Sep 04 21:51:37.216565 ip-10-0-128-61 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 04 21:51:37.216577 ip-10-0-128-61 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 04 21:51:37.216585 ip-10-0-128-61 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 04 21:51:37.216753 ip-10-0-128-61 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 04 21:51:48.590722 ip-10-0-128-61 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 04 21:51:48.590741 ip-10-0-128-61 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1f22641093844aff991930583e0e1b89 --
Sep 04 21:53:23.101891 ip-10-0-128-61 systemd[1]: Starting Kubernetes Kubelet...
Sep 04 21:53:23.535765 ip-10-0-128-61 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 04 21:53:23.535765 ip-10-0-128-61 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 04 21:53:23.535765 ip-10-0-128-61 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 04 21:53:23.535765 ip-10-0-128-61 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 04 21:53:23.535765 ip-10-0-128-61 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 04 21:53:23.536524 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.535840    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 04 21:53:23.540787 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540767    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 21:53:23.540787 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540786    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 21:53:23.540787 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540791    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 21:53:23.540787 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540795    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540799    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540804    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540808    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540812    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540815    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540819    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540832    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540838    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540842    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540845    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540849    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540853    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540857    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540861    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540864    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540868    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540872    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540876    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540880    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 21:53:23.541032 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540884    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540888    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540892    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540896    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540899    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540903    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540907    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540911    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540916    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540920    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540924    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540928    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540933    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540938    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540944    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540948    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540952    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540959    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540966    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 21:53:23.541592 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540970    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540975    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540979    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540983    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540988    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540992    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.540996    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541000    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541005    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541009    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541014    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541018    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541023    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541027    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541032    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541039    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541044    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541050    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541054    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 21:53:23.542162 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541059    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541063    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541067    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541072    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541076    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541080    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541085    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541089    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541095    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541100    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541104    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541109    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541113    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541117    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541122    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541126    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541130    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541134    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541138    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541145    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 21:53:23.542904 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541149    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541153    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541157    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541162    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541167    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541171    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541175    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541179    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541183    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541187    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541191    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541195    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541199    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541204    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541208    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541212    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541217    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.541221    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543122    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543142    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 21:53:23.543678 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543151    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543156    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543162    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543167    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543172    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543176    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543180    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543184    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543190    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543195    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543206    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543210    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543214    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543219    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543223    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543228    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543233    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543237    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543241    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543245    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 21:53:23.544293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543250    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543254    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543263    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543267    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543272    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543276    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543280    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543284    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543289    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543293    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543297    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543304    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543308    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543313    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543316    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543325    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543328    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543334    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543339    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 21:53:23.544873 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543343    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543349    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543356    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543361    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543366    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543371    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543376    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543385    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543393    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543400    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543404    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543408    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543413    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543417    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543421    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543426    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543430    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543435    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543444    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 21:53:23.545348 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543448    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543452    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543456    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543460    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543465    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543471    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543476    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543481    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543485    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543489    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543493    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543497    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543506    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543510    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543514    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543518    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543523    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543527    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543532    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543536    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 21:53:23.545842 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543541    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543545    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543549    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543554    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543558    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543565    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543569    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543573    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543578    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543583    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543589    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543654    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543658    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543662    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543666    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543670    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543675    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543679    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.543688    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544479    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 21:53:23.546344 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544489    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544493    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544496    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544499    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544502    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544505    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544508    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544511    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544513    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544516    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544519    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544523    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544527    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544530    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544533    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544536    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544539    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544541    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544544    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 21:53:23.546850 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544547    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544549    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544552    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544554    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544557    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544560    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544562    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544565    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544568    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544570    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544573    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544577    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544581    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544585    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544588    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544591    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544594    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544597    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544599    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544602    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 21:53:23.547317 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544604    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544607    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544609    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544612    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544615    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544618    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544620    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544623    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544625    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544628    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544631    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544647    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544650    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544652    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544656    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544658    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544661    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544664    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544667    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544669    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 21:53:23.547822 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544672    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544675    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544677    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544680    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544683    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544687    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544689    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544692    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544695    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544697    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544700    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544703    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544706    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544708    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544711    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544716    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544719    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544722    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544725    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 21:53:23.548303 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544728    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544731    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544734    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544737    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544739    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544742    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544744    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544747    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544749    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544752    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544755    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544758    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544761    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544763    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544766    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544768    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544771    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544773    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544776    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.544779    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 21:53:23.548791 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544848    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544890    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544898    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544903    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544907    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544910    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544914    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544918    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544922    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544925    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544928    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544931    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544935    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544938    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544940    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544943    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544948    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544951    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544956    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544958    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544961    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544965    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544969    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544973    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 04 21:53:23.549321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544976    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544979    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544982    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544986    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544989    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544991    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544995    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.544998    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545002    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545006    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545009    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545012    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545015    2577 flags.go:64] FLAG: --enable-server="true"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545018    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545022    2577 flags.go:64] FLAG: --event-burst="100"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545025    2577 flags.go:64] FLAG: --event-qps="50"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545028    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545031    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545034    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545038    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545041    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545044    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545047    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545050    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545053    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 04 21:53:23.549924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545056    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545059    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545062    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545065    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545069    2577 flags.go:64] FLAG: --feature-gates=""
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545073    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545076    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545079    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545082    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545085    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545088    2577 flags.go:64] FLAG: --help="false"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545091    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-61.ec2.internal"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545094    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545097    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545100    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545104    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545108    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545110    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545113    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545116    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545119    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545122    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545125    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545128    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 04 21:53:23.550544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545131    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545134    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545137    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545139    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545142    2577 flags.go:64] FLAG: --lock-file=""
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545145    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545148    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545151    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545157    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545160    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545163    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545166    2577 flags.go:64] FLAG: --logging-format="text"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545169    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545173    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545175    2577 flags.go:64] FLAG: --manifest-url=""
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545178    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545183    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545186    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545189    2577 flags.go:64] FLAG: --max-pods="110"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545192    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545195    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545202    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545205    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545208    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545211    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 04 21:53:23.551169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545215    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545222    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545226    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545229    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545232    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545235    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545241    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545244    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545247    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545250    2577 flags.go:64] FLAG: --port="10250"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545253    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545256    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0361a7801444a68cc"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545259    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545262    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545265    2577 flags.go:64] FLAG: --register-node="true"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545268    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545272    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545276    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545279    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545281    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545285    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545288    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545291    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545295    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545297    2577 flags.go:64] FLAG: --runonce="false"
Sep 04 21:53:23.551823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545300    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545303    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545306    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545309    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545313    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545316    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545319    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545322    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545325    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545328    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545331    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545334    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545338    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545341    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545343    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545349    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545352    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545355    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545360    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545363    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545366    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545369    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545372    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545375    2577 flags.go:64] FLAG: --v="2"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545379    2577 flags.go:64] FLAG: --version="false"
Sep 04 21:53:23.552426 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545385    2577 flags.go:64] FLAG: --vmodule=""
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545388    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.545392    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545510    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545514    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545518    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545522    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545525    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545530    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545534    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545537    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545541    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545544    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545547    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545549    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545552    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545554    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545557    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545562    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545564    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 21:53:23.553066 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545567    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545570    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545573    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545576    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545578    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545581    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545584    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545587    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545589    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545592    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545594    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545597    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545599    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545603    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545605    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545608    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545611    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545613    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545616    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545619    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 21:53:23.553553 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545621    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545624    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545627    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545631    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545649    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545654    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545658    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545661    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545663    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545666    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545671    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545674    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545676    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545679    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545682    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545684    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545687    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545690    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545693    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 21:53:23.554063 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545695    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545698    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545700    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545703    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545706    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545709    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545711    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545715    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545717    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545720    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545723    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545725    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545728    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545730    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545733    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545736    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545741    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545745    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545748    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 21:53:23.554538 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545751    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545754    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545757    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545760    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545764    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545767    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545770    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545773    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545775    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545778    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545781    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545783    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545786    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545788    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545791    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545794    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545796    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545799    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545801    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545804    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 21:53:23.555033 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545806    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545810    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545812    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.545815    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.546214    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.552911    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.552928    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.552948    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.552954    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553008    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553013    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553016    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553020    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553022    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553025    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 21:53:23.555565 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553028    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553030    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553033    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553036    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553038    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553041    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553044    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553047    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553051    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553054    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553057    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553060    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553063    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553066    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553069    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553072    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553075    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553079    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553082    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 21:53:23.555958 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553085    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553088    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553090    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553093    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553100    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553103    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553106    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553109    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553113    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553116    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553119    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553122    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553126    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553129    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553132    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553134    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553137    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553140    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553143    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 21:53:23.556461 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553145    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553148    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553151    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553154    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553156    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553159    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553162    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553165    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553168    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553171    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553174    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553176    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553179    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553181    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553184    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553187    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553205    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553208    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553212    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 21:53:23.556943 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553216    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553220    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553224    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553227    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553230    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553232    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553235    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553238    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553241    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553244    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553246    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553249    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553252    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553254    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553257    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553259    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553262    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553265    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553267    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553270    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 21:53:23.557415 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553272    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553275    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553278    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553280    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553283    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553285    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553288    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553290    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553294    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553296    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553299    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553301    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553304    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553307    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553309    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 21:53:23.557914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553312    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.553317    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553441    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553445    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553448    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553451    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553453    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553456    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553459    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553462    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553464    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553467    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553469    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553472    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553474    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 21:53:23.558281 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553477    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553480    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553482    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553485    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553487    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553490    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553492    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553495    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553497    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553501    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553503    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553506    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553508    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553511    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553513    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553516    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553519    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553521    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553524    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553526    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 21:53:23.558774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553529    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553532    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553534    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553537    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553540    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553542    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553545    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553547    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553550    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553552    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553555    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553557    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553560    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553563    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553566    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553568    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553572    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553576    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553578    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 21:53:23.559270 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553581    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553584    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553586    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553589    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553591    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553594    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553596    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553599    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553601    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553605    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553607    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553610    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553612    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553615    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553619    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553622    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553626    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553628    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553631    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553650    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 21:53:23.559774 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553653    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553656    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553659    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553661    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553664    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553666    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553669    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553672    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553675    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553679    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553682    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553685    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553688    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553691    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553693    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553696    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553699    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553701    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553704    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 21:53:23.560248 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553707    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553709    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553712    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553715    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553718    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553720    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553723    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:23.553725    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.553730    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.553834    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.555972    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.556774    2577 server.go:1019] "Starting client certificate rotation"
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.556869    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 04 21:53:23.560718 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.556902    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 04 21:53:23.561040 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.559039    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 04 21:53:23.561581 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.561563    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 04 21:53:23.574396 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.574371    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 04 21:53:23.576905 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.576889    2577 log.go:25] "Validated CRI v1 image API"
Sep 04 21:53:23.577803 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.577774    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 04 21:53:23.582244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.582221    2577 fs.go:135] Filesystem UUIDs: map[5eb09e7d-dd13-4270-aff5-ad72adb9c890:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a86c0dcb-89c3-4bed-b7bb-29f751562f93:/dev/nvme0n1p4]
Sep 04 21:53:23.582324 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.582242    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 04 21:53:23.586925 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.586813    2577 manager.go:216] Machine: {Timestamp:2026-09-04 21:53:23.585674784 +0000 UTC m=+0.357687784 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101626 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ffad3477bb9b25d4e8c26d9a6cd4f SystemUUID:ec2ffad3-477b-b9b2-5d4e-8c26d9a6cd4f BootID:1f226410-9384-4aff-9919-30583e0e1b89 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:d5:28:be:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:d5:28:be:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:5f:fe:82:f5:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 04 21:53:23.586925 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.586914    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 04 21:53:23.587056 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.586985    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 04 21:53:23.589100 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.589077    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 04 21:53:23.589230 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.589103    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 04 21:53:23.589577 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.589562    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 04 21:53:23.590184 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.590172    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 04 21:53:23.590230 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.590186    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 04 21:53:23.590230 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.590194    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 04 21:53:23.590770 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.590760    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 04 21:53:23.591903 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.591891    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 04 21:53:23.595261 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595248    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 04 21:53:23.595381 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595372    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 04 21:53:23.595418 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595404    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 04 21:53:23.595449 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595421    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 04 21:53:23.595449 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595437    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 04 21:53:23.595449 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595447    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 04 21:53:23.595556 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595455    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 04 21:53:23.595794 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595782    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 04 21:53:23.595839 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.595802    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 04 21:53:23.597667 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.597651    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 04 21:53:23.599659 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.599624    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 04 21:53:23.599702 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.599677    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 04 21:53:23.600358 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600348    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 04 21:53:23.600391 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600363    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 04 21:53:23.600391 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600370    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 04 21:53:23.600391 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600375    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 04 21:53:23.600391 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600384    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 04 21:53:23.600391 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600389    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 04 21:53:23.600525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600402    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 04 21:53:23.600525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600407    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 04 21:53:23.600525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600413    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 04 21:53:23.600525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600423    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 04 21:53:23.600525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600435    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 04 21:53:23.600525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.600440    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 04 21:53:23.601088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.601077    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 04 21:53:23.601088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.601089    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 04 21:53:23.604614 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.604598    2577 server.go:1268] "Started kubelet"
Sep 04 21:53:23.604727 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.604676    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 04 21:53:23.604822 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.604767    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 04 21:53:23.604877 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.604837    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 04 21:53:23.605397 ip-10-0-128-61 systemd[1]: Started Kubernetes Kubelet.
Sep 04 21:53:23.606099 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.606079    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 04 21:53:23.610392 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.610377    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 04 21:53:23.611393 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.611369    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 04 21:53:23.611530 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.611505    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 04 21:53:23.611651 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.611613    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 04 21:53:23.614010 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.613246    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc174bfa067  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.604578407 +0000 UTC m=+0.376591410,LastTimestamp:2026-09-04 21:53:23.604578407 +0000 UTC m=+0.376591410,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.614112 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.614093    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 04 21:53:23.614510 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.614495    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 04 21:53:23.614962 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.614943    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 04 21:53:23.615107 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.615088    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:23.615580 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615566    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 04 21:53:23.615711 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615575    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 04 21:53:23.615711 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615713    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 04 21:53:23.615856 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615775    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 04 21:53:23.615856 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615787    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 04 21:53:23.615970 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615891    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 04 21:53:23.615970 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615905    2577 factory.go:55] Registering systemd factory
Sep 04 21:53:23.615970 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.615914    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 04 21:53:23.616101 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.616087    2577 factory.go:153] Registering CRI-O factory
Sep 04 21:53:23.616101 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.616101    2577 factory.go:223] Registration of the crio container factory successfully
Sep 04 21:53:23.616227 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.616115    2577 factory.go:103] Registering Raw factory
Sep 04 21:53:23.616227 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.616127    2577 manager.go:1196] Started watching for new ooms in manager
Sep 04 21:53:23.616465 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.616453    2577 manager.go:349] Starting recovery of all containers
Sep 04 21:53:23.622613 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.622585    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 04 21:53:23.623019 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.622995    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 04 21:53:23.628991 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.628880    2577 manager.go:354] Recovery completed
Sep 04 21:53:23.633437 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.633422    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.634950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.634935    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.635011 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.634959    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.635011 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.634969    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.635509 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.635492    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 04 21:53:23.635568 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.635511    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 04 21:53:23.635568 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.635499    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.635568 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.635529    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 04 21:53:23.636259 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.636244    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.636321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.636268    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.636321 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.636279    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.636665 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.636626    2577 policy_none.go:49] "None policy: Start"
Sep 04 21:53:23.636701 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.636665    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 04 21:53:23.636701 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.636683    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 04 21:53:23.637707 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.637694    2577 policy_none.go:47] "Start"
Sep 04 21:53:23.638412 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.637729    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc1768f09eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.634948587 +0000 UTC m=+0.406961588,LastTimestamp:2026-09-04 21:53:23.634948587 +0000 UTC m=+0.406961588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.646953 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.646495    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc1768f46ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-61.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.634964154 +0000 UTC m=+0.406977156,LastTimestamp:2026-09-04 21:53:23.634964154 +0000 UTC m=+0.406977156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.649355 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.649289    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc1768f7c97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-61.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.634977943 +0000 UTC m=+0.406990944,LastTimestamp:2026-09-04 21:53:23.634977943 +0000 UTC m=+0.406990944,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.657212 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.657155    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-61.ec2.internal.18d23cc1768f09eb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc1768f09eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.634948587 +0000 UTC m=+0.406961588,LastTimestamp:2026-09-04 21:53:23.636257645 +0000 UTC m=+0.408270645,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.659594 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.659539    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-61.ec2.internal.18d23cc1768f46ba\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc1768f46ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-61.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.634964154 +0000 UTC m=+0.406977156,LastTimestamp:2026-09-04 21:53:23.636272993 +0000 UTC m=+0.408285993,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.661292 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661276    2577 manager.go:337] "Starting Device Plugin manager"
Sep 04 21:53:23.661367 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.661317    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 04 21:53:23.661367 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661330    2577 server.go:87] "Starting device plugin registration server"
Sep 04 21:53:23.661610 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661597    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 04 21:53:23.661699 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661611    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 04 21:53:23.661759 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661735    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 04 21:53:23.661821 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661810    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 04 21:53:23.661854 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.661821    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 04 21:53:23.662448 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.662428    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 04 21:53:23.662508 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.662482    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:23.663905 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.663890    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l4qtc"
Sep 04 21:53:23.665913 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.665858    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-61.ec2.internal.18d23cc1768f7c97\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc1768f7c97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-61.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.634977943 +0000 UTC m=+0.406990944,LastTimestamp:2026-09-04 21:53:23.63628527 +0000 UTC m=+0.408298273,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.676749 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.676729    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l4qtc"
Sep 04 21:53:23.677437 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.677376    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-61.ec2.internal.18d23cc178f266c8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-61.ec2.internal,UID:ip-10-0-128-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-61.ec2.internal,},FirstTimestamp:2026-09-04 21:53:23.675014856 +0000 UTC m=+0.447027844,LastTimestamp:2026-09-04 21:53:23.675014856 +0000 UTC m=+0.447027844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-61.ec2.internal,}"
Sep 04 21:53:23.681597 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.681579    2577 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2611 into the system container \"/system.slice\": <nil>"
Sep 04 21:53:23.762256 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.762240    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.763970 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.763954    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.764056 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.763983    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.764056 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.763997    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.764056 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.764026    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-61.ec2.internal"
Sep 04 21:53:23.782808 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.782794    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-61.ec2.internal"
Sep 04 21:53:23.782892 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.782812    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-61.ec2.internal\": node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:23.822978 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.822960    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:23.843050 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.843029    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 04 21:53:23.844184 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.844168    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 04 21:53:23.844238 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.844223    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 04 21:53:23.844288 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.844248    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 04 21:53:23.844340 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.844289    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 04 21:53:23.847918 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.847901    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 21:53:23.923473 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.923446    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:23.944612 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.944582    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"]
Sep 04 21:53:23.944676 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.944666    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.946100 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.946084    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.946231 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.946114    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.946231 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.946129    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.947379 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.947365    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.947519 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.947506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:23.947566 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.947532    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.948036 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.948022    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.948125 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.948052    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.948125 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.948066    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.948125 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.948102    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.948125 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.948124    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.948304 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.948138    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.949282 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.949267    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:23.949361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.949296    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:23.949941 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.949927    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:23.950016 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.949950    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:23.950016 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:23.949963    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:23.969246 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.969228    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-61.ec2.internal\" not found" node="ip-10-0-128-61.ec2.internal"
Sep 04 21:53:23.973553 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:23.973537    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-61.ec2.internal\" not found" node="ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.018256 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.018236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9bc02de3d951ad38e1949ea90d1cdf11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal\" (UID: \"9bc02de3d951ad38e1949ea90d1cdf11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.018323 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.018260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bc02de3d951ad38e1949ea90d1cdf11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal\" (UID: \"9bc02de3d951ad38e1949ea90d1cdf11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.018323 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.018276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fed4194045521f365d114faefa73311c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-61.ec2.internal\" (UID: \"fed4194045521f365d114faefa73311c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.024348 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.024325    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.118965 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.118914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9bc02de3d951ad38e1949ea90d1cdf11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal\" (UID: \"9bc02de3d951ad38e1949ea90d1cdf11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.118965 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.118941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bc02de3d951ad38e1949ea90d1cdf11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal\" (UID: \"9bc02de3d951ad38e1949ea90d1cdf11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.118965 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.118958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fed4194045521f365d114faefa73311c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-61.ec2.internal\" (UID: \"fed4194045521f365d114faefa73311c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.119104 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.119014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fed4194045521f365d114faefa73311c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-61.ec2.internal\" (UID: \"fed4194045521f365d114faefa73311c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.119104 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.119027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bc02de3d951ad38e1949ea90d1cdf11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal\" (UID: \"9bc02de3d951ad38e1949ea90d1cdf11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.119104 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.119015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9bc02de3d951ad38e1949ea90d1cdf11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal\" (UID: \"9bc02de3d951ad38e1949ea90d1cdf11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.125032 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.125017    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.225535 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.225509    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.273695 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.273672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.275910 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.275885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:24.325855 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.325830    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.426041 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.425981    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.454647 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.454622    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 21:53:24.526288 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.526261    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.556697 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.556666    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 04 21:53:24.557137 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.556839    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 04 21:53:24.557137 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.556854    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 04 21:53:24.626366 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.626340    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.664297 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.664272    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 21:53:24.665182 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.665166    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 21:53:24.665246 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.665196    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 21:53:24.665246 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.665206    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeHasSufficientPID"
Sep 04 21:53:24.678727 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.678669    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-03 21:48:24 +0000 UTC" deadline="2028-04-23 21:12:39.176123938 +0000 UTC"
Sep 04 21:53:24.678727 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.678693    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14327h19m14.497434286s"
Sep 04 21:53:24.726776 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.726750    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.755791 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.755773    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 21:53:24.827137 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.827106    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.928180 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:24.928158    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:24.980583 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:24.980554    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc02de3d951ad38e1949ea90d1cdf11.slice/crio-51d7142b25f53a2087e08978272b73738719e73670fd8c291feb1438e5eabd35 WatchSource:0}: Error finding container 51d7142b25f53a2087e08978272b73738719e73670fd8c291feb1438e5eabd35: Status 404 returned error can't find the container with id 51d7142b25f53a2087e08978272b73738719e73670fd8c291feb1438e5eabd35
Sep 04 21:53:24.988952 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:24.988933    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 21:53:24.992853 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:24.992831    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed4194045521f365d114faefa73311c.slice/crio-44ab709a011262c57456bbc3f526e65b44f3210512ce0a75807224f9138d615c WatchSource:0}: Error finding container 44ab709a011262c57456bbc3f526e65b44f3210512ce0a75807224f9138d615c: Status 404 returned error can't find the container with id 44ab709a011262c57456bbc3f526e65b44f3210512ce0a75807224f9138d615c
Sep 04 21:53:25.028487 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.028457    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-61.ec2.internal\" not found"
Sep 04 21:53:25.054419 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.054394    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 21:53:25.116474 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.116449    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:25.131557 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.131536    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 04 21:53:25.132419 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.132407    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal"
Sep 04 21:53:25.141917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.141895    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 04 21:53:25.430822 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.430748    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 21:53:25.598275 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.598200    2577 apiserver.go:52] "Watching apiserver"
Sep 04 21:53:25.604250 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.604220    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 04 21:53:25.605470 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.605413    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-knwk6","openshift-network-operator/iptables-alerter-854cw","openshift-ovn-kubernetes/ovnkube-node-tv5qw","kube-system/global-pull-secret-syncer-dvvh2","kube-system/konnectivity-agent-n7k9f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8","openshift-cluster-node-tuning-operator/tuned-jvst9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal","openshift-network-diagnostics/network-check-target-bfglg","kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal","openshift-dns/node-resolver-fwp9d","openshift-image-registry/node-ca-kkwjz","openshift-multus/multus-additional-cni-plugins-5r2zk","openshift-multus/multus-t2zf5"]
Sep 04 21:53:25.608227 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.608196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.610618 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.610594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.611521 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.611495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.611633 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.611589    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vhvnl\""
Sep 04 21:53:25.611848 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.611822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.612914 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.612890    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.613060 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.613019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xjxsh\""
Sep 04 21:53:25.613060 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.613052    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 04 21:53:25.613195 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.613171    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 04 21:53:25.613392 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.613365    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 04 21:53:25.613464 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.613444    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.613524 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.613447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.615055 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.615032    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 04 21:53:25.615706 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.615680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 04 21:53:25.616489 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.616489 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.616100    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:25.616489 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616111    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 04 21:53:25.616489 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x75w5\""
Sep 04 21:53:25.616489 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616356    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 04 21:53:25.616830 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616584    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.616830 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616777    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 04 21:53:25.616933 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.616846    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.619766 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.619744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.621566 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.621548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.622186 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.622167    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 04 21:53:25.622338 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.622297    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 04 21:53:25.625652 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.624071    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gkdzt\""
Sep 04 21:53:25.625652 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.624715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:25.625652 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.624804    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-cni-bin\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22w96\" (UniqueName: \"kubernetes.io/projected/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-kube-api-access-22w96\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-dbus\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-modprobe-d\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-lib-modules\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-kubelet-config\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72d4dfda-8b90-4f4d-93f7-fe171807c3bb-konnectivity-ca\") pod \"konnectivity-agent-n7k9f\" (UID: \"72d4dfda-8b90-4f4d-93f7-fe171807c3bb\") " pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-kubernetes\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysctl-conf\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-system-cni-dir\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-var-lib-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.627996 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.627988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-env-overrides\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-systemd\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-run\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53128034-f3fe-4fca-8656-8e17e049d180-tmp\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovn-node-metrics-cert\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72d4dfda-8b90-4f4d-93f7-fe171807c3bb-agent-certs\") pod \"konnectivity-agent-n7k9f\" (UID: \"72d4dfda-8b90-4f4d-93f7-fe171807c3bb\") " pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628337    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628410    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-host\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-slash\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-run-netns\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-log-socket\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628642    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j5kcv\""
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628702    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53128034-f3fe-4fca-8656-8e17e049d180-etc-tuned\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmsn\" (UniqueName: \"kubernetes.io/projected/53128034-f3fe-4fca-8656-8e17e049d180-kube-api-access-qlmsn\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.628906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-cnibin\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.629848 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-systemd-units\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.629848 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-systemd\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.629848 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-cni-netd\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.629848 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.628980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovnkube-config\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.629848 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.629015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysconfig\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.630247 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.629857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysctl-d\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.630247 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.629903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-kubelet\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.630247 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.629931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-etc-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.630247 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.629966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovnkube-script-lib\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.630247 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptj8w\" (UniqueName: \"kubernetes.io/projected/70efcff8-67a7-4d35-9300-beff862fbb5f-kube-api-access-ptj8w\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.630551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-sys\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.630551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-var-lib-kubelet\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.630551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.630551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.630551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-ovn\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.630551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.630500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-node-log\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.631666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.631643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:25.631875 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.631759    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:25.635931 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.635910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.639434 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.639416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.641150 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.641129    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 04 21:53:25.641430 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.641406    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.641521 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.641476    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.641878 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.641856    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qr8nv\""
Sep 04 21:53:25.642175 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.642157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.644635 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.644615    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 04 21:53:25.644757 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.644681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.645493 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.645315    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hl8jm\""
Sep 04 21:53:25.645493 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.645438    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.645757 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.645737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jgjll\""
Sep 04 21:53:25.645837 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.645737    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 04 21:53:25.645837 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.645811    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.646841 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.646820    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 04 21:53:25.647472 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.647446    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-slr9c\""
Sep 04 21:53:25.647560 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.647525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 04 21:53:25.647827 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.647811    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 04 21:53:25.661975 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.661936    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-29cg7"
Sep 04 21:53:25.679030 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.678774    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-29cg7"
Sep 04 21:53:25.717288 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.717202    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 04 21:53:25.731546 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-kubernetes\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.731660 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-var-lib-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.731660 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-system-cni-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.731660 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-cni-multus\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-run\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f381a89-94bb-48c7-8bdd-b44e56695651-hosts-file\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcdx\" (UniqueName: \"kubernetes.io/projected/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-kube-api-access-hpcdx\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-kubernetes\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-host\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-slash\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.731858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-host\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-log-socket\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-netns\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-var-lib-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-slash\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmsn\" (UniqueName: \"kubernetes.io/projected/53128034-f3fe-4fca-8656-8e17e049d180-kube-api-access-qlmsn\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-cnibin\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-log-socket\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.731981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-systemd\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-cni-netd\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-systemd\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-cnibin\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-run\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysconfig\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-cni-netd\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-kubelet\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-etc-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.732244 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732161    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysconfig\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b321a8c3-7d3d-49b9-80e0-9e70498071d1-iptables-alerter-script\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-kubelet\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blk9f\" (UniqueName: \"kubernetes.io/projected/b321a8c3-7d3d-49b9-80e0-9e70498071d1-kube-api-access-blk9f\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-etc-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-k8s-cni-cncf-io\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-cni-bin\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptj8w\" (UniqueName: \"kubernetes.io/projected/70efcff8-67a7-4d35-9300-beff862fbb5f-kube-api-access-ptj8w\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-ovn\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-cni-bin\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-dbus\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-ovn\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5zj\" (UniqueName: \"kubernetes.io/projected/ce981603-50b1-4f7d-b1fd-f8be6253ac29-kube-api-access-pr5zj\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-etc-kubernetes\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-cni-bin\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.733088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-dbus\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw677\" (UniqueName: \"kubernetes.io/projected/2e880518-4c71-4ae3-a31f-a0d584f72c0d-kube-api-access-sw677\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-registration-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.732795    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-sys-fs\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-serviceca\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.732886    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:26.232848519 +0000 UTC m=+3.004861530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-lib-modules\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-cni-binary-copy\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.732992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-conf-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-host\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysctl-conf\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-system-cni-dir\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.733917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-env-overrides\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-socket-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-lib-modules\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-etc-selinux\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f381a89-94bb-48c7-8bdd-b44e56695651-tmp-dir\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-systemd\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53128034-f3fe-4fca-8656-8e17e049d180-tmp\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-system-cni-dir\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovn-node-metrics-cert\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72d4dfda-8b90-4f4d-93f7-fe171807c3bb-agent-certs\") pod \"konnectivity-agent-n7k9f\" (UID: \"72d4dfda-8b90-4f4d-93f7-fe171807c3bb\") " pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b321a8c3-7d3d-49b9-80e0-9e70498071d1-host-slash\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysctl-conf\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70efcff8-67a7-4d35-9300-beff862fbb5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-env-overrides\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrplz\" (UniqueName: \"kubernetes.io/projected/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-kube-api-access-qrplz\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-systemd\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.734807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.733977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-run-netns\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-run-netns\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-cni-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-cnibin\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734123    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-kubelet\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53128034-f3fe-4fca-8656-8e17e049d180-etc-tuned\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-systemd-units\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovnkube-config\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysctl-d\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovnkube-script-lib\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-systemd-units\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-daemon-config\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.735666 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z768m\" (UniqueName: \"kubernetes.io/projected/6f381a89-94bb-48c7-8bdd-b44e56695651-kube-api-access-z768m\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-sys\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-var-lib-kubelet\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-node-log\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-multus-certs\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22w96\" (UniqueName: \"kubernetes.io/projected/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-kube-api-access-22w96\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-device-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-socket-dir-parent\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-hostroot\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-modprobe-d\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovnkube-config\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.734933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-sysctl-d\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovnkube-script-lib\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70efcff8-67a7-4d35-9300-beff862fbb5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.736595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-kubelet-config\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-node-log\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72d4dfda-8b90-4f4d-93f7-fe171807c3bb-konnectivity-ca\") pod \"konnectivity-agent-n7k9f\" (UID: \"72d4dfda-8b90-4f4d-93f7-fe171807c3bb\") " pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-sys\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-var-lib-kubelet\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.735756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-run-openvswitch\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.736007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53128034-f3fe-4fca-8656-8e17e049d180-etc-modprobe-d\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.736061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-kubelet-config\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:25.737453 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.736232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72d4dfda-8b90-4f4d-93f7-fe171807c3bb-konnectivity-ca\") pod \"konnectivity-agent-n7k9f\" (UID: \"72d4dfda-8b90-4f4d-93f7-fe171807c3bb\") " pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.740918 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.740569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53128034-f3fe-4fca-8656-8e17e049d180-etc-tuned\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.741029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.740919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72d4dfda-8b90-4f4d-93f7-fe171807c3bb-agent-certs\") pod \"konnectivity-agent-n7k9f\" (UID: \"72d4dfda-8b90-4f4d-93f7-fe171807c3bb\") " pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.741916 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.741870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-ovn-node-metrics-cert\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.743751 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.743674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmsn\" (UniqueName: \"kubernetes.io/projected/53128034-f3fe-4fca-8656-8e17e049d180-kube-api-access-qlmsn\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.744041 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.743999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53128034-f3fe-4fca-8656-8e17e049d180-tmp\") pod \"tuned-jvst9\" (UID: \"53128034-f3fe-4fca-8656-8e17e049d180\") " pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.745572 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.745530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22w96\" (UniqueName: \"kubernetes.io/projected/7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac-kube-api-access-22w96\") pod \"ovnkube-node-tv5qw\" (UID: \"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.745866 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.745847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptj8w\" (UniqueName: \"kubernetes.io/projected/70efcff8-67a7-4d35-9300-beff862fbb5f-kube-api-access-ptj8w\") pod \"multus-additional-cni-plugins-5r2zk\" (UID: \"70efcff8-67a7-4d35-9300-beff862fbb5f\") " pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.836088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-system-cni-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.836218 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-cni-multus\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.836218 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.836218 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f381a89-94bb-48c7-8bdd-b44e56695651-hosts-file\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.836218 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcdx\" (UniqueName: \"kubernetes.io/projected/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-kube-api-access-hpcdx\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.836218 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-netns\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b321a8c3-7d3d-49b9-80e0-9e70498071d1-iptables-alerter-script\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blk9f\" (UniqueName: \"kubernetes.io/projected/b321a8c3-7d3d-49b9-80e0-9e70498071d1-kube-api-access-blk9f\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-k8s-cni-cncf-io\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-cni-bin\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5zj\" (UniqueName: \"kubernetes.io/projected/ce981603-50b1-4f7d-b1fd-f8be6253ac29-kube-api-access-pr5zj\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-etc-kubernetes\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw677\" (UniqueName: \"kubernetes.io/projected/2e880518-4c71-4ae3-a31f-a0d584f72c0d-kube-api-access-sw677\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:25.836490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-registration-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-sys-fs\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-serviceca\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-cni-binary-copy\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-conf-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-host\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-socket-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-etc-selinux\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f381a89-94bb-48c7-8bdd-b44e56695651-tmp-dir\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b321a8c3-7d3d-49b9-80e0-9e70498071d1-host-slash\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrplz\" (UniqueName: \"kubernetes.io/projected/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-kube-api-access-qrplz\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-cni-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-cnibin\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-kubelet\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-daemon-config\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z768m\" (UniqueName: \"kubernetes.io/projected/6f381a89-94bb-48c7-8bdd-b44e56695651-kube-api-access-z768m\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-multus-certs\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.836971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-device-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.837013 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-socket-dir-parent\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-hostroot\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-hostroot\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-system-cni-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-cni-multus\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837264    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f381a89-94bb-48c7-8bdd-b44e56695651-hosts-file\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.837930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.837559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-netns\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.838283 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838161    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b321a8c3-7d3d-49b9-80e0-9e70498071d1-iptables-alerter-script\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.838490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b321a8c3-7d3d-49b9-80e0-9e70498071d1-host-slash\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.838567 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-etc-selinux\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.838627 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-socket-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-conf-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f381a89-94bb-48c7-8bdd-b44e56695651-tmp-dir\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-serviceca\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-registration-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-host\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.838963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-socket-dir-parent\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-device-dir\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-multus-certs\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-cni-dir\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.839086    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-cnibin\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.839137    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:53:26.339121616 +0000 UTC m=+3.111134621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-run-k8s-cni-cncf-io\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-kubelet\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-host-var-lib-cni-bin\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-etc-kubernetes\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.839254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce981603-50b1-4f7d-b1fd-f8be6253ac29-sys-fs\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.840177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-multus-daemon-config\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.840177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.839427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-cni-binary-copy\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.850696 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.850677    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:25.850824 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.850700    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:25.850824 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.850748    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:25.850950 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:25.850881    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:53:26.350861798 +0000 UTC m=+3.122874803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:25.850950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.850928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5zj\" (UniqueName: \"kubernetes.io/projected/ce981603-50b1-4f7d-b1fd-f8be6253ac29-kube-api-access-pr5zj\") pod \"aws-ebs-csi-driver-node-lggj8\" (UID: \"ce981603-50b1-4f7d-b1fd-f8be6253ac29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.851285 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.851197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal" event={"ID":"fed4194045521f365d114faefa73311c","Type":"ContainerStarted","Data":"44ab709a011262c57456bbc3f526e65b44f3210512ce0a75807224f9138d615c"}
Sep 04 21:53:25.851570 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.851514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrplz\" (UniqueName: \"kubernetes.io/projected/4c6f13b7-ea2d-4141-89c1-aa05b26a0d13-kube-api-access-qrplz\") pod \"multus-t2zf5\" (UID: \"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13\") " pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.851673 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.851597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blk9f\" (UniqueName: \"kubernetes.io/projected/b321a8c3-7d3d-49b9-80e0-9e70498071d1-kube-api-access-blk9f\") pod \"iptables-alerter-854cw\" (UID: \"b321a8c3-7d3d-49b9-80e0-9e70498071d1\") " pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.853639 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.853328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal" event={"ID":"9bc02de3d951ad38e1949ea90d1cdf11","Type":"ContainerStarted","Data":"51d7142b25f53a2087e08978272b73738719e73670fd8c291feb1438e5eabd35"}
Sep 04 21:53:25.853639 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.853618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z768m\" (UniqueName: \"kubernetes.io/projected/6f381a89-94bb-48c7-8bdd-b44e56695651-kube-api-access-z768m\") pod \"node-resolver-fwp9d\" (UID: \"6f381a89-94bb-48c7-8bdd-b44e56695651\") " pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.853810 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.853620    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcdx\" (UniqueName: \"kubernetes.io/projected/a17e9807-9b5e-4cc5-90c3-7c6afd89e797-kube-api-access-hpcdx\") pod \"node-ca-kkwjz\" (UID: \"a17e9807-9b5e-4cc5-90c3-7c6afd89e797\") " pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:25.853810 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.853729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw677\" (UniqueName: \"kubernetes.io/projected/2e880518-4c71-4ae3-a31f-a0d584f72c0d-kube-api-access-sw677\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:25.922956 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.922925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvst9"
Sep 04 21:53:25.933878 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.933854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:25.934308 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.934283    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53128034_f3fe_4fca_8656_8e17e049d180.slice/crio-c273c28f5fdfd7f444c3f472c36000ec7ff4fa150a1b8accf40d1825d0e1af9f WatchSource:0}: Error finding container c273c28f5fdfd7f444c3f472c36000ec7ff4fa150a1b8accf40d1825d0e1af9f: Status 404 returned error can't find the container with id c273c28f5fdfd7f444c3f472c36000ec7ff4fa150a1b8accf40d1825d0e1af9f
Sep 04 21:53:25.944473 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.944449    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2c1f29_d7e4_45b0_8100_1a27a8fc01ac.slice/crio-72a0e47f6ecf073f1e78b8f747bdebc7315407f357884de4f012837b5ea6c633 WatchSource:0}: Error finding container 72a0e47f6ecf073f1e78b8f747bdebc7315407f357884de4f012837b5ea6c633: Status 404 returned error can't find the container with id 72a0e47f6ecf073f1e78b8f747bdebc7315407f357884de4f012837b5ea6c633
Sep 04 21:53:25.945946 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.945802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5r2zk"
Sep 04 21:53:25.955836 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.955673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:25.955836 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.955822    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70efcff8_67a7_4d35_9300_beff862fbb5f.slice/crio-62b1f5db2895ac40e291f4a7e4ff78c27aaf73ff464170968c86281e1b5cdab2 WatchSource:0}: Error finding container 62b1f5db2895ac40e291f4a7e4ff78c27aaf73ff464170968c86281e1b5cdab2: Status 404 returned error can't find the container with id 62b1f5db2895ac40e291f4a7e4ff78c27aaf73ff464170968c86281e1b5cdab2
Sep 04 21:53:25.964736 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.964664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8"
Sep 04 21:53:25.966527 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.966473    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d4dfda_8b90_4f4d_93f7_fe171807c3bb.slice/crio-a36a406e93a35b2075de715a851fa91654002f1e3ed58ee4b571a37361155446 WatchSource:0}: Error finding container a36a406e93a35b2075de715a851fa91654002f1e3ed58ee4b571a37361155446: Status 404 returned error can't find the container with id a36a406e93a35b2075de715a851fa91654002f1e3ed58ee4b571a37361155446
Sep 04 21:53:25.974182 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.974159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-854cw"
Sep 04 21:53:25.977562 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.977534    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce981603_50b1_4f7d_b1fd_f8be6253ac29.slice/crio-19bd7b5ebd1e6b7649d41c3824c554ff0524cf943c4cd6e003eb906d12529f36 WatchSource:0}: Error finding container 19bd7b5ebd1e6b7649d41c3824c554ff0524cf943c4cd6e003eb906d12529f36: Status 404 returned error can't find the container with id 19bd7b5ebd1e6b7649d41c3824c554ff0524cf943c4cd6e003eb906d12529f36
Sep 04 21:53:25.982400 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.982233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2zf5"
Sep 04 21:53:25.984284 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.984061    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb321a8c3_7d3d_49b9_80e0_9e70498071d1.slice/crio-534fb70b04ea93cea1316e15a4392fe35f5800b33db5aa6daa0fdb930d48c46c WatchSource:0}: Error finding container 534fb70b04ea93cea1316e15a4392fe35f5800b33db5aa6daa0fdb930d48c46c: Status 404 returned error can't find the container with id 534fb70b04ea93cea1316e15a4392fe35f5800b33db5aa6daa0fdb930d48c46c
Sep 04 21:53:25.990336 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.990181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fwp9d"
Sep 04 21:53:25.993949 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:25.993922    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6f13b7_ea2d_4141_89c1_aa05b26a0d13.slice/crio-d9df8f78d662c575a7a3966f5d0ecafee16487460521b3c9fc566dc0eab5078d WatchSource:0}: Error finding container d9df8f78d662c575a7a3966f5d0ecafee16487460521b3c9fc566dc0eab5078d: Status 404 returned error can't find the container with id d9df8f78d662c575a7a3966f5d0ecafee16487460521b3c9fc566dc0eab5078d
Sep 04 21:53:25.995595 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:25.995573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kkwjz"
Sep 04 21:53:26.000106 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:26.000081    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f381a89_94bb_48c7_8bdd_b44e56695651.slice/crio-7c04a19ef194bc46c1224d57b796c59adb1d3e08b4afca5b632819760910b670 WatchSource:0}: Error finding container 7c04a19ef194bc46c1224d57b796c59adb1d3e08b4afca5b632819760910b670: Status 404 returned error can't find the container with id 7c04a19ef194bc46c1224d57b796c59adb1d3e08b4afca5b632819760910b670
Sep 04 21:53:26.007659 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:26.007551    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17e9807_9b5e_4cc5_90c3_7c6afd89e797.slice/crio-072f512fcca9d433f24be44f14eb82bba0b428de3b427d5ee02ff8916fe10a27 WatchSource:0}: Error finding container 072f512fcca9d433f24be44f14eb82bba0b428de3b427d5ee02ff8916fe10a27: Status 404 returned error can't find the container with id 072f512fcca9d433f24be44f14eb82bba0b428de3b427d5ee02ff8916fe10a27
Sep 04 21:53:26.240442 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.240327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:26.240611 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.240496    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:26.240611 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.240577    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:27.240558471 +0000 UTC m=+4.012571478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:26.340928 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.340887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:26.341109 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.341027    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:26.341109 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.341090    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:53:27.341070337 +0000 UTC m=+4.113083329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:26.441963 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.441925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:26.442146 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.442125    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:26.442209 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.442158    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:26.442209 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.442173    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:26.442281 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:26.442241    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:53:27.442221378 +0000 UTC m=+4.214234372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:26.682531 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.682452    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-03 21:48:26 +0000 UTC" deadline="2028-06-01 03:56:59.95621268 +0000 UTC"
Sep 04 21:53:26.682531 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.682483    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15246h3m33.273732631s"
Sep 04 21:53:26.790972 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.790934    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 21:53:26.859698 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.859522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fwp9d" event={"ID":"6f381a89-94bb-48c7-8bdd-b44e56695651","Type":"ContainerStarted","Data":"7c04a19ef194bc46c1224d57b796c59adb1d3e08b4afca5b632819760910b670"}
Sep 04 21:53:26.861503 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.861472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-854cw" event={"ID":"b321a8c3-7d3d-49b9-80e0-9e70498071d1","Type":"ContainerStarted","Data":"534fb70b04ea93cea1316e15a4392fe35f5800b33db5aa6daa0fdb930d48c46c"}
Sep 04 21:53:26.863043 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.863016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8" event={"ID":"ce981603-50b1-4f7d-b1fd-f8be6253ac29","Type":"ContainerStarted","Data":"19bd7b5ebd1e6b7649d41c3824c554ff0524cf943c4cd6e003eb906d12529f36"}
Sep 04 21:53:26.864428 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.864393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n7k9f" event={"ID":"72d4dfda-8b90-4f4d-93f7-fe171807c3bb","Type":"ContainerStarted","Data":"a36a406e93a35b2075de715a851fa91654002f1e3ed58ee4b571a37361155446"}
Sep 04 21:53:26.866183 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.866133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvst9" event={"ID":"53128034-f3fe-4fca-8656-8e17e049d180","Type":"ContainerStarted","Data":"c273c28f5fdfd7f444c3f472c36000ec7ff4fa150a1b8accf40d1825d0e1af9f"}
Sep 04 21:53:26.867531 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.867503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2zf5" event={"ID":"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13","Type":"ContainerStarted","Data":"d9df8f78d662c575a7a3966f5d0ecafee16487460521b3c9fc566dc0eab5078d"}
Sep 04 21:53:26.869032 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.869006    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerStarted","Data":"62b1f5db2895ac40e291f4a7e4ff78c27aaf73ff464170968c86281e1b5cdab2"}
Sep 04 21:53:26.870602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.870576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"72a0e47f6ecf073f1e78b8f747bdebc7315407f357884de4f012837b5ea6c633"}
Sep 04 21:53:26.872016 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:26.871989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kkwjz" event={"ID":"a17e9807-9b5e-4cc5-90c3-7c6afd89e797","Type":"ContainerStarted","Data":"072f512fcca9d433f24be44f14eb82bba0b428de3b427d5ee02ff8916fe10a27"}
Sep 04 21:53:27.250176 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.249543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:27.250176 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.249732    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:27.250176 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.249812    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:29.249791848 +0000 UTC m=+6.021804845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:27.350902 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.350865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:27.351100 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.351032    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:27.351100 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.351098    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:53:29.35107816 +0000 UTC m=+6.123091157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:27.451225 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.451182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:27.451449 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.451429    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:27.451527 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.451462    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:27.451527 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.451475    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:27.451634 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.451538    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:53:29.451518846 +0000 UTC m=+6.223531842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:27.683470 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.683322    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-03 21:48:26 +0000 UTC" deadline="2028-02-20 10:46:48.782744241 +0000 UTC"
Sep 04 21:53:27.683470 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.683392    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12804h53m21.099356711s"
Sep 04 21:53:27.847607 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.846842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:27.847607 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.846992    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:27.847607 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.847449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:27.847607 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.847559    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:27.848278 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:27.847864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:27.848278 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:27.847961    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:29.265487 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:29.265449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:29.265986 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.265639    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:29.265986 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.265715    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:33.265694463 +0000 UTC m=+10.037707455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:29.365962 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:29.365932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:29.366134 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.366118    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:29.366204 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.366178    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:53:33.366157552 +0000 UTC m=+10.138170545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:29.466609 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:29.466572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:29.466802 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.466784    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:29.466881 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.466810    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:29.466881 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.466823    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:29.466881 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.466871    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:53:33.466857181 +0000 UTC m=+10.238870171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:29.846652 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:29.845994    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:29.846652 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.846149    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:29.846652 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:29.846512    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:29.846652 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.846616    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:29.847429 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:29.847168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:29.847429 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:29.847272    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:31.844952 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:31.844922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:31.845388 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:31.844980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:31.845388 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:31.844983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:31.845388 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:31.845097    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:31.845388 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:31.845219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:31.845388 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:31.845332    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:33.297856 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:33.297761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:33.298311 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.297924    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:33.298311 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.297988    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:41.29797321 +0000 UTC m=+18.069986198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:33.398819 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:33.398543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:33.398819 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.398699    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:33.398819 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.398760    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:53:41.398740759 +0000 UTC m=+18.170753753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:33.499255 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:33.499155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:33.499427 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.499328    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:33.499427 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.499347    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:33.499427 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.499361    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:33.499427 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.499417    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:53:41.499400576 +0000 UTC m=+18.271413579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:33.846590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:33.846302    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:33.846590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:33.846405    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:33.846590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:33.846449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:33.846590 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.846446    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:33.846590 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.846522    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:33.846961 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:33.846600    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:35.845315 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:35.845278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:35.845785 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:35.845426    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:35.845785 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:35.845511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:35.845785 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:35.845601    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:35.845785 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:35.845686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:35.845785 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:35.845773    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:37.845535 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:37.845499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:37.846029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:37.845545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:37.846029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:37.845500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:37.846029 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:37.845617    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:37.846029 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:37.845722    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:37.846029 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:37.845777    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:39.845089 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:39.845059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:39.845529 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:39.845059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:39.845529 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:39.845059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:39.845529 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:39.845201    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:39.845529 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:39.845323    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:39.845529 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:39.845403    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:41.354681 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:41.354625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:41.355144 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.354807    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:41.355144 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.354886    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:57.354864191 +0000 UTC m=+34.126877181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:41.455813 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:41.455781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:41.455988 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.455901    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:41.455988 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.455958    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:53:57.455939994 +0000 UTC m=+34.227952984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:41.556608 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:41.556573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:41.556789 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.556751    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:41.556789 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.556779    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:41.556789 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.556792    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:41.556919 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.556840    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:53:57.556827949 +0000 UTC m=+34.328840937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:41.844762 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:41.844685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:41.844762 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:41.844701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:41.844964 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:41.844685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:41.844964 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.844800    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:41.844964 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.844854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:41.844964 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:41.844938    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:43.845613 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:43.845577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:43.846078 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:43.845682    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:43.846078 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:43.845765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:43.846078 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:43.845881    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:43.846078 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:43.845932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:43.846078 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:43.846007    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:44.907183 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.906758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal" event={"ID":"9bc02de3d951ad38e1949ea90d1cdf11","Type":"ContainerStarted","Data":"b02fbdb3f6d0e513c8d51e063c602e4dc0ccd7db8f507c46f0728de9a940dc19"}
Sep 04 21:53:44.910611 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.910581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kkwjz" event={"ID":"a17e9807-9b5e-4cc5-90c3-7c6afd89e797","Type":"ContainerStarted","Data":"f1282a81702feaa85613c10bc8e8c2a3fe0200fe099b9bc269ba1b79887a42dc"}
Sep 04 21:53:44.912888 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.912724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fwp9d" event={"ID":"6f381a89-94bb-48c7-8bdd-b44e56695651","Type":"ContainerStarted","Data":"fa204a376b8c853c6f8092108b6c0c04065ade4c90a3f825de089f558a17fd48"}
Sep 04 21:53:44.919370 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.919345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8" event={"ID":"ce981603-50b1-4f7d-b1fd-f8be6253ac29","Type":"ContainerStarted","Data":"98884e7677355db21a118d563bb41b7c4d68bb79205c0d3e1dc37966fccc3099"}
Sep 04 21:53:44.921235 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.921212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n7k9f" event={"ID":"72d4dfda-8b90-4f4d-93f7-fe171807c3bb","Type":"ContainerStarted","Data":"152f59ed23e8ae6a25b6ab0167ef9176915d0a158546d6142897b985395c1f2b"}
Sep 04 21:53:44.923037 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.923016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvst9" event={"ID":"53128034-f3fe-4fca-8656-8e17e049d180","Type":"ContainerStarted","Data":"cfd4ebb825ab16b83249f1d3af18c06561e3e0fa2e58263c3f6eacec5a2a3514"}
Sep 04 21:53:44.924924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.924903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal" event={"ID":"fed4194045521f365d114faefa73311c","Type":"ContainerStarted","Data":"2776ea75b81210da96ea4ed6d3946e44c03a919c0e516cbbc400da354f81bb84"}
Sep 04 21:53:44.926541 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.926523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2zf5" event={"ID":"4c6f13b7-ea2d-4141-89c1-aa05b26a0d13","Type":"ContainerStarted","Data":"af47a3263868c14aae8c5b03eb2e8a69c855b3052cddac7069ff5ce7fa42f2c8"}
Sep 04 21:53:44.927795 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.927775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerStarted","Data":"0d8bc23a07d4c0e1d68c8b9710cfbb3f22ee678db1a6a7753e781cc99ee347bd"}
Sep 04 21:53:44.930446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.930427    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"1c7efebc3969ff821ca6f3a661f83caef2e5d72c8fbe69487277aa56ac3eae4d"}
Sep 04 21:53:44.930525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.930475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"fa4f74cc6b782ecd87449b191f01e9764cdfa23a6b28824e5d2727c9a8f96f98"}
Sep 04 21:53:44.930525 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.930507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"f725c6fb2571214db21d1e2fc0eadc78a3d11fd25f45c2f99551e4c92b4b795d"}
Sep 04 21:53:44.930593 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.930533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"39b40a1171f4e68776fe981257f44c4aeaed63a7263495d2a2503cb644b27d8f"}
Sep 04 21:53:44.930593 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.930558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"ecd269ad6a94b89fa447fc9fe2ef355de048c08167cb140cb7478261cef627e4"}
Sep 04 21:53:44.938236 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.938199    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n7k9f" podStartSLOduration=2.996274578 podStartE2EDuration="20.938187068s" totalImagesPullingTime="17.94191249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:44.937804959 +0000 UTC m=+21.709817969" watchObservedRunningTime="2026-09-04 21:53:44.938187068 +0000 UTC m=+21.710200075"
Sep 04 21:53:44.952879 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.952845    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fwp9d" podStartSLOduration=2.834214581 podStartE2EDuration="20.95283418s" totalImagesPullingTime="18.118619599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:44.952266521 +0000 UTC m=+21.724279533" watchObservedRunningTime="2026-09-04 21:53:44.95283418 +0000 UTC m=+21.724847192"
Sep 04 21:53:44.966910 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:44.966871    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kkwjz" podStartSLOduration=3.064010493 podStartE2EDuration="20.966856554s" totalImagesPullingTime="17.902846061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:44.966262519 +0000 UTC m=+21.738275530" watchObservedRunningTime="2026-09-04 21:53:44.966856554 +0000 UTC m=+21.738869564"
Sep 04 21:53:45.033116 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.033080    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jvst9" podStartSLOduration=2.8175713399999998 podStartE2EDuration="21.033068873s" totalImagesPullingTime="18.215497533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:45.032756865 +0000 UTC m=+21.804769876" watchObservedRunningTime="2026-09-04 21:53:45.033068873 +0000 UTC m=+21.805081883"
Sep 04 21:53:45.033235 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.033217    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-61.ec2.internal" podStartSLOduration=20.033210824 podStartE2EDuration="20.033210824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:45.011594158 +0000 UTC m=+21.783607167" watchObservedRunningTime="2026-09-04 21:53:45.033210824 +0000 UTC m=+21.805223834"
Sep 04 21:53:45.054147 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.054113    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t2zf5" podStartSLOduration=2.877541785 podStartE2EDuration="21.054101142s" totalImagesPullingTime="18.176559357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:45.053897611 +0000 UTC m=+21.825910620" watchObservedRunningTime="2026-09-04 21:53:45.054101142 +0000 UTC m=+21.826114151"
Sep 04 21:53:45.139103 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.139082    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:45.844522 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.844484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:45.844522 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.844494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:45.844799 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:45.844611    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:45.844799 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:45.844678    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:45.844799 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.844691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:45.844799 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:45.844755    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:45.880690 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.880672    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 04 21:53:45.933470 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.933445    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc02de3d951ad38e1949ea90d1cdf11" containerID="b02fbdb3f6d0e513c8d51e063c602e4dc0ccd7db8f507c46f0728de9a940dc19" exitCode=0
Sep 04 21:53:45.934130 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.933534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal" event={"ID":"9bc02de3d951ad38e1949ea90d1cdf11","Type":"ContainerDied","Data":"b02fbdb3f6d0e513c8d51e063c602e4dc0ccd7db8f507c46f0728de9a940dc19"}
Sep 04 21:53:45.935092 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.935074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-854cw" event={"ID":"b321a8c3-7d3d-49b9-80e0-9e70498071d1","Type":"ContainerStarted","Data":"c9a512bca93dfdf89d6a18766e10e20cf5e1f4e94c7c6f3cfde97d921845d6cf"}
Sep 04 21:53:45.937012 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.936989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8" event={"ID":"ce981603-50b1-4f7d-b1fd-f8be6253ac29","Type":"ContainerStarted","Data":"487a21b7488de96f6d394e3056208102cf7101cfcfe33515f5211da48e9096cd"}
Sep 04 21:53:45.940817 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.939162    2577 generic.go:356] "Generic (PLEG): container finished" podID="70efcff8-67a7-4d35-9300-beff862fbb5f" containerID="0d8bc23a07d4c0e1d68c8b9710cfbb3f22ee678db1a6a7753e781cc99ee347bd" exitCode=0
Sep 04 21:53:45.940817 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.939290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerDied","Data":"0d8bc23a07d4c0e1d68c8b9710cfbb3f22ee678db1a6a7753e781cc99ee347bd"}
Sep 04 21:53:45.944345 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:45.944320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"dcb61e783447d165a73303d9a67b95b75082a7d91e1385aafea5be0e45fc34e7"}
Sep 04 21:53:46.242508 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.242433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:46.243020 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.243000    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:46.260059 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.260015    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-854cw" podStartSLOduration=4.09464109 podStartE2EDuration="22.260000985s" totalImagesPullingTime="18.165359895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:45.990235248 +0000 UTC m=+22.762248258" watchObservedRunningTime="2026-09-04 21:53:46.260000985 +0000 UTC m=+23.032013995"
Sep 04 21:53:46.674483 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.674116    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-04T21:53:45.880686502Z","UUID":"c6391fcd-a6e8-4af2-adb1-885176f877eb","Handler":null,"Name":"","Endpoint":""}
Sep 04 21:53:46.675861 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.675842    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 04 21:53:46.675983 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.675875    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 04 21:53:46.949548 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.949447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal" event={"ID":"9bc02de3d951ad38e1949ea90d1cdf11","Type":"ContainerStarted","Data":"7c244483692fc7dbbad5e04cd8872969beaab7407ab754ec0ad07531a2990991"}
Sep 04 21:53:46.950319 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.950298    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n7k9f"
Sep 04 21:53:46.973407 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:46.973361    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-61.ec2.internal" podStartSLOduration=21.973349252 podStartE2EDuration="21.973349252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:46.972871282 +0000 UTC m=+23.744884292" watchObservedRunningTime="2026-09-04 21:53:46.973349252 +0000 UTC m=+23.745362262"
Sep 04 21:53:47.845088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:47.845059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:47.845088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:47.845088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:47.845375 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:47.845059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:47.845375 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:47.845170    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:47.845375 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:47.845284    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:47.845530 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:47.845370    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:47.958174 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:47.958129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"024a7bbdf10dd41c9dafe152f579c8bd8428666ad7bb87042e6a007aeb96bb21"}
Sep 04 21:53:47.960546 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:47.960518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8" event={"ID":"ce981603-50b1-4f7d-b1fd-f8be6253ac29","Type":"ContainerStarted","Data":"1670cff3ab5cf67179f26fa3135f211c4a9c4270ca6c3a75fc396c9d807356ed"}
Sep 04 21:53:47.983055 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:47.983009    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lggj8" podStartSLOduration=3.9258683469999998 podStartE2EDuration="23.982996899s" totalImagesPullingTime="20.057128552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:47.982992671 +0000 UTC m=+24.755005681" watchObservedRunningTime="2026-09-04 21:53:47.982996899 +0000 UTC m=+24.755009906"
Sep 04 21:53:49.844784 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:49.844723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:49.845258 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:49.844851    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:49.845258 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:49.844942    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:49.845258 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:49.844851    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:49.845258 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:49.844841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:49.845258 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:49.845044    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:50.969627 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.969278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerStarted","Data":"f11f6a53f048842d83e2bae34c3f95b438c889d990e4bc7ed36a0fce861722e0"}
Sep 04 21:53:50.975147 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.975112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" event={"ID":"7e2c1f29-d7e4-45b0-8100-1a27a8fc01ac","Type":"ContainerStarted","Data":"f1b28f228c1ec3a2719d659c615b2a590ada88c6a7fc1823d49ed06d5f9a342d"}
Sep 04 21:53:50.975444 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.975424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:50.975537 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.975496    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:50.975653 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.975544    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:50.990866 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.990840    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:50.991625 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:50.991610    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:53:51.035753 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:51.035704    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw" podStartSLOduration=8.473767829 podStartE2EDuration="27.035684749s" totalImagesPullingTime="18.56191692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:53:51.03469967 +0000 UTC m=+27.806712681" watchObservedRunningTime="2026-09-04 21:53:51.035684749 +0000 UTC m=+27.807697760"
Sep 04 21:53:51.847394 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:51.847362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:51.847618 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:51.847465    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:51.847618 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:51.847479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:51.847618 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:51.847474    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:51.847618 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:51.847535    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:51.847618 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:51.847602    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:51.979498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:51.979465    2577 generic.go:356] "Generic (PLEG): container finished" podID="70efcff8-67a7-4d35-9300-beff862fbb5f" containerID="f11f6a53f048842d83e2bae34c3f95b438c889d990e4bc7ed36a0fce861722e0" exitCode=0
Sep 04 21:53:51.979915 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:51.979550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerDied","Data":"f11f6a53f048842d83e2bae34c3f95b438c889d990e4bc7ed36a0fce861722e0"}
Sep 04 21:53:52.716983 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.716948    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bfglg"]
Sep 04 21:53:52.717108 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.717047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:52.717152 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:52.717124    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:52.721315 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.721292    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvvh2"]
Sep 04 21:53:52.721410 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.721378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:52.721491 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:52.721466    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:52.721983 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.721962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knwk6"]
Sep 04 21:53:52.722078 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.722052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:52.722180 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:52.722134    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:52.983604 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.983523    2577 generic.go:356] "Generic (PLEG): container finished" podID="70efcff8-67a7-4d35-9300-beff862fbb5f" containerID="4fdc1866a901ae9f25832687e6161b45789c86a2b8d5a4f5fb39cd23f8bef2fb" exitCode=0
Sep 04 21:53:52.984366 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:52.983612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerDied","Data":"4fdc1866a901ae9f25832687e6161b45789c86a2b8d5a4f5fb39cd23f8bef2fb"}
Sep 04 21:53:53.845770 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:53.845743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:53.845908 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:53.845830    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:53.988303 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:53.988155    2577 generic.go:356] "Generic (PLEG): container finished" podID="70efcff8-67a7-4d35-9300-beff862fbb5f" containerID="0fc01469a94cc72288c85e94205232534ecb3e52fc8a7726b90d800727d4bbe1" exitCode=0
Sep 04 21:53:53.988303 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:53.988226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerDied","Data":"0fc01469a94cc72288c85e94205232534ecb3e52fc8a7726b90d800727d4bbe1"}
Sep 04 21:53:54.844964 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:54.844930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:54.845130 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:54.845040    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:54.845130 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:54.845092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:54.845233 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:54.845193    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:55.845052 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:55.845022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:55.845406 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:55.845157    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:56.845243 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:56.845206    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:56.845243 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:56.845239    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:56.845719 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:56.845334    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwk6" podUID="2e880518-4c71-4ae3-a31f-a0d584f72c0d"
Sep 04 21:53:56.845719 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:56.845465    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfglg" podUID="99928b1b-1cac-4fc7-82ea-d97856fffb5f"
Sep 04 21:53:57.376918 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:57.376884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:57.377099 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.377054    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:57.377147 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.377128    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret podName:db1ee4f6-293f-4063-9cb4-acdedfc96fa7 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:29.37710796 +0000 UTC m=+66.149120954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret") pod "global-pull-secret-syncer-dvvh2" (UID: "db1ee4f6-293f-4063-9cb4-acdedfc96fa7") : object "kube-system"/"original-pull-secret" not registered
Sep 04 21:53:57.477570 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:57.477534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:57.477853 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.477716    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:57.477853 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.477789    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs podName:2e880518-4c71-4ae3-a31f-a0d584f72c0d nodeName:}" failed. No retries permitted until 2026-09-04 21:54:29.477774044 +0000 UTC m=+66.249787036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs") pod "network-metrics-daemon-knwk6" (UID: "2e880518-4c71-4ae3-a31f-a0d584f72c0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 21:53:57.578372 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:57.578334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:57.578549 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.578479    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 21:53:57.578549 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.578504    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 21:53:57.578549 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.578514    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kpnls for pod openshift-network-diagnostics/network-check-target-bfglg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:57.578710 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.578571    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls podName:99928b1b-1cac-4fc7-82ea-d97856fffb5f nodeName:}" failed. No retries permitted until 2026-09-04 21:54:29.578557574 +0000 UTC m=+66.350570562 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpnls" (UniqueName: "kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls") pod "network-check-target-bfglg" (UID: "99928b1b-1cac-4fc7-82ea-d97856fffb5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 21:53:57.844601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:57.844513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:57.844752 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:57.844664    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvvh2" podUID="db1ee4f6-293f-4063-9cb4-acdedfc96fa7"
Sep 04 21:53:58.020370 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.020330    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-61.ec2.internal" event="NodeReady"
Sep 04 21:53:58.020797 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.020475    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 04 21:53:58.093458 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.093362    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78f87c87fc-m9qlm"]
Sep 04 21:53:58.147744 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.147664    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"]
Sep 04 21:53:58.147888 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.147766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.154433 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.154408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 04 21:53:58.154564 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.154489    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 04 21:53:58.155143 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.154961    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfckr\""
Sep 04 21:53:58.155627 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.155607    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 04 21:53:58.164353 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.164330    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 04 21:53:58.164700 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.164627    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"]
Sep 04 21:53:58.164788 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.164732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.168910 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.168891    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q9m5q\""
Sep 04 21:53:58.169029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.168894    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 04 21:53:58.169839 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.169818    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.169941 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.169866    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.183008 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.182990    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-8rx8q"]
Sep 04 21:53:58.183113 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.183098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.204941 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.204913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ql6g5"]
Sep 04 21:53:58.205068 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.205044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.223233 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.222991    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f6c8885b8-v8qbh"]
Sep 04 21:53:58.223339 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.223295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.247214 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247192    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"]
Sep 04 21:53:58.247350 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247329    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 04 21:53:58.247450 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247523    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247614    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247759    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247786    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247861    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.247996    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 04 21:53:58.248091 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.248060    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.248456 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.248259    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.254087 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.254005    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nsp6t\""
Sep 04 21:53:58.254087 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.254055    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-srfrh\""
Sep 04 21:53:58.254087 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.254059    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 04 21:53:58.254394 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.254008    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pzr7c\""
Sep 04 21:53:58.254394 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.254206    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.254717 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.254552    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 04 21:53:58.259370 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.259348    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 04 21:53:58.261473 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.261456    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 04 21:53:58.261929 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.261891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 04 21:53:58.262505 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.262487    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"]
Sep 04 21:53:58.262601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.262523    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"]
Sep 04 21:53:58.262601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.262537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"]
Sep 04 21:53:58.262601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.262554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-8rx8q"]
Sep 04 21:53:58.262601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.262576    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"]
Sep 04 21:53:58.262964 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.262908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"
Sep 04 21:53:58.263118 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.263102    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.264287 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.264228    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.267201 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.267182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9rf2q\""
Sep 04 21:53:58.282981 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.282960    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"]
Sep 04 21:53:58.283072 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.282969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.284225 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d30f914-a461-490e-ab74-c52677dbee40-ca-trust-extracted\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284327 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-trusted-ca\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284327 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.284327 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.284498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-bound-sa-token\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.284498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzpc\" (UniqueName: \"kubernetes.io/projected/d10170e3-9966-4245-87c0-a46550a09296-kube-api-access-qjzpc\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.284498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bff74870-50dd-444a-9cf3-00135ed88165-tmp\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.284498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff74870-50dd-444a-9cf3-00135ed88165-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.284498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bff74870-50dd-444a-9cf3-00135ed88165-snapshots\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff74870-50dd-444a-9cf3-00135ed88165-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bff74870-50dd-444a-9cf3-00135ed88165-serving-cert\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbfw\" (UniqueName: \"kubernetes.io/projected/bff74870-50dd-444a-9cf3-00135ed88165-kube-api-access-cnbfw\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-registry-certificates\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-installation-pull-secrets\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcqr\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-kube-api-access-9tcqr\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-image-registry-private-configuration\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxf6\" (UniqueName: \"kubernetes.io/projected/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-kube-api-access-lhxf6\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.284812 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.284797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.287798 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.287753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 04 21:53:58.289523 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.289072    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 04 21:53:58.289925 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.289905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.299750 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.299734    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.301043 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.301026    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vbzm9"]
Sep 04 21:53:58.301161 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.301144    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.301483 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.301374    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.302487 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.302472    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p2nmv\""
Sep 04 21:53:58.315054 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.315035    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f6c8885b8-v8qbh"]
Sep 04 21:53:58.315157 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.315071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f87c87fc-m9qlm"]
Sep 04 21:53:58.315157 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.315090    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"]
Sep 04 21:53:58.315157 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.315111    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4wv5v"]
Sep 04 21:53:58.315157 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.315137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9"
Sep 04 21:53:58.320912 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.320889    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 04 21:53:58.324476 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.323718    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.324476 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.324037    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t7z5s\""
Sep 04 21:53:58.324617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.324548    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sp2sk\""
Sep 04 21:53:58.325693 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.324683    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 04 21:53:58.325693 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.325429    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.325693 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.325438    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-drqjs\""
Sep 04 21:53:58.326533 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.326512    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 04 21:53:58.326792 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.326772    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.336420 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.336401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 04 21:53:58.337192 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.337173    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.337296 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.337278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.337296 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.337219    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kntzg"]
Sep 04 21:53:58.337695 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.337676    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.345756 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.345705    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 04 21:53:58.345858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.345755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 04 21:53:58.345858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.345709    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 04 21:53:58.345858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.345845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dmz5v\""
Sep 04 21:53:58.361319 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.361299    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"]
Sep 04 21:53:58.361411 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.361331    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4wv5v"]
Sep 04 21:53:58.361411 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.361350    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kntzg"]
Sep 04 21:53:58.361411 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.361371    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ql6g5"]
Sep 04 21:53:58.361411 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.361384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vbzm9"]
Sep 04 21:53:58.361572 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.361441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.364001 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.363984    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 04 21:53:58.364694 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.364678    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 04 21:53:58.379736 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.379718    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hzgq\""
Sep 04 21:53:58.385951 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.385934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.386029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.385961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jct\" (UniqueName: \"kubernetes.io/projected/7802a7ba-c4b5-49f2-9988-f4462937de53-kube-api-access-h5jct\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.386029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.385982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrz6x\" (UniqueName: \"kubernetes.io/projected/f0ca4367-fd7e-4c51-a763-cd939e9c1154-kube-api-access-lrz6x\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.386029 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5zq7\" (UniqueName: \"kubernetes.io/projected/ecb25480-a856-42e8-9f87-eb170d89d8c8-kube-api-access-m5zq7\") pod \"volume-data-source-validator-695c895bd6-mlzpj\" (UID: \"ecb25480-a856-42e8-9f87-eb170d89d8c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"
Sep 04 21:53:58.386177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-stats-auth\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.386177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.386177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bff74870-50dd-444a-9cf3-00135ed88165-serving-cert\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.386322 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-default-certificate\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.386322 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.386176    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 04 21:53:58.386322 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.386216    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f87c87fc-m9qlm: secret "image-registry-tls" not found
Sep 04 21:53:58.386322 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bff74870-50dd-444a-9cf3-00135ed88165-tmp\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.386322 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.386322 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.386281    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls podName:1d30f914-a461-490e-ab74-c52677dbee40 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:58.886261085 +0000 UTC m=+35.658274073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls") pod "image-registry-78f87c87fc-m9qlm" (UID: "1d30f914-a461-490e-ab74-c52677dbee40") : secret "image-registry-tls" not found
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0ca4367-fd7e-4c51-a763-cd939e9c1154-config\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff74870-50dd-444a-9cf3-00135ed88165-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzpc\" (UniqueName: \"kubernetes.io/projected/d10170e3-9966-4245-87c0-a46550a09296-kube-api-access-qjzpc\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bff74870-50dd-444a-9cf3-00135ed88165-snapshots\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbfw\" (UniqueName: \"kubernetes.io/projected/bff74870-50dd-444a-9cf3-00135ed88165-kube-api-access-cnbfw\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bff74870-50dd-444a-9cf3-00135ed88165-tmp\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.386544    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-registry-certificates\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.386602 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.386594    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls podName:5b7e5697-f59b-4970-a58e-6f9bcb4b9a92 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:58.886577098 +0000 UTC m=+35.658590095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hs27z" (UID: "5b7e5697-f59b-4970-a58e-6f9bcb4b9a92") : secret "cluster-monitoring-operator-tls" not found
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-installation-pull-secrets\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcqr\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-kube-api-access-9tcqr\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb671cf-5a76-465a-8bcb-9f815bf3a057-serving-cert\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-image-registry-private-configuration\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9dx\" (UniqueName: \"kubernetes.io/projected/6bb671cf-5a76-465a-8bcb-9f815bf3a057-kube-api-access-hw9dx\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.386996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxf6\" (UniqueName: \"kubernetes.io/projected/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-kube-api-access-lhxf6\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0ca4367-fd7e-4c51-a763-cd939e9c1154-trusted-ca\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.387097 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.387468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqdh6\" (UniqueName: \"kubernetes.io/projected/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-kube-api-access-sqdh6\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.387468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bff74870-50dd-444a-9cf3-00135ed88165-snapshots\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.387468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.387468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d30f914-a461-490e-ab74-c52677dbee40-ca-trust-extracted\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff74870-50dd-444a-9cf3-00135ed88165-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.387468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d30f914-a461-490e-ab74-c52677dbee40-ca-trust-extracted\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-bound-sa-token\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ca4367-fd7e-4c51-a763-cd939e9c1154-serving-cert\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-registry-certificates\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-trusted-ca\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff74870-50dd-444a-9cf3-00135ed88165-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bb671cf-5a76-465a-8bcb-9f815bf3a057-config\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.387834 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.387787    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 21:53:58.388183 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.387858    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls podName:d10170e3-9966-4245-87c0-a46550a09296 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:58.887834645 +0000 UTC m=+35.659847658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-b576p" (UID: "d10170e3-9966-4245-87c0-a46550a09296") : secret "samples-operator-tls" not found
Sep 04 21:53:58.388183 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.387929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.388183 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.388172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff74870-50dd-444a-9cf3-00135ed88165-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.388461 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.388435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-trusted-ca\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.390995 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.390951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bff74870-50dd-444a-9cf3-00135ed88165-serving-cert\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.391077 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.391006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-installation-pull-secrets\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.391077 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.391018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-image-registry-private-configuration\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.395982 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.395956    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 04 21:53:58.408621 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.408576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzpc\" (UniqueName: \"kubernetes.io/projected/d10170e3-9966-4245-87c0-a46550a09296-kube-api-access-qjzpc\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.421454 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.421423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-bound-sa-token\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.425296 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.425258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxf6\" (UniqueName: \"kubernetes.io/projected/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-kube-api-access-lhxf6\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.426822 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.426029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcqr\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-kube-api-access-9tcqr\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.430956 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.430939    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbfw\" (UniqueName: \"kubernetes.io/projected/bff74870-50dd-444a-9cf3-00135ed88165-kube-api-access-cnbfw\") pod \"insights-operator-76bcd6ccf5-8rx8q\" (UID: \"bff74870-50dd-444a-9cf3-00135ed88165\") " pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.488568 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9dx\" (UniqueName: \"kubernetes.io/projected/6bb671cf-5a76-465a-8bcb-9f815bf3a057-kube-api-access-hw9dx\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.488688 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0ca4367-fd7e-4c51-a763-cd939e9c1154-trusted-ca\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.488688 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqdh6\" (UniqueName: \"kubernetes.io/projected/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-kube-api-access-sqdh6\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.488688 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63185afc-d764-488c-8d3e-ff86a5494b41-tmp-dir\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.488838 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.488838 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gcd\" (UniqueName: \"kubernetes.io/projected/63185afc-d764-488c-8d3e-ff86a5494b41-kube-api-access-t6gcd\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.488838 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.488809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ca4367-fd7e-4c51-a763-cd939e9c1154-serving-cert\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.488972 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.488885    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 04 21:53:58.488972 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.488957    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:58.988938225 +0000 UTC m=+35.760951226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : secret "router-metrics-certs-default" not found
Sep 04 21:53:58.489081 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bb671cf-5a76-465a-8bcb-9f815bf3a057-config\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.489081 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74ggr\" (UniqueName: \"kubernetes.io/projected/01c87113-e1fc-499c-8cd0-1eba43565af8-kube-api-access-74ggr\") pod \"ingress-canary-4wv5v\" (UID: \"01c87113-e1fc-499c-8cd0-1eba43565af8\") " pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.489177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.489177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jct\" (UniqueName: \"kubernetes.io/projected/7802a7ba-c4b5-49f2-9988-f4462937de53-kube-api-access-h5jct\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.489177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrz6x\" (UniqueName: \"kubernetes.io/projected/f0ca4367-fd7e-4c51-a763-cd939e9c1154-kube-api-access-lrz6x\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.489177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zq7\" (UniqueName: \"kubernetes.io/projected/ecb25480-a856-42e8-9f87-eb170d89d8c8-kube-api-access-m5zq7\") pod \"volume-data-source-validator-695c895bd6-mlzpj\" (UID: \"ecb25480-a856-42e8-9f87-eb170d89d8c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"
Sep 04 21:53:58.489365 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-stats-auth\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.489365 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-default-certificate\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.489365 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.489365 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.489302    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:58.989285105 +0000 UTC m=+35.761298111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : configmap references non-existent config key: service-ca.crt
Sep 04 21:53:58.489365 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0ca4367-fd7e-4c51-a763-cd939e9c1154-config\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.489684 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.489684 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0ca4367-fd7e-4c51-a763-cd939e9c1154-trusted-ca\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.489684 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvmw\" (UniqueName: \"kubernetes.io/projected/29c29276-c762-4fa0-926e-8c958212959e-kube-api-access-hqvmw\") pod \"network-check-source-685456655f-vbzm9\" (UID: \"29c29276-c762-4fa0-926e-8c958212959e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9"
Sep 04 21:53:58.489684 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.489909 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bb671cf-5a76-465a-8bcb-9f815bf3a057-config\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.489909 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63185afc-d764-488c-8d3e-ff86a5494b41-config-volume\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.489909 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01c87113-e1fc-499c-8cd0-1eba43565af8-cert\") pod \"ingress-canary-4wv5v\" (UID: \"01c87113-e1fc-499c-8cd0-1eba43565af8\") " pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.489909 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb671cf-5a76-465a-8bcb-9f815bf3a057-serving-cert\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.490108 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.489964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.490108 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.490087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0ca4367-fd7e-4c51-a763-cd939e9c1154-config\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.491851 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.491826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ca4367-fd7e-4c51-a763-cd939e9c1154-serving-cert\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.492370 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.492350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bb671cf-5a76-465a-8bcb-9f815bf3a057-serving-cert\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.492474 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.492376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.492592 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.492571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-default-certificate\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.492798 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.492776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-stats-auth\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.511498 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.511473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9dx\" (UniqueName: \"kubernetes.io/projected/6bb671cf-5a76-465a-8bcb-9f815bf3a057-kube-api-access-hw9dx\") pod \"service-ca-operator-859f94c4b-fhgsf\" (UID: \"6bb671cf-5a76-465a-8bcb-9f815bf3a057\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.512181 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.512158    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5zq7\" (UniqueName: \"kubernetes.io/projected/ecb25480-a856-42e8-9f87-eb170d89d8c8-kube-api-access-m5zq7\") pod \"volume-data-source-validator-695c895bd6-mlzpj\" (UID: \"ecb25480-a856-42e8-9f87-eb170d89d8c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"
Sep 04 21:53:58.513431 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.513166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q"
Sep 04 21:53:58.513431 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.513390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jct\" (UniqueName: \"kubernetes.io/projected/7802a7ba-c4b5-49f2-9988-f4462937de53-kube-api-access-h5jct\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:58.515054 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.515031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrz6x\" (UniqueName: \"kubernetes.io/projected/f0ca4367-fd7e-4c51-a763-cd939e9c1154-kube-api-access-lrz6x\") pod \"console-operator-85b454874b-ql6g5\" (UID: \"f0ca4367-fd7e-4c51-a763-cd939e9c1154\") " pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.517567 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.517545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqdh6\" (UniqueName: \"kubernetes.io/projected/3db4739a-47e2-47ea-8e10-b68b9e58c8d8-kube-api-access-sqdh6\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xkcpb\" (UID: \"3db4739a-47e2-47ea-8e10-b68b9e58c8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.532150 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.532132    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:53:58.574136 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.574114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"
Sep 04 21:53:58.590779 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.590759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.590863 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.590787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvmw\" (UniqueName: \"kubernetes.io/projected/29c29276-c762-4fa0-926e-8c958212959e-kube-api-access-hqvmw\") pod \"network-check-source-685456655f-vbzm9\" (UID: \"29c29276-c762-4fa0-926e-8c958212959e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9"
Sep 04 21:53:58.590863 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.590808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63185afc-d764-488c-8d3e-ff86a5494b41-config-volume\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.590863 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.590832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01c87113-e1fc-499c-8cd0-1eba43565af8-cert\") pod \"ingress-canary-4wv5v\" (UID: \"01c87113-e1fc-499c-8cd0-1eba43565af8\") " pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.590976 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.590881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63185afc-d764-488c-8d3e-ff86a5494b41-tmp-dir\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.590976 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.590967    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 21:53:58.591047 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.591012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gcd\" (UniqueName: \"kubernetes.io/projected/63185afc-d764-488c-8d3e-ff86a5494b41-kube-api-access-t6gcd\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.591047 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.591020    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls podName:63185afc-d764-488c-8d3e-ff86a5494b41 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:59.091003084 +0000 UTC m=+35.863016075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls") pod "dns-default-kntzg" (UID: "63185afc-d764-488c-8d3e-ff86a5494b41") : secret "dns-default-metrics-tls" not found
Sep 04 21:53:58.591139 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.591104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggr\" (UniqueName: \"kubernetes.io/projected/01c87113-e1fc-499c-8cd0-1eba43565af8-kube-api-access-74ggr\") pod \"ingress-canary-4wv5v\" (UID: \"01c87113-e1fc-499c-8cd0-1eba43565af8\") " pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.591325 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.591306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63185afc-d764-488c-8d3e-ff86a5494b41-tmp-dir\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.591392 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.591359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63185afc-d764-488c-8d3e-ff86a5494b41-config-volume\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.592269 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.592249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"
Sep 04 21:53:58.592874 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.592855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01c87113-e1fc-499c-8cd0-1eba43565af8-cert\") pod \"ingress-canary-4wv5v\" (UID: \"01c87113-e1fc-499c-8cd0-1eba43565af8\") " pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.610441 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.609477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"
Sep 04 21:53:58.631726 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.631696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvmw\" (UniqueName: \"kubernetes.io/projected/29c29276-c762-4fa0-926e-8c958212959e-kube-api-access-hqvmw\") pod \"network-check-source-685456655f-vbzm9\" (UID: \"29c29276-c762-4fa0-926e-8c958212959e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9"
Sep 04 21:53:58.632266 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.632243    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74ggr\" (UniqueName: \"kubernetes.io/projected/01c87113-e1fc-499c-8cd0-1eba43565af8-kube-api-access-74ggr\") pod \"ingress-canary-4wv5v\" (UID: \"01c87113-e1fc-499c-8cd0-1eba43565af8\") " pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.633602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.633557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gcd\" (UniqueName: \"kubernetes.io/projected/63185afc-d764-488c-8d3e-ff86a5494b41-kube-api-access-t6gcd\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:58.647556 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.647453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4wv5v"
Sep 04 21:53:58.845178 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.845152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:53:58.845282 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.845151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:53:58.848117 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.848098    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xzsq2\""
Sep 04 21:53:58.848117 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.848101    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-268hq\""
Sep 04 21:53:58.848597 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.848583    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 04 21:53:58.901458 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.901435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:58.901551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.901486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:58.901551 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.901526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:58.901666 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901583    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 21:53:58.901666 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901654    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls podName:d10170e3-9966-4245-87c0-a46550a09296 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:59.901623196 +0000 UTC m=+36.673636198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-b576p" (UID: "d10170e3-9966-4245-87c0-a46550a09296") : secret "samples-operator-tls" not found
Sep 04 21:53:58.901764 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901703    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 04 21:53:58.901764 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901743    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls podName:5b7e5697-f59b-4970-a58e-6f9bcb4b9a92 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:59.901730057 +0000 UTC m=+36.673743058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hs27z" (UID: "5b7e5697-f59b-4970-a58e-6f9bcb4b9a92") : secret "cluster-monitoring-operator-tls" not found
Sep 04 21:53:58.901764 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901741    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 04 21:53:58.901764 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901757    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f87c87fc-m9qlm: secret "image-registry-tls" not found
Sep 04 21:53:58.901913 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:58.901786    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls podName:1d30f914-a461-490e-ab74-c52677dbee40 nodeName:}" failed. No retries permitted until 2026-09-04 21:53:59.901776467 +0000 UTC m=+36.673789457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls") pod "image-registry-78f87c87fc-m9qlm" (UID: "1d30f914-a461-490e-ab74-c52677dbee40") : secret "image-registry-tls" not found
Sep 04 21:53:58.928601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.928541    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9"
Sep 04 21:53:58.945931 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.945500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb"]
Sep 04 21:53:58.955256 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:58.955054    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db4739a_47e2_47ea_8e10_b68b9e58c8d8.slice/crio-db7f2f5e912a1e3e65126492d593b9e58740a0a4961b6b6d25311bfc572eab2f WatchSource:0}: Error finding container db7f2f5e912a1e3e65126492d593b9e58740a0a4961b6b6d25311bfc572eab2f: Status 404 returned error can't find the container with id db7f2f5e912a1e3e65126492d593b9e58740a0a4961b6b6d25311bfc572eab2f
Sep 04 21:53:58.957343 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:58.957269    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb671cf_5a76_465a_8bcb_9f815bf3a057.slice/crio-f5cea54ea4ed611e1926d0a68558cf75da4a6450d109feac681fa040537c4051 WatchSource:0}: Error finding container f5cea54ea4ed611e1926d0a68558cf75da4a6450d109feac681fa040537c4051: Status 404 returned error can't find the container with id f5cea54ea4ed611e1926d0a68558cf75da4a6450d109feac681fa040537c4051
Sep 04 21:53:58.959197 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.959175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-8rx8q"]
Sep 04 21:53:58.959267 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:58.959207    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff74870_50dd_444a_9cf3_00135ed88165.slice/crio-4bed720e3a49fcab075e5fcf2264a0f7cf85d029ffa1ce4c445148a7165bda07 WatchSource:0}: Error finding container 4bed720e3a49fcab075e5fcf2264a0f7cf85d029ffa1ce4c445148a7165bda07: Status 404 returned error can't find the container with id 4bed720e3a49fcab075e5fcf2264a0f7cf85d029ffa1ce4c445148a7165bda07
Sep 04 21:53:58.960287 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:58.960266    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ca4367_fd7e_4c51_a763_cd939e9c1154.slice/crio-766b1ac9fca1d788f544a40adbbf28aeee32f4415600280f6f1042ebf4c86aa3 WatchSource:0}: Error finding container 766b1ac9fca1d788f544a40adbbf28aeee32f4415600280f6f1042ebf4c86aa3: Status 404 returned error can't find the container with id 766b1ac9fca1d788f544a40adbbf28aeee32f4415600280f6f1042ebf4c86aa3
Sep 04 21:53:58.960389 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.960369    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ql6g5"]
Sep 04 21:53:58.961575 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.961409    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf"]
Sep 04 21:53:58.962736 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.962714    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj"]
Sep 04 21:53:58.965474 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:58.965421    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb25480_a856_42e8_9f87_eb170d89d8c8.slice/crio-e98c2016322ad167d650ff4de08bfca6852a4131599c815cf653a4b079d85c14 WatchSource:0}: Error finding container e98c2016322ad167d650ff4de08bfca6852a4131599c815cf653a4b079d85c14: Status 404 returned error can't find the container with id e98c2016322ad167d650ff4de08bfca6852a4131599c815cf653a4b079d85c14
Sep 04 21:53:58.992807 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:58.992780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4wv5v"]
Sep 04 21:53:59.002071 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:59.002040    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c87113_e1fc_499c_8cd0_1eba43565af8.slice/crio-f1c6b9e49fd089521d9ee90bbac85312df766b330d842f0f1e16802bce9e9c27 WatchSource:0}: Error finding container f1c6b9e49fd089521d9ee90bbac85312df766b330d842f0f1e16802bce9e9c27: Status 404 returned error can't find the container with id f1c6b9e49fd089521d9ee90bbac85312df766b330d842f0f1e16802bce9e9c27
Sep 04 21:53:59.002208 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.002115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:59.002272 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.002232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:53:59.002330 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.002285    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 04 21:53:59.002390 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.002349    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:00.002330703 +0000 UTC m=+36.774343697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : secret "router-metrics-certs-default" not found
Sep 04 21:53:59.003086 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.002465    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:00.002452473 +0000 UTC m=+36.774465481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : configmap references non-existent config key: service-ca.crt
Sep 04 21:53:59.003086 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.002558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q" event={"ID":"bff74870-50dd-444a-9cf3-00135ed88165","Type":"ContainerStarted","Data":"4bed720e3a49fcab075e5fcf2264a0f7cf85d029ffa1ce4c445148a7165bda07"}
Sep 04 21:53:59.004921 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.004889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf" event={"ID":"6bb671cf-5a76-465a-8bcb-9f815bf3a057","Type":"ContainerStarted","Data":"f5cea54ea4ed611e1926d0a68558cf75da4a6450d109feac681fa040537c4051"}
Sep 04 21:53:59.008900 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.008825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj" event={"ID":"ecb25480-a856-42e8-9f87-eb170d89d8c8","Type":"ContainerStarted","Data":"e98c2016322ad167d650ff4de08bfca6852a4131599c815cf653a4b079d85c14"}
Sep 04 21:53:59.011957 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.011885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" event={"ID":"f0ca4367-fd7e-4c51-a763-cd939e9c1154","Type":"ContainerStarted","Data":"766b1ac9fca1d788f544a40adbbf28aeee32f4415600280f6f1042ebf4c86aa3"}
Sep 04 21:53:59.015616 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.014600    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb" event={"ID":"3db4739a-47e2-47ea-8e10-b68b9e58c8d8","Type":"ContainerStarted","Data":"db7f2f5e912a1e3e65126492d593b9e58740a0a4961b6b6d25311bfc572eab2f"}
Sep 04 21:53:59.102883 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.102858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:53:59.103255 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.103045    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 21:53:59.103255 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.103115    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls podName:63185afc-d764-488c-8d3e-ff86a5494b41 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:00.103094666 +0000 UTC m=+36.875107656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls") pod "dns-default-kntzg" (UID: "63185afc-d764-488c-8d3e-ff86a5494b41") : secret "dns-default-metrics-tls" not found
Sep 04 21:53:59.246420 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.246391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vbzm9"]
Sep 04 21:53:59.249330 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:53:59.249299    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c29276_c762_4fa0_926e_8c958212959e.slice/crio-85d4b366c71e720a244b364addf9002df3d4d461efc2288ea93593f6ccb38874 WatchSource:0}: Error finding container 85d4b366c71e720a244b364addf9002df3d4d461efc2288ea93593f6ccb38874: Status 404 returned error can't find the container with id 85d4b366c71e720a244b364addf9002df3d4d461efc2288ea93593f6ccb38874
Sep 04 21:53:59.845865 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.845831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:53:59.850351 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.850322    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.909414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.909474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:53:59.909586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.909767    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.909838    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls podName:d10170e3-9966-4245-87c0-a46550a09296 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:01.909818898 +0000 UTC m=+38.681831889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-b576p" (UID: "d10170e3-9966-4245-87c0-a46550a09296") : secret "samples-operator-tls" not found
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.910079    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 04 21:53:59.910174 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.910131    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls podName:5b7e5697-f59b-4970-a58e-6f9bcb4b9a92 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:01.910114547 +0000 UTC m=+38.682127544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hs27z" (UID: "5b7e5697-f59b-4970-a58e-6f9bcb4b9a92") : secret "cluster-monitoring-operator-tls" not found
Sep 04 21:53:59.910775 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.910196    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 04 21:53:59.910775 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.910207    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f87c87fc-m9qlm: secret "image-registry-tls" not found
Sep 04 21:53:59.910775 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:53:59.910240    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls podName:1d30f914-a461-490e-ab74-c52677dbee40 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:01.910229429 +0000 UTC m=+38.682242429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls") pod "image-registry-78f87c87fc-m9qlm" (UID: "1d30f914-a461-490e-ab74-c52677dbee40") : secret "image-registry-tls" not found
Sep 04 21:54:00.010791 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.010755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:00.010961 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.010904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:00.011025 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:00.010979    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:02.010959114 +0000 UTC m=+38.782972112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : configmap references non-existent config key: service-ca.crt
Sep 04 21:54:00.011092 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:00.011040    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 04 21:54:00.011092 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:00.011078    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:02.011067459 +0000 UTC m=+38.783080449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : secret "router-metrics-certs-default" not found
Sep 04 21:54:00.032734 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.032171    2577 generic.go:356] "Generic (PLEG): container finished" podID="70efcff8-67a7-4d35-9300-beff862fbb5f" containerID="f52353dc62a2052728a3dec6114d09c75aa2f5aacebc751efda5b8e6d9e7fb87" exitCode=0
Sep 04 21:54:00.032734 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.032270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerDied","Data":"f52353dc62a2052728a3dec6114d09c75aa2f5aacebc751efda5b8e6d9e7fb87"}
Sep 04 21:54:00.038126 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.038072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9" event={"ID":"29c29276-c762-4fa0-926e-8c958212959e","Type":"ContainerStarted","Data":"85d4b366c71e720a244b364addf9002df3d4d461efc2288ea93593f6ccb38874"}
Sep 04 21:54:00.039839 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.039671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4wv5v" event={"ID":"01c87113-e1fc-499c-8cd0-1eba43565af8","Type":"ContainerStarted","Data":"f1c6b9e49fd089521d9ee90bbac85312df766b330d842f0f1e16802bce9e9c27"}
Sep 04 21:54:00.111923 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:00.111722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:00.112458 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:00.111987    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 21:54:00.112458 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:00.112043    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls podName:63185afc-d764-488c-8d3e-ff86a5494b41 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:02.112025195 +0000 UTC m=+38.884038187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls") pod "dns-default-kntzg" (UID: "63185afc-d764-488c-8d3e-ff86a5494b41") : secret "dns-default-metrics-tls" not found
Sep 04 21:54:01.050953 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.050047    2577 generic.go:356] "Generic (PLEG): container finished" podID="70efcff8-67a7-4d35-9300-beff862fbb5f" containerID="f749084a7be26d0d11028ff0e608474c1ee2b39f1fab54b9af8f85cc667b8075" exitCode=0
Sep 04 21:54:01.050953 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.050122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerDied","Data":"f749084a7be26d0d11028ff0e608474c1ee2b39f1fab54b9af8f85cc667b8075"}
Sep 04 21:54:01.185012 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.184252    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-9hkfv"]
Sep 04 21:54:01.201810 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.201152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.202834 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.202654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-9hkfv"]
Sep 04 21:54:01.206385 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.206359    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mxslr\""
Sep 04 21:54:01.206676 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.206628    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 04 21:54:01.206858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.206839    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 04 21:54:01.325603 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.325481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.325772 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.325665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8529306-7f66-4db0-bf84-65530b4f0547-nginx-conf\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.427653 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.427245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8529306-7f66-4db0-bf84-65530b4f0547-nginx-conf\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.427653 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.427346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.427653 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.427574    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 04 21:54:01.427933 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.427701    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert podName:f8529306-7f66-4db0-bf84-65530b4f0547 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:01.927679002 +0000 UTC m=+38.699692175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9hkfv" (UID: "f8529306-7f66-4db0-bf84-65530b4f0547") : secret "networking-console-plugin-cert" not found
Sep 04 21:54:01.428663 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.428613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8529306-7f66-4db0-bf84-65530b4f0547-nginx-conf\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.452188 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.452034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:01.655378 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.655301    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:01.751195 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.751140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:01.884361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.884326    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:01.931542 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.931457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:01.931542 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.931504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931618    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931624    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931660    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f87c87fc-m9qlm: secret "image-registry-tls" not found
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.931664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931682    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls podName:5b7e5697-f59b-4970-a58e-6f9bcb4b9a92 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:05.931667938 +0000 UTC m=+42.703680926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hs27z" (UID: "5b7e5697-f59b-4970-a58e-6f9bcb4b9a92") : secret "cluster-monitoring-operator-tls" not found
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931721    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls podName:1d30f914-a461-490e-ab74-c52677dbee40 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:05.931704129 +0000 UTC m=+42.703717120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls") pod "image-registry-78f87c87fc-m9qlm" (UID: "1d30f914-a461-490e-ab74-c52677dbee40") : secret "image-registry-tls" not found
Sep 04 21:54:01.931787 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931742    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 04 21:54:01.932117 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931798    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert podName:f8529306-7f66-4db0-bf84-65530b4f0547 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:02.931783232 +0000 UTC m=+39.703796225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9hkfv" (UID: "f8529306-7f66-4db0-bf84-65530b4f0547") : secret "networking-console-plugin-cert" not found
Sep 04 21:54:01.932117 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:01.931863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:54:01.932117 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.931957    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 21:54:01.932117 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:01.932000    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls podName:d10170e3-9966-4245-87c0-a46550a09296 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:05.931988129 +0000 UTC m=+42.704001120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-b576p" (UID: "d10170e3-9966-4245-87c0-a46550a09296") : secret "samples-operator-tls" not found
Sep 04 21:54:02.032931 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:02.032893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:02.033096 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.033052    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:06.033032264 +0000 UTC m=+42.805045256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : configmap references non-existent config key: service-ca.crt
Sep 04 21:54:02.033199 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:02.033177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:02.033374 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.033348    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 04 21:54:02.033491 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.033425    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:06.033407114 +0000 UTC m=+42.805420118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : secret "router-metrics-certs-default" not found
Sep 04 21:54:02.134572 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:02.134528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:02.134733 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.134672    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 21:54:02.134733 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.134726    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls podName:63185afc-d764-488c-8d3e-ff86a5494b41 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:06.134711942 +0000 UTC m=+42.906724931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls") pod "dns-default-kntzg" (UID: "63185afc-d764-488c-8d3e-ff86a5494b41") : secret "dns-default-metrics-tls" not found
Sep 04 21:54:02.940572 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:02.940488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:02.941036 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.940670    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 04 21:54:02.941036 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:02.940754    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert podName:f8529306-7f66-4db0-bf84-65530b4f0547 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:04.940729918 +0000 UTC m=+41.712742912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9hkfv" (UID: "f8529306-7f66-4db0-bf84-65530b4f0547") : secret "networking-console-plugin-cert" not found
Sep 04 21:54:03.095684 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:03.095655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:03.208441 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:03.208346    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:03.562761 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:03.562683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:03.695057 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:03.695006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:04.957955 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:04.957919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:04.958379 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:04.958071    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 04 21:54:04.958379 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:04.958150    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert podName:f8529306-7f66-4db0-bf84-65530b4f0547 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:08.958132687 +0000 UTC m=+45.730145674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9hkfv" (UID: "f8529306-7f66-4db0-bf84-65530b4f0547") : secret "networking-console-plugin-cert" not found
Sep 04 21:54:05.966047 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:05.966006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:05.966159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966172    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:05.966219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966304    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966328    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966342    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f87c87fc-m9qlm: secret "image-registry-tls" not found
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966284    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls podName:5b7e5697-f59b-4970-a58e-6f9bcb4b9a92 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:13.966261869 +0000 UTC m=+50.738274859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hs27z" (UID: "5b7e5697-f59b-4970-a58e-6f9bcb4b9a92") : secret "cluster-monitoring-operator-tls" not found
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966375    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls podName:d10170e3-9966-4245-87c0-a46550a09296 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:13.966358708 +0000 UTC m=+50.738371699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-b576p" (UID: "d10170e3-9966-4245-87c0-a46550a09296") : secret "samples-operator-tls" not found
Sep 04 21:54:05.966521 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:05.966392    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls podName:1d30f914-a461-490e-ab74-c52677dbee40 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:13.966383287 +0000 UTC m=+50.738396276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls") pod "image-registry-78f87c87fc-m9qlm" (UID: "1d30f914-a461-490e-ab74-c52677dbee40") : secret "image-registry-tls" not found
Sep 04 21:54:05.966977 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:05.966689    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:06.066753 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:06.066719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:06.066936 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:06.066812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:06.066936 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:06.066897    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 04 21:54:06.067050 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:06.066973    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:14.066955074 +0000 UTC m=+50.838968082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : secret "router-metrics-certs-default" not found
Sep 04 21:54:06.067050 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:06.066995    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:14.066985225 +0000 UTC m=+50.838998215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : configmap references non-existent config key: service-ca.crt
Sep 04 21:54:06.068594 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:06.068559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:06.167686 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:06.167650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:06.167836 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:06.167800    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 21:54:06.167876 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:06.167862    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls podName:63185afc-d764-488c-8d3e-ff86a5494b41 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:14.167847484 +0000 UTC m=+50.939860472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls") pod "dns-default-kntzg" (UID: "63185afc-d764-488c-8d3e-ff86a5494b41") : secret "dns-default-metrics-tls" not found
Sep 04 21:54:06.775025 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:06.774995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:06.873787 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:06.873758    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:07.072069 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.072031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" event={"ID":"70efcff8-67a7-4d35-9300-beff862fbb5f","Type":"ContainerStarted","Data":"e7f61ac92c43143fe364db0f9e3404e84a6b12ae86939c1743db9008772ea6be"}
Sep 04 21:54:07.078282 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.075053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf" event={"ID":"6bb671cf-5a76-465a-8bcb-9f815bf3a057","Type":"ContainerStarted","Data":"bf3e6895f9910acd7d0a443acd6ceb018b2dc6aae7afbc2ad23ac940c2e505df"}
Sep 04 21:54:07.078282 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.077177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj" event={"ID":"ecb25480-a856-42e8-9f87-eb170d89d8c8","Type":"ContainerStarted","Data":"b1d86603048937b151c8e3424d5f28fd17fdad2cfab4fb4db50e73232aba2439"}
Sep 04 21:54:07.089486 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.089152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/0.log"
Sep 04 21:54:07.089486 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.089196    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0ca4367-fd7e-4c51-a763-cd939e9c1154" containerID="0daa6af8bbb25c2e5b9763171cd7a4916e1398423ee2b82c543e5264e16ae4f1" exitCode=255
Sep 04 21:54:07.089486 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.089285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" event={"ID":"f0ca4367-fd7e-4c51-a763-cd939e9c1154","Type":"ContainerDied","Data":"0daa6af8bbb25c2e5b9763171cd7a4916e1398423ee2b82c543e5264e16ae4f1"}
Sep 04 21:54:07.089486 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.089482    2577 scope.go:117] "RemoveContainer" containerID="0daa6af8bbb25c2e5b9763171cd7a4916e1398423ee2b82c543e5264e16ae4f1"
Sep 04 21:54:07.093183 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.093137    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9" event={"ID":"29c29276-c762-4fa0-926e-8c958212959e","Type":"ContainerStarted","Data":"f78f0c6d2a66fd521e3e7abea70d0d4988679a3a53a802ea5083779aa891fd47"}
Sep 04 21:54:07.095087 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.095039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb" event={"ID":"3db4739a-47e2-47ea-8e10-b68b9e58c8d8","Type":"ContainerStarted","Data":"2267457f83f992c71f060c4e7eb645f0e8571f0cea4e9bac7fbfc5c65ada3f4b"}
Sep 04 21:54:07.097114 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.097069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q" event={"ID":"bff74870-50dd-444a-9cf3-00135ed88165","Type":"ContainerStarted","Data":"1bf221acb2b24b8d5f07169db2405dfae0ada96d6e7ee6573a391dce3bbc48c3"}
Sep 04 21:54:07.098655 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.098613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4wv5v" event={"ID":"01c87113-e1fc-499c-8cd0-1eba43565af8","Type":"ContainerStarted","Data":"3dc37906050e91357bb04fd80b4c0b280bb4ee05e67383cd64ce49778cef9888"}
Sep 04 21:54:07.106988 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.106931    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5r2zk" podStartSLOduration=13.708888747 podStartE2EDuration="43.106913858s" totalImagesPullingTime="29.398025111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.104831342 +0000 UTC m=+43.876844351" watchObservedRunningTime="2026-09-04 21:54:07.106913858 +0000 UTC m=+43.878926866"
Sep 04 21:54:07.145691 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.145618    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q" podStartSLOduration=32.388358962 podStartE2EDuration="40.145597392s" totalImagesPullingTime="7.75723843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.144518012 +0000 UTC m=+43.916531023" watchObservedRunningTime="2026-09-04 21:54:07.145597392 +0000 UTC m=+43.917610403"
Sep 04 21:54:07.164268 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.164217    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mlzpj" podStartSLOduration=32.446682907 podStartE2EDuration="40.164196838s" totalImagesPullingTime="7.717513931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.163521929 +0000 UTC m=+43.935534941" watchObservedRunningTime="2026-09-04 21:54:07.164196838 +0000 UTC m=+43.936209849"
Sep 04 21:54:07.231557 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.230003    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-vbzm9" podStartSLOduration=25.75059559 podStartE2EDuration="33.229981688s" totalImagesPullingTime="7.479386098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.194592498 +0000 UTC m=+43.966605509" watchObservedRunningTime="2026-09-04 21:54:07.229981688 +0000 UTC m=+44.001994699"
Sep 04 21:54:07.231557 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.230110    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4wv5v" podStartSLOduration=1.513671988 podStartE2EDuration="9.230101263s" totalImagesPullingTime="7.716429275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.228763464 +0000 UTC m=+44.000776475" watchObservedRunningTime="2026-09-04 21:54:07.230101263 +0000 UTC m=+44.002114274"
Sep 04 21:54:07.317443 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.317373    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb" podStartSLOduration=29.554598861 podStartE2EDuration="37.317348104s" totalImagesPullingTime="7.762749243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.317178192 +0000 UTC m=+44.089191201" watchObservedRunningTime="2026-09-04 21:54:07.317348104 +0000 UTC m=+44.089361116"
Sep 04 21:54:07.365492 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.365433    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf" podStartSLOduration=26.605699984 podStartE2EDuration="34.365411085s" totalImagesPullingTime="7.759711101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:07.363842767 +0000 UTC m=+44.135855779" watchObservedRunningTime="2026-09-04 21:54:07.365411085 +0000 UTC m=+44.137424096"
Sep 04 21:54:07.372330 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.372301    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:07.504035 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.504003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:07.607714 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.607652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:07.717447 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.717411    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:07.828850 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:07.828762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.107928 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.107851    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 21:54:08.108363 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.108284    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/0.log"
Sep 04 21:54:08.108363 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.108322    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0ca4367-fd7e-4c51-a763-cd939e9c1154" containerID="219a6ce69388385544994363be9a315b64d6565229dcc04610f085bf3f77b25f" exitCode=255
Sep 04 21:54:08.108472 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.108426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" event={"ID":"f0ca4367-fd7e-4c51-a763-cd939e9c1154","Type":"ContainerDied","Data":"219a6ce69388385544994363be9a315b64d6565229dcc04610f085bf3f77b25f"}
Sep 04 21:54:08.108538 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.108489    2577 scope.go:117] "RemoveContainer" containerID="0daa6af8bbb25c2e5b9763171cd7a4916e1398423ee2b82c543e5264e16ae4f1"
Sep 04 21:54:08.108670 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.108631    2577 scope.go:117] "RemoveContainer" containerID="219a6ce69388385544994363be9a315b64d6565229dcc04610f085bf3f77b25f"
Sep 04 21:54:08.108863 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.108840    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ql6g5_openshift-console-operator(f0ca4367-fd7e-4c51-a763-cd939e9c1154)\"" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" podUID="f0ca4367-fd7e-4c51-a763-cd939e9c1154"
Sep 04 21:54:08.115120 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.115094    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.123872 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.123851    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"]
Sep 04 21:54:08.137179 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.137137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"
Sep 04 21:54:08.139616 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.139593    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fttvn\""
Sep 04 21:54:08.139855 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.139837    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 04 21:54:08.140045 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.140030    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 04 21:54:08.143030 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.143009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"]
Sep 04 21:54:08.186440 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.186195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnhjj\" (UniqueName: \"kubernetes.io/projected/3e983334-06d4-4810-ab8b-eeffc1a18a2a-kube-api-access-xnhjj\") pod \"migrator-fdbb8fdff-r6cwf\" (UID: \"3e983334-06d4-4810-ab8b-eeffc1a18a2a\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"
Sep 04 21:54:08.212553 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.212482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.287766 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.287731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnhjj\" (UniqueName: \"kubernetes.io/projected/3e983334-06d4-4810-ab8b-eeffc1a18a2a-kube-api-access-xnhjj\") pod \"migrator-fdbb8fdff-r6cwf\" (UID: \"3e983334-06d4-4810-ab8b-eeffc1a18a2a\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"
Sep 04 21:54:08.301737 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.301710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnhjj\" (UniqueName: \"kubernetes.io/projected/3e983334-06d4-4810-ab8b-eeffc1a18a2a-kube-api-access-xnhjj\") pod \"migrator-fdbb8fdff-r6cwf\" (UID: \"3e983334-06d4-4810-ab8b-eeffc1a18a2a\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"
Sep 04 21:54:08.325664 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.325616    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.450367 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.450282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"
Sep 04 21:54:08.533331 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.533298    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:54:08.533448 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.533426    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:54:08.578361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.578320    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vl5vx"]
Sep 04 21:54:08.613405 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.613377    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vl5vx"]
Sep 04 21:54:08.613549 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.613510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.616124 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.616101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 04 21:54:08.616276 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.616119    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 04 21:54:08.616276 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.616127    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9gp7g\""
Sep 04 21:54:08.627626 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.627602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.691482 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.691454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09623da6-2cb8-4eb4-a754-87ccd3c94a72-data-volume\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.691603 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.691496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.691603 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.691586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09623da6-2cb8-4eb4-a754-87ccd3c94a72-crio-socket\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.691734 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.691717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.691813 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.691798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8j2t\" (UniqueName: \"kubernetes.io/projected/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-api-access-d8j2t\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.700878 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.700821    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.765205 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.765177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf"]
Sep 04 21:54:08.768983 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:08.768944    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e983334_06d4_4810_ab8b_eeffc1a18a2a.slice/crio-6d8f9729ea78911973e029afce5f5487111cbe06600456a49a2799cc181a420f WatchSource:0}: Error finding container 6d8f9729ea78911973e029afce5f5487111cbe06600456a49a2799cc181a420f: Status 404 returned error can't find the container with id 6d8f9729ea78911973e029afce5f5487111cbe06600456a49a2799cc181a420f
Sep 04 21:54:08.793061 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8j2t\" (UniqueName: \"kubernetes.io/projected/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-api-access-d8j2t\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793154 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09623da6-2cb8-4eb4-a754-87ccd3c94a72-data-volume\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793154 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793254 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.793196    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:08.793301 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.793271    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:09.293246387 +0000 UTC m=+46.065259379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:08.793362 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09623da6-2cb8-4eb4-a754-87ccd3c94a72-crio-socket\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793427 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09623da6-2cb8-4eb4-a754-87ccd3c94a72-data-volume\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793481 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793481 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.793455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09623da6-2cb8-4eb4-a754-87ccd3c94a72-crio-socket\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.793578 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.793480    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 21:54:08.793615 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.793578    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:09.293561775 +0000 UTC m=+46.065574780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : configmap "kube-rbac-proxy" not found
Sep 04 21:54:08.802588 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.802564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8j2t\" (UniqueName: \"kubernetes.io/projected/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-api-access-d8j2t\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:08.916345 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.916317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:08.995133 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:08.995049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:08.995294 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.995173    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 04 21:54:08.995294 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:08.995250    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert podName:f8529306-7f66-4db0-bf84-65530b4f0547 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:16.995231 +0000 UTC m=+53.767243992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9hkfv" (UID: "f8529306-7f66-4db0-bf84-65530b4f0547") : secret "networking-console-plugin-cert" not found
Sep 04 21:54:09.112852 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.112825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 21:54:09.113265 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.113190    2577 scope.go:117] "RemoveContainer" containerID="219a6ce69388385544994363be9a315b64d6565229dcc04610f085bf3f77b25f"
Sep 04 21:54:09.113392 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:09.113369    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ql6g5_openshift-console-operator(f0ca4367-fd7e-4c51-a763-cd939e9c1154)\"" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" podUID="f0ca4367-fd7e-4c51-a763-cd939e9c1154"
Sep 04 21:54:09.114153 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.114128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf" event={"ID":"3e983334-06d4-4810-ab8b-eeffc1a18a2a","Type":"ContainerStarted","Data":"6d8f9729ea78911973e029afce5f5487111cbe06600456a49a2799cc181a420f"}
Sep 04 21:54:09.297671 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.297625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:09.297850 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.297719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:09.297850 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:09.297750    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 21:54:09.297850 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:09.297819    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:10.297795874 +0000 UTC m=+47.069808867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : configmap "kube-rbac-proxy" not found
Sep 04 21:54:09.297850 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:09.297820    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:09.297988 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:09.297863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:10.297850788 +0000 UTC m=+47.069863779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:09.339752 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.339721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:09.432523 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.432484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:09.659808 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.659726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:09.954913 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:09.954820    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:10.027336 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.027260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:10.114693 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.114659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:10.116802 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.116783    2577 scope.go:117] "RemoveContainer" containerID="219a6ce69388385544994363be9a315b64d6565229dcc04610f085bf3f77b25f"
Sep 04 21:54:10.116946 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:10.116929    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ql6g5_openshift-console-operator(f0ca4367-fd7e-4c51-a763-cd939e9c1154)\"" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" podUID="f0ca4367-fd7e-4c51-a763-cd939e9c1154"
Sep 04 21:54:10.307821 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.307795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:10.307948 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.307857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:10.307948 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:10.307924    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 21:54:10.308018 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:10.307984    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:10.308018 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:10.307999    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:12.307980281 +0000 UTC m=+49.079993286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : configmap "kube-rbac-proxy" not found
Sep 04 21:54:10.308086 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:10.308041    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:12.308012553 +0000 UTC m=+49.080025541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:10.355976 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.355947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fwp9d_6f381a89-94bb-48c7-8bdd-b44e56695651/dns-node-resolver/0.log"
Sep 04 21:54:10.393894 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.393865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:10.497857 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.497830    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:10.615896 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.615870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:10.736739 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:10.736712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:11.121427 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.121389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf" event={"ID":"3e983334-06d4-4810-ab8b-eeffc1a18a2a","Type":"ContainerStarted","Data":"84063e2b699a76224a1fa1bf277b8f33117b3cae3006f67ac2608f1ed1d740e3"}
Sep 04 21:54:11.121820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.121481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf" event={"ID":"3e983334-06d4-4810-ab8b-eeffc1a18a2a","Type":"ContainerStarted","Data":"60cdcd7255ea641384435b82f99dcbb5f5dd632c7944a5c958b1d957fd8c25dc"}
Sep 04 21:54:11.145469 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.145418    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-r6cwf" podStartSLOduration=1.410535165 podStartE2EDuration="3.145403685s" totalImagesPullingTime="1.73486852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:11.144656608 +0000 UTC m=+47.916669608" watchObservedRunningTime="2026-09-04 21:54:11.145403685 +0000 UTC m=+47.917416695"
Sep 04 21:54:11.251532 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.251473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:11.353802 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.353762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:11.539604 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.539578    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:11.552344 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:11.552324    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kkwjz_a17e9807-9b5e-4cc5-90c3-7c6afd89e797/node-ca/0.log"
Sep 04 21:54:12.167419 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.167393    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4wv5v_01c87113-e1fc-499c-8cd0-1eba43565af8/serve-healthcheck-canary/0.log"
Sep 04 21:54:12.254880 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.254855    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4xkdp"]
Sep 04 21:54:12.280720 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.280697    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4xkdp"]
Sep 04 21:54:12.280847 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.280783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.283375 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.283358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4fhdp\""
Sep 04 21:54:12.283648 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.283617    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 04 21:54:12.284094 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.284079    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 04 21:54:12.284407 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.284392    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 04 21:54:12.284468 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.284450    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 04 21:54:12.306934 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.306909    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:12.324065 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.324045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlvq7\" (UniqueName: \"kubernetes.io/projected/12b64cdf-0411-477b-8523-ebbe708efa14-kube-api-access-vlvq7\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.324150 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.324072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12b64cdf-0411-477b-8523-ebbe708efa14-signing-cabundle\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.324150 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.324093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12b64cdf-0411-477b-8523-ebbe708efa14-signing-key\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.324224 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.324204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:12.324278 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.324265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:12.324315 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:12.324309    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 21:54:12.324356 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:12.324351    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:16.324339346 +0000 UTC m=+53.096352333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : configmap "kube-rbac-proxy" not found
Sep 04 21:54:12.324405 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:12.324353    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:12.324405 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:12.324389    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:16.324377414 +0000 UTC m=+53.096390402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:12.353864 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.353843    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-r6cwf_3e983334-06d4-4810-ab8b-eeffc1a18a2a/migrator/0.log"
Sep 04 21:54:12.408208 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.408183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:12.425110 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.425055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12b64cdf-0411-477b-8523-ebbe708efa14-signing-cabundle\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.425110 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.425086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12b64cdf-0411-477b-8523-ebbe708efa14-signing-key\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.425245 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.425234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlvq7\" (UniqueName: \"kubernetes.io/projected/12b64cdf-0411-477b-8523-ebbe708efa14-kube-api-access-vlvq7\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.425715 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.425686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12b64cdf-0411-477b-8523-ebbe708efa14-signing-cabundle\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.427443 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.427425    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12b64cdf-0411-477b-8523-ebbe708efa14-signing-key\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.434199 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.434171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlvq7\" (UniqueName: \"kubernetes.io/projected/12b64cdf-0411-477b-8523-ebbe708efa14-kube-api-access-vlvq7\") pod \"service-ca-75d99c484-4xkdp\" (UID: \"12b64cdf-0411-477b-8523-ebbe708efa14\") " pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.553858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.553818    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-r6cwf_3e983334-06d4-4810-ab8b-eeffc1a18a2a/graceful-termination/0.log"
Sep 04 21:54:12.589159 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.589124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-4xkdp"
Sep 04 21:54:12.756155 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.756124    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-xkcpb_3db4739a-47e2-47ea-8e10-b68b9e58c8d8/kube-storage-version-migrator-operator/0.log"
Sep 04 21:54:12.890704 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:12.890675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4xkdp"]
Sep 04 21:54:12.893546 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:12.893524    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b64cdf_0411_477b_8523_ebbe708efa14.slice/crio-554dfc69cf7a9b144d9067537585ea1b17bc3e7c1f624ab25b8fd521dd3e9298 WatchSource:0}: Error finding container 554dfc69cf7a9b144d9067537585ea1b17bc3e7c1f624ab25b8fd521dd3e9298: Status 404 returned error can't find the container with id 554dfc69cf7a9b144d9067537585ea1b17bc3e7c1f624ab25b8fd521dd3e9298
Sep 04 21:54:13.130103 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:13.130021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-4xkdp" event={"ID":"12b64cdf-0411-477b-8523-ebbe708efa14","Type":"ContainerStarted","Data":"e64f266faaa507885a41da3e26c336e16542ecbc13ff43d34844b1af58fb3b17"}
Sep 04 21:54:13.130103 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:13.130081    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-4xkdp" event={"ID":"12b64cdf-0411-477b-8523-ebbe708efa14","Type":"ContainerStarted","Data":"554dfc69cf7a9b144d9067537585ea1b17bc3e7c1f624ab25b8fd521dd3e9298"}
Sep 04 21:54:13.149616 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:13.149559    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-4xkdp" podStartSLOduration=1.14954044 podStartE2EDuration="1.14954044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:13.148448462 +0000 UTC m=+49.920461472" watchObservedRunningTime="2026-09-04 21:54:13.14954044 +0000 UTC m=+49.921553452"
Sep 04 21:54:13.338702 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:13.338669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:13.710856 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:13.710816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:14.041590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.041561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:54:14.041792 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.041627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:14.041792 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.041696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:54:14.041792 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041720    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 21:54:14.041792 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041749    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 04 21:54:14.041792 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041768    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f87c87fc-m9qlm: secret "image-registry-tls" not found
Sep 04 21:54:14.041792 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041782    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls podName:d10170e3-9966-4245-87c0-a46550a09296 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:30.041763679 +0000 UTC m=+66.813776682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-b576p" (UID: "d10170e3-9966-4245-87c0-a46550a09296") : secret "samples-operator-tls" not found
Sep 04 21:54:14.042040 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041826    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls podName:1d30f914-a461-490e-ab74-c52677dbee40 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:30.041810565 +0000 UTC m=+66.813823567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls") pod "image-registry-78f87c87fc-m9qlm" (UID: "1d30f914-a461-490e-ab74-c52677dbee40") : secret "image-registry-tls" not found
Sep 04 21:54:14.042040 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041850    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 04 21:54:14.042040 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.041914    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls podName:5b7e5697-f59b-4970-a58e-6f9bcb4b9a92 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:30.041897581 +0000 UTC m=+66.813910575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hs27z" (UID: "5b7e5697-f59b-4970-a58e-6f9bcb4b9a92") : secret "cluster-monitoring-operator-tls" not found
Sep 04 21:54:14.142878 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.142843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:14.143003 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.142950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:14.143003 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.142980    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 04 21:54:14.143083 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.143042    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:30.143024872 +0000 UTC m=+66.915037865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : secret "router-metrics-certs-default" not found
Sep 04 21:54:14.143128 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.143100    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle podName:7802a7ba-c4b5-49f2-9988-f4462937de53 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:30.143083827 +0000 UTC m=+66.915096823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle") pod "router-default-7f6c8885b8-v8qbh" (UID: "7802a7ba-c4b5-49f2-9988-f4462937de53") : configmap references non-existent config key: service-ca.crt
Sep 04 21:54:14.244456 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.244413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:14.244691 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.244667    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 21:54:14.244808 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:14.244769    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls podName:63185afc-d764-488c-8d3e-ff86a5494b41 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:30.24474484 +0000 UTC m=+67.016757828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls") pod "dns-default-kntzg" (UID: "63185afc-d764-488c-8d3e-ff86a5494b41") : secret "dns-default-metrics-tls" not found
Sep 04 21:54:14.337433 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.337320    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:14.637940 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.637828    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:14.738002 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.737956    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:14.879155 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.879126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:14.975562 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:14.975463    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:15.075375 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:15.075345    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:15.179447 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:15.179408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:16.007269 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.007233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:16.209963 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.209930    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:16.363993 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.363920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:16.364167 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.364068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:16.364167 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:16.364098    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:16.364263 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:16.364171    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls podName:09623da6-2cb8-4eb4-a754-87ccd3c94a72 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:24.364151483 +0000 UTC m=+61.136164477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vl5vx" (UID: "09623da6-2cb8-4eb4-a754-87ccd3c94a72") : secret "insights-runtime-extractor-tls" not found
Sep 04 21:54:16.364542 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.364525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09623da6-2cb8-4eb4-a754-87ccd3c94a72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:16.616223 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.616146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:16.697093 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.697065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:16.815649 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:16.815616    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:17.037960 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:17.037924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:17.070877 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:17.070837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:17.070999 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:17.070981    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 04 21:54:17.071062 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:17.071051    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert podName:f8529306-7f66-4db0-bf84-65530b4f0547 nodeName:}" failed. No retries permitted until 2026-09-04 21:54:33.071034057 +0000 UTC m=+69.843047062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9hkfv" (UID: "f8529306-7f66-4db0-bf84-65530b4f0547") : secret "networking-console-plugin-cert" not found
Sep 04 21:54:17.773490 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:17.773450    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:18.029740 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:18.029661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:18.254213 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:18.254175    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:18.425335 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:18.425247    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:18.644924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:18.644872    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:18.720910 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:18.720842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:18.800096 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:18.800066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:19.005296 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:19.005265    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:20.030464 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:20.030434    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:20.408499 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:20.408425    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:20.593073 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:20.593036    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:20.695420 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:20.695344    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:20.815917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:20.815886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:20.928861 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:20.928833    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:21.031654 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:21.031615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:21.213278 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:21.213243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:22.003296 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:22.003257    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:22.415872 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:22.415788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:22.611810 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:22.611777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:22.800129 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:22.800083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:23.000184 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:23.000157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv5qw"
Sep 04 21:54:23.010615 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:23.005817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:23.801624 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:23.801596    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:23.846155 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:23.846132    2577 scope.go:117] "RemoveContainer" containerID="219a6ce69388385544994363be9a315b64d6565229dcc04610f085bf3f77b25f"
Sep 04 21:54:24.173412 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.173336    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 21:54:24.173565 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.173416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" event={"ID":"f0ca4367-fd7e-4c51-a763-cd939e9c1154","Type":"ContainerStarted","Data":"f038b89f9b1d97a814f32fe7a9a564c7ab3a06b9ec9205774f00c82128f0df04"}
Sep 04 21:54:24.173806 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.173776    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:54:24.190838 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.190792    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-ql6g5" podStartSLOduration=49.434256748 podStartE2EDuration="57.190775508s" totalImagesPullingTime="7.75651876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:24.190439727 +0000 UTC m=+60.962452738" watchObservedRunningTime="2026-09-04 21:54:24.190775508 +0000 UTC m=+60.962788516"
Sep 04 21:54:24.375033 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.374995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-ql6g5"
Sep 04 21:54:24.432127 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.432048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:24.435744 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.435719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:24.437958 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.437931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09623da6-2cb8-4eb4-a754-87ccd3c94a72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vl5vx\" (UID: \"09623da6-2cb8-4eb4-a754-87ccd3c94a72\") " pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:24.525417 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.525386    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9gp7g\""
Sep 04 21:54:24.534065 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.534038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vl5vx"
Sep 04 21:54:24.580166 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.579612    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:24.674998 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.674966    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:24.736782 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.736724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:24.805713 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.805622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vl5vx"]
Sep 04 21:54:24.805713 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.805651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:24.808136 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:24.808113    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09623da6_2cb8_4eb4_a754_87ccd3c94a72.slice/crio-528d78c42270ff38bdb664d757516959461611dafb839d35edef3f796b39e25f WatchSource:0}: Error finding container 528d78c42270ff38bdb664d757516959461611dafb839d35edef3f796b39e25f: Status 404 returned error can't find the container with id 528d78c42270ff38bdb664d757516959461611dafb839d35edef3f796b39e25f
Sep 04 21:54:24.911156 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:24.911126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:25.006253 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.006220    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:25.107138 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.107108    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:25.177649 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.177616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vl5vx" event={"ID":"09623da6-2cb8-4eb4-a754-87ccd3c94a72","Type":"ContainerStarted","Data":"6ae2c13ce710d1b247907556bbcd59ea24cc070510c37ee3f96d827548853bce"}
Sep 04 21:54:25.177773 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.177678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vl5vx" event={"ID":"09623da6-2cb8-4eb4-a754-87ccd3c94a72","Type":"ContainerStarted","Data":"528d78c42270ff38bdb664d757516959461611dafb839d35edef3f796b39e25f"}
Sep 04 21:54:25.247590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.247562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:25.362455 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.362373    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:25.465381 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.465015    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:25.560114 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:25.560084    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:26.185437 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:26.185395    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vl5vx" event={"ID":"09623da6-2cb8-4eb4-a754-87ccd3c94a72","Type":"ContainerStarted","Data":"0ed6f1335b4aae94a800f1cd39bf634d195a6cb12188792c5d57634198f81f55"}
Sep 04 21:54:26.252715 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:26.252670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:26.309903 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:26.309856    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:26.380132 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:26.380105    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:26.480469 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:26.480354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:27.062253 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:27.062230    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:27.127047 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:27.127019    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:27.190720 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:27.190694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vl5vx" event={"ID":"09623da6-2cb8-4eb4-a754-87ccd3c94a72","Type":"ContainerStarted","Data":"bc4ec3d691d3a7788c1ce2a68be2405e9769c54795222320947abf8c37f5b8f3"}
Sep 04 21:54:27.210228 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:27.210122    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vl5vx" podStartSLOduration=17.168510415 podStartE2EDuration="19.210107213s" totalImagesPullingTime="2.041596798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:54:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:27.208967042 +0000 UTC m=+63.980980051" watchObservedRunningTime="2026-09-04 21:54:27.210107213 +0000 UTC m=+63.982120224"
Sep 04 21:54:29.379141 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.379102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:54:29.381411 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.381393    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 04 21:54:29.392171 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.392152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db1ee4f6-293f-4063-9cb4-acdedfc96fa7-original-pull-secret\") pod \"global-pull-secret-syncer-dvvh2\" (UID: \"db1ee4f6-293f-4063-9cb4-acdedfc96fa7\") " pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:54:29.480368 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.480322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:54:29.482633 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.482615    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 04 21:54:29.493603 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.493581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e880518-4c71-4ae3-a31f-a0d584f72c0d-metrics-certs\") pod \"network-metrics-daemon-knwk6\" (UID: \"2e880518-4c71-4ae3-a31f-a0d584f72c0d\") " pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:54:29.560802 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.560782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvvh2"
Sep 04 21:54:29.581212 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.581195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:54:29.583526 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.583504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnls\" (UniqueName: \"kubernetes.io/projected/99928b1b-1cac-4fc7-82ea-d97856fffb5f-kube-api-access-kpnls\") pod \"network-check-target-bfglg\" (UID: \"99928b1b-1cac-4fc7-82ea-d97856fffb5f\") " pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:54:29.757998 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.757971    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-268hq\""
Sep 04 21:54:29.761683 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.761660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xzsq2\""
Sep 04 21:54:29.766399 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.766384    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwk6"
Sep 04 21:54:29.770604 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.770588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:54:29.855605 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:29.855576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvvh2"]
Sep 04 21:54:29.858823 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:29.858798    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1ee4f6_293f_4063_9cb4_acdedfc96fa7.slice/crio-e2d73fb371ac2e4cddee0b059ec7423d808a5829db92215fb1acf762547806e2 WatchSource:0}: Error finding container e2d73fb371ac2e4cddee0b059ec7423d808a5829db92215fb1acf762547806e2: Status 404 returned error can't find the container with id e2d73fb371ac2e4cddee0b059ec7423d808a5829db92215fb1acf762547806e2
Sep 04 21:54:30.066184 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.066161    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knwk6"]
Sep 04 21:54:30.068011 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:30.067985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e880518_4c71_4ae3_a31f_a0d584f72c0d.slice/crio-4b9d272165475be79979b31b121c16b5a63c08a3a37a6c5693a88bb5d8d77a3d WatchSource:0}: Error finding container 4b9d272165475be79979b31b121c16b5a63c08a3a37a6c5693a88bb5d8d77a3d: Status 404 returned error can't find the container with id 4b9d272165475be79979b31b121c16b5a63c08a3a37a6c5693a88bb5d8d77a3d
Sep 04 21:54:30.086752 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.086728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:54:30.086846 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.086827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:54:30.086894 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.086867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:30.089114 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.089092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b7e5697-f59b-4970-a58e-6f9bcb4b9a92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hs27z\" (UID: \"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:54:30.089213 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.089145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10170e3-9966-4245-87c0-a46550a09296-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-b576p\" (UID: \"d10170e3-9966-4245-87c0-a46550a09296\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:54:30.089213 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.089183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"image-registry-78f87c87fc-m9qlm\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") " pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:30.102483 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.102465    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bfglg"]
Sep 04 21:54:30.104428 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:30.104410    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99928b1b_1cac_4fc7_82ea_d97856fffb5f.slice/crio-86029de46b84875d40424bfd101e1d7ce7a653d9c56282a245f4f7e1e75f1391 WatchSource:0}: Error finding container 86029de46b84875d40424bfd101e1d7ce7a653d9c56282a245f4f7e1e75f1391: Status 404 returned error can't find the container with id 86029de46b84875d40424bfd101e1d7ce7a653d9c56282a245f4f7e1e75f1391
Sep 04 21:54:30.187441 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.187410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:30.187550 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.187527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:30.187966 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.187946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7802a7ba-c4b5-49f2-9988-f4462937de53-service-ca-bundle\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:30.189602 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.189581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7802a7ba-c4b5-49f2-9988-f4462937de53-metrics-certs\") pod \"router-default-7f6c8885b8-v8qbh\" (UID: \"7802a7ba-c4b5-49f2-9988-f4462937de53\") " pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:30.202688 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.202664    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knwk6" event={"ID":"2e880518-4c71-4ae3-a31f-a0d584f72c0d","Type":"ContainerStarted","Data":"4b9d272165475be79979b31b121c16b5a63c08a3a37a6c5693a88bb5d8d77a3d"}
Sep 04 21:54:30.203676 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.203658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvvh2" event={"ID":"db1ee4f6-293f-4063-9cb4-acdedfc96fa7","Type":"ContainerStarted","Data":"e2d73fb371ac2e4cddee0b059ec7423d808a5829db92215fb1acf762547806e2"}
Sep 04 21:54:30.205116 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.205097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bfglg" event={"ID":"99928b1b-1cac-4fc7-82ea-d97856fffb5f","Type":"ContainerStarted","Data":"2f0010b8c647f09820accb0bfdb304b06d71dcf749815e377bf5eaccd02e588b"}
Sep 04 21:54:30.205195 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.205132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bfglg" event={"ID":"99928b1b-1cac-4fc7-82ea-d97856fffb5f","Type":"ContainerStarted","Data":"86029de46b84875d40424bfd101e1d7ce7a653d9c56282a245f4f7e1e75f1391"}
Sep 04 21:54:30.262142 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.262121    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfckr\""
Sep 04 21:54:30.270293 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.270263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:30.277435 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.277418    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q9m5q\""
Sep 04 21:54:30.286080 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.286065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"
Sep 04 21:54:30.288441 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.288428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:30.290476 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.290453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63185afc-d764-488c-8d3e-ff86a5494b41-metrics-tls\") pod \"dns-default-kntzg\" (UID: \"63185afc-d764-488c-8d3e-ff86a5494b41\") " pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:30.297298 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.297173    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pzr7c\""
Sep 04 21:54:30.305994 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.305977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"
Sep 04 21:54:30.360981 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.360893    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9rf2q\""
Sep 04 21:54:30.368941 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.368909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:30.472072 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.472051    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hzgq\""
Sep 04 21:54:30.480704 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.480688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:30.566088 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.566059    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f87c87fc-m9qlm"]
Sep 04 21:54:30.569093 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:30.569031    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d30f914_a461_490e_ab74_c52677dbee40.slice/crio-0f6d93d15d752cb314ae50d9a2edb54110440a003de9dbb7cd459a60b9ae8a7e WatchSource:0}: Error finding container 0f6d93d15d752cb314ae50d9a2edb54110440a003de9dbb7cd459a60b9ae8a7e: Status 404 returned error can't find the container with id 0f6d93d15d752cb314ae50d9a2edb54110440a003de9dbb7cd459a60b9ae8a7e
Sep 04 21:54:30.588913 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.588796    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z"]
Sep 04 21:54:30.592075 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:30.592049    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7e5697_f59b_4970_a58e_6f9bcb4b9a92.slice/crio-b3a8bc682ce8e80847796941807d99a6d852f935d1dc8b459382b3fc85137f30 WatchSource:0}: Error finding container b3a8bc682ce8e80847796941807d99a6d852f935d1dc8b459382b3fc85137f30: Status 404 returned error can't find the container with id b3a8bc682ce8e80847796941807d99a6d852f935d1dc8b459382b3fc85137f30
Sep 04 21:54:30.616183 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.616133    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p"]
Sep 04 21:54:30.679544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.679459    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f6c8885b8-v8qbh"]
Sep 04 21:54:30.682246 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:30.682215    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7802a7ba_c4b5_49f2_9988_f4462937de53.slice/crio-32b64d14e8d792027112f2fbf9d69872b3debff3993a151a1b42e9a02c49ffb4 WatchSource:0}: Error finding container 32b64d14e8d792027112f2fbf9d69872b3debff3993a151a1b42e9a02c49ffb4: Status 404 returned error can't find the container with id 32b64d14e8d792027112f2fbf9d69872b3debff3993a151a1b42e9a02c49ffb4
Sep 04 21:54:30.778488 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:30.778465    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kntzg"]
Sep 04 21:54:30.783704 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:30.783668    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63185afc_d764_488c_8d3e_ff86a5494b41.slice/crio-45d2f6b7a78d9212e0dd80d03743efeceb99ad43dcf353e383ab7d787cdfb6fc WatchSource:0}: Error finding container 45d2f6b7a78d9212e0dd80d03743efeceb99ad43dcf353e383ab7d787cdfb6fc: Status 404 returned error can't find the container with id 45d2f6b7a78d9212e0dd80d03743efeceb99ad43dcf353e383ab7d787cdfb6fc
Sep 04 21:54:31.216444 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.216403    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z" event={"ID":"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92","Type":"ContainerStarted","Data":"b3a8bc682ce8e80847796941807d99a6d852f935d1dc8b459382b3fc85137f30"}
Sep 04 21:54:31.218105 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.218078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p" event={"ID":"d10170e3-9966-4245-87c0-a46550a09296","Type":"ContainerStarted","Data":"c18a7abe4995155f692c8dc32440aef3d5184d8f77c48ad12fd18a64ea625482"}
Sep 04 21:54:31.220973 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.220944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" event={"ID":"1d30f914-a461-490e-ab74-c52677dbee40","Type":"ContainerStarted","Data":"d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba"}
Sep 04 21:54:31.221071 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.221004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" event={"ID":"1d30f914-a461-490e-ab74-c52677dbee40","Type":"ContainerStarted","Data":"0f6d93d15d752cb314ae50d9a2edb54110440a003de9dbb7cd459a60b9ae8a7e"}
Sep 04 21:54:31.221287 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.221266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:31.222960 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.222932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kntzg" event={"ID":"63185afc-d764-488c-8d3e-ff86a5494b41","Type":"ContainerStarted","Data":"45d2f6b7a78d9212e0dd80d03743efeceb99ad43dcf353e383ab7d787cdfb6fc"}
Sep 04 21:54:31.225858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.225774    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh" event={"ID":"7802a7ba-c4b5-49f2-9988-f4462937de53","Type":"ContainerStarted","Data":"89370622d7d27ff156059e8a420ded293931e3d576d8e9572ddbaa1f4711591c"}
Sep 04 21:54:31.225858 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.225816    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh" event={"ID":"7802a7ba-c4b5-49f2-9988-f4462937de53","Type":"ContainerStarted","Data":"32b64d14e8d792027112f2fbf9d69872b3debff3993a151a1b42e9a02c49ffb4"}
Sep 04 21:54:31.243975 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.243918    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" podStartSLOduration=66.243899532 podStartE2EDuration="1m6.243899532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:31.242849731 +0000 UTC m=+68.014862741" watchObservedRunningTime="2026-09-04 21:54:31.243899532 +0000 UTC m=+68.015912544"
Sep 04 21:54:31.260555 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.260505    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bfglg" podStartSLOduration=67.260490447 podStartE2EDuration="1m7.260490447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:31.259421009 +0000 UTC m=+68.031434021" watchObservedRunningTime="2026-09-04 21:54:31.260490447 +0000 UTC m=+68.032503459"
Sep 04 21:54:31.284459 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.284408    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh" podStartSLOduration=64.284390695 podStartE2EDuration="1m4.284390695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:31.28423666 +0000 UTC m=+68.056249674" watchObservedRunningTime="2026-09-04 21:54:31.284390695 +0000 UTC m=+68.056403706"
Sep 04 21:54:31.370148 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.370069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:31.373388 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:31.373195    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:32.238859 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:32.238779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knwk6" event={"ID":"2e880518-4c71-4ae3-a31f-a0d584f72c0d","Type":"ContainerStarted","Data":"5232c7b5294f62ab4acb900555e352768ae99973ee5d671e124e5d4982c3859c"}
Sep 04 21:54:32.239852 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:32.239755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:32.241051 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:32.241023    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f6c8885b8-v8qbh"
Sep 04 21:54:33.115374 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.115337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:33.118062 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.118036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8529306-7f66-4db0-bf84-65530b4f0547-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9hkfv\" (UID: \"f8529306-7f66-4db0-bf84-65530b4f0547\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:33.245324 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.245288    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knwk6" event={"ID":"2e880518-4c71-4ae3-a31f-a0d584f72c0d","Type":"ContainerStarted","Data":"e9577223458e7acc0cba7f781218efe589c2ba3a73409904d05ef82ad30eae31"}
Sep 04 21:54:33.261084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.260946    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-knwk6" podStartSLOduration=67.369490396 podStartE2EDuration="1m9.260928057s" totalImagesPullingTime="1.891437661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:33.260758245 +0000 UTC m=+70.032771255" watchObservedRunningTime="2026-09-04 21:54:33.260928057 +0000 UTC m=+70.032941068"
Sep 04 21:54:33.317989 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.317965    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mxslr\""
Sep 04 21:54:33.325796 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.325780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv"
Sep 04 21:54:33.667071 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:33.667027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:34.802348 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.802312    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"]
Sep 04 21:54:34.823906 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.823874    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"]
Sep 04 21:54:34.824064 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.823998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:34.826630 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.826606    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 04 21:54:34.826765 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.826606    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 04 21:54:34.827483 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.827423    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 04 21:54:34.827583 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.827543    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rkk7q\""
Sep 04 21:54:34.834064 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.833575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 04 21:54:34.840511 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.840421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:34.840511 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.840442    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"]
Sep 04 21:54:34.843860 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.843841    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 04 21:54:34.856065 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.856047    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"]
Sep 04 21:54:34.856208 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.856191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"]
Sep 04 21:54:34.856316 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.856222    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"]
Sep 04 21:54:34.856316 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.856122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.859785 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.859767    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 04 21:54:34.860198 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.860163    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 04 21:54:34.860306 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.860290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 04 21:54:34.860552 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.860534    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 04 21:54:34.916572 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.916543    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f6fc74b6-wvp76"]
Sep 04 21:54:34.934472 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e19771-245d-4822-b74c-20b6946dfc44-additional-service-ca\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.934617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-tmp\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:34.934617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj4ht\" (UniqueName: \"kubernetes.io/projected/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-kube-api-access-bj4ht\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:34.934617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.934617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjpwf\" (UniqueName: \"kubernetes.io/projected/2114f36f-6232-48ea-9401-c499f96c8526-kube-api-access-pjpwf\") pod \"managed-serviceaccount-addon-agent-54f49b4598-skdwz\" (UID: \"2114f36f-6232-48ea-9401-c499f96c8526\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:34.934617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-ca\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.934617 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-klusterlet-config\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:34.934962 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.934962 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2114f36f-6232-48ea-9401-c499f96c8526-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54f49b4598-skdwz\" (UID: \"2114f36f-6232-48ea-9401-c499f96c8526\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:34.934962 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmsv9\" (UniqueName: \"kubernetes.io/projected/c5e19771-245d-4822-b74c-20b6946dfc44-kube-api-access-hmsv9\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.934962 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.934794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-hub\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:34.938004 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.937982    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-t7vpj"]
Sep 04 21:54:34.938149 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.938127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:34.941950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.941666    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l72hl\""
Sep 04 21:54:34.941950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.941882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 04 21:54:34.942180 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.942159    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 04 21:54:34.944374 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.944209    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 04 21:54:34.944374 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.944253    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 04 21:54:34.944539 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.944483    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 04 21:54:34.945975 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.945929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 04 21:54:34.946506 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.946488    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 04 21:54:34.954110 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.954085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-t7vpj"]
Sep 04 21:54:34.954223 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.954138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6fc74b6-wvp76"]
Sep 04 21:54:34.954279 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.954230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:34.954970 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.954952    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 04 21:54:34.958150 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:34.958017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pxzhn\""
Sep 04 21:54:35.004143 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.004103    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:35.035550 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e19771-245d-4822-b74c-20b6946dfc44-additional-service-ca\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.035550 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-tmp\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.035820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-service-ca\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.035820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj4ht\" (UniqueName: \"kubernetes.io/projected/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-kube-api-access-bj4ht\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.035820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.035820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-console-config\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.035820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjpwf\" (UniqueName: \"kubernetes.io/projected/2114f36f-6232-48ea-9401-c499f96c8526-kube-api-access-pjpwf\") pod \"managed-serviceaccount-addon-agent-54f49b4598-skdwz\" (UID: \"2114f36f-6232-48ea-9401-c499f96c8526\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:35.035820 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-ca\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-oauth-config\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-klusterlet-config\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-serving-cert\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-trusted-ca-bundle\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.035976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-tmp\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2114f36f-6232-48ea-9401-c499f96c8526-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54f49b4598-skdwz\" (UID: \"2114f36f-6232-48ea-9401-c499f96c8526\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmsv9\" (UniqueName: \"kubernetes.io/projected/c5e19771-245d-4822-b74c-20b6946dfc44-kube-api-access-hmsv9\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.036123 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5jbh\" (UniqueName: \"kubernetes.io/projected/082d903d-8332-426d-aab5-2aeb71fd92b6-kube-api-access-f5jbh\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.036547 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghb44\" (UniqueName: \"kubernetes.io/projected/99d2eb09-b6bc-4752-95ed-fec54d0cadd8-kube-api-access-ghb44\") pod \"downloads-85d98c998f-t7vpj\" (UID: \"99d2eb09-b6bc-4752-95ed-fec54d0cadd8\") " pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:35.036547 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-hub\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.036547 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-oauth-serving-cert\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.036547 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.036309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e19771-245d-4822-b74c-20b6946dfc44-additional-service-ca\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.039055 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.039013    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-ca\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.039192 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.039168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.039255 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.039200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.039255 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.039176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c5e19771-245d-4822-b74c-20b6946dfc44-hub\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.039776 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.039752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-klusterlet-config\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.039889 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.039789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2114f36f-6232-48ea-9401-c499f96c8526-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54f49b4598-skdwz\" (UID: \"2114f36f-6232-48ea-9401-c499f96c8526\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:35.045527 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.045499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj4ht\" (UniqueName: \"kubernetes.io/projected/7ad7a39c-ed50-4dc5-ba85-182ab0a7e843-kube-api-access-bj4ht\") pod \"klusterlet-addon-workmgr-59758df95f-jmhrh\" (UID: \"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.046077 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.046051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjpwf\" (UniqueName: \"kubernetes.io/projected/2114f36f-6232-48ea-9401-c499f96c8526-kube-api-access-pjpwf\") pod \"managed-serviceaccount-addon-agent-54f49b4598-skdwz\" (UID: \"2114f36f-6232-48ea-9401-c499f96c8526\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:35.047211 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.047190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmsv9\" (UniqueName: \"kubernetes.io/projected/c5e19771-245d-4822-b74c-20b6946dfc44-kube-api-access-hmsv9\") pod \"cluster-proxy-proxy-agent-685f9cff48-j54ld\" (UID: \"c5e19771-245d-4822-b74c-20b6946dfc44\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.136832 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.136745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-serving-cert\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.136832 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.136793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-trusted-ca-bundle\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.137049 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.136841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jbh\" (UniqueName: \"kubernetes.io/projected/082d903d-8332-426d-aab5-2aeb71fd92b6-kube-api-access-f5jbh\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.137049 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.136865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghb44\" (UniqueName: \"kubernetes.io/projected/99d2eb09-b6bc-4752-95ed-fec54d0cadd8-kube-api-access-ghb44\") pod \"downloads-85d98c998f-t7vpj\" (UID: \"99d2eb09-b6bc-4752-95ed-fec54d0cadd8\") " pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:35.137049 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.137003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-oauth-serving-cert\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.137215 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.137191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-service-ca\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.137285 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.137236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-console-config\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.137285 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.137278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-oauth-config\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.137888 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.137859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-service-ca\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.138005 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.137868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-trusted-ca-bundle\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.138100 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.138073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-console-config\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.138205 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.138073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-oauth-serving-cert\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.139775 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.139754    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-serving-cert\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.139971 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.139947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-oauth-config\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.144741 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.144720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"
Sep 04 21:54:35.152948 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.152924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5jbh\" (UniqueName: \"kubernetes.io/projected/082d903d-8332-426d-aab5-2aeb71fd92b6-kube-api-access-f5jbh\") pod \"console-66f6fc74b6-wvp76\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") " pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.154612 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.154586    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghb44\" (UniqueName: \"kubernetes.io/projected/99d2eb09-b6bc-4752-95ed-fec54d0cadd8-kube-api-access-ghb44\") pod \"downloads-85d98c998f-t7vpj\" (UID: \"99d2eb09-b6bc-4752-95ed-fec54d0cadd8\") " pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:35.155169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.155152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:35.167236 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.166826    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"
Sep 04 21:54:35.189307 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.189277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:35.261249 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.261212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:35.267933 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.267906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:35.310145 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.310113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:35.408969 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.408890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:35.938117 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:35.938081    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:36.042186 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.042148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:36.198964 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.198916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:36.261580 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.261545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z" event={"ID":"5b7e5697-f59b-4970-a58e-6f9bcb4b9a92","Type":"ContainerStarted","Data":"1852145e8e24bbcbb3e9efa75a97ceb083acfd36114ee4dfcaf4ec910fbe3996"}
Sep 04 21:54:36.263573 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.263503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p" event={"ID":"d10170e3-9966-4245-87c0-a46550a09296","Type":"ContainerStarted","Data":"f5164f899f4e3aafe126d7f2c7c4d5239aae9cfc633cdbf8872b897ce350ff47"}
Sep 04 21:54:36.265465 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.265140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kntzg" event={"ID":"63185afc-d764-488c-8d3e-ff86a5494b41","Type":"ContainerStarted","Data":"9a2c4a2d2829b575846cd94ca87d40088dd5924add8bf82c8d37cf4528c06f78"}
Sep 04 21:54:36.293670 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.293520    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hs27z" podStartSLOduration=63.877742696 podStartE2EDuration="1m9.293499894s" totalImagesPullingTime="5.415757198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:36.29343223 +0000 UTC m=+73.065445242" watchObservedRunningTime="2026-09-04 21:54:36.293499894 +0000 UTC m=+73.065512904"
Sep 04 21:54:36.320861 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.320775    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz"]
Sep 04 21:54:36.322692 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.322621    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6fc74b6-wvp76"]
Sep 04 21:54:36.323363 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.323308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:36.329451 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.328461    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-t7vpj"]
Sep 04 21:54:36.334712 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.334292    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld"]
Sep 04 21:54:36.346025 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.345967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"]
Sep 04 21:54:36.361814 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.359507    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-9hkfv"]
Sep 04 21:54:36.583556 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.583504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:36.664557 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.664527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:36.796749 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:36.796716    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:37.279850 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.279811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-t7vpj" event={"ID":"99d2eb09-b6bc-4752-95ed-fec54d0cadd8","Type":"ContainerStarted","Data":"6c87f73ec98b543cae07309215c86af45d71d8074a910e736b568d234e250f00"}
Sep 04 21:54:37.286335 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.285851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld" event={"ID":"c5e19771-245d-4822-b74c-20b6946dfc44","Type":"ContainerStarted","Data":"56fc3f090a721e8c5e66beb770faa3e7475ee26862a233c927705b634e11c2df"}
Sep 04 21:54:37.290823 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.290746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvvh2" event={"ID":"db1ee4f6-293f-4063-9cb4-acdedfc96fa7","Type":"ContainerStarted","Data":"3b666c87870b35818321fac757d97fa938d91343a403ac58bfcab4d4b0a29ed2"}
Sep 04 21:54:37.293420 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.293361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6fc74b6-wvp76" event={"ID":"082d903d-8332-426d-aab5-2aeb71fd92b6","Type":"ContainerStarted","Data":"849c55bca619963c9871d433f14fac3149490b4f89d7ebb6597635646a2d8b41"}
Sep 04 21:54:37.298309 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.298284    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p" event={"ID":"d10170e3-9966-4245-87c0-a46550a09296","Type":"ContainerStarted","Data":"7921cabfbbe870c253a5d2751011c0e6b858feafe3d79fdd88c2d3231b7780b2"}
Sep 04 21:54:37.300315 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.300290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv" event={"ID":"f8529306-7f66-4db0-bf84-65530b4f0547","Type":"ContainerStarted","Data":"f56b6f8ff6523872e8ce8424b757a451868c4b391bc344728da7365125787ebf"}
Sep 04 21:54:37.302118 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.302091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh" event={"ID":"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843","Type":"ContainerStarted","Data":"36afff3dc60c54ef3913ee20e8cf5a2122e52276a02940d23ecc6b47e23cc39e"}
Sep 04 21:54:37.307994 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.306656    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dvvh2" podStartSLOduration=66.874828671 podStartE2EDuration="1m13.306623271s" totalImagesPullingTime="6.4317946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 21:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:37.305092545 +0000 UTC m=+74.077105556" watchObservedRunningTime="2026-09-04 21:54:37.306623271 +0000 UTC m=+74.078636284"
Sep 04 21:54:37.309845 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.308479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kntzg" event={"ID":"63185afc-d764-488c-8d3e-ff86a5494b41","Type":"ContainerStarted","Data":"e9f8d41ee0af1138c53bd7cc8fd005b85e99a038bcc8f895126666131aa56c03"}
Sep 04 21:54:37.309845 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.309006    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:37.311513 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.311474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz" event={"ID":"2114f36f-6232-48ea-9401-c499f96c8526","Type":"ContainerStarted","Data":"6f2bcbc8e0d3324a2e21541c12e7555099835172c18630a89007f145e27f1e0e"}
Sep 04 21:54:37.344727 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.343466    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-b576p" podStartSLOduration=65.015639108 podStartE2EDuration="1m10.343450194s" totalImagesPullingTime="5.327811086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:37.324999966 +0000 UTC m=+74.097012980" watchObservedRunningTime="2026-09-04 21:54:37.343450194 +0000 UTC m=+74.115463202"
Sep 04 21:54:37.815533 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:37.815498    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:39.337040 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:39.336961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv" event={"ID":"f8529306-7f66-4db0-bf84-65530b4f0547","Type":"ContainerStarted","Data":"679d5c751272740f603e4abad949e7c2187e83cd315cd5d381eaffd3eb88cdde"}
Sep 04 21:54:39.354661 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:39.352516    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-9hkfv" podStartSLOduration=35.737086364 podStartE2EDuration="38.352496208s" totalImagesPullingTime="2.615409844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:39.351976079 +0000 UTC m=+76.123989090" watchObservedRunningTime="2026-09-04 21:54:39.352496208 +0000 UTC m=+76.124509218"
Sep 04 21:54:39.354661 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:39.352769    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kntzg" podStartSLOduration=36.127122727 podStartE2EDuration="41.352761732s" totalImagesPullingTime="5.225639005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:37.344435143 +0000 UTC m=+74.116448155" watchObservedRunningTime="2026-09-04 21:54:39.352761732 +0000 UTC m=+76.124774742"
Sep 04 21:54:39.484970 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:39.484809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:39.584547 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:39.584486    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:41.226556 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:41.226518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:54:42.085337 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:42.085235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:42.152616 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:42.152526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:43.789770 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:43.789734    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:43.892980 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:43.892944    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:44.224783 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:44.224630    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:44.815590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:44.815544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:44.917217 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:44.917184    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:45.472010 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:45.471970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:45.527080 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:45.527039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:45.656212 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:45.656125    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:45.757002 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:45.756916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:45.819874 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:45.819834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:46.379702 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.379165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6fc74b6-wvp76" event={"ID":"082d903d-8332-426d-aab5-2aeb71fd92b6","Type":"ContainerStarted","Data":"64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64"}
Sep 04 21:54:46.380924 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.380891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh" event={"ID":"7ad7a39c-ed50-4dc5-ba85-182ab0a7e843","Type":"ContainerStarted","Data":"e985a5ecf33137642076d517b272150bee8bb309e3b0d395216c9fb3ab41bffc"}
Sep 04 21:54:46.381061 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.381043    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:46.382748 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.382717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz" event={"ID":"2114f36f-6232-48ea-9401-c499f96c8526","Type":"ContainerStarted","Data":"d1f9b381224c7dfcebf163f6a04baa36cd37ba909a70e5062d9dd58b7d0e9c87"}
Sep 04 21:54:46.383213 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.383192    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh"
Sep 04 21:54:46.385238 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.385209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld" event={"ID":"c5e19771-245d-4822-b74c-20b6946dfc44","Type":"ContainerStarted","Data":"6f0f7899af5b34bfce1ef0e4c6412f8e78498ed98282ce303eebcaec139fa5da"}
Sep 04 21:54:46.385312 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.385250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld" event={"ID":"c5e19771-245d-4822-b74c-20b6946dfc44","Type":"ContainerStarted","Data":"851e6068bd6f3cf0d46ab94fab3f959b59674192aa3be6b7599403112b53a219"}
Sep 04 21:54:46.385312 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.385266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld" event={"ID":"c5e19771-245d-4822-b74c-20b6946dfc44","Type":"ContainerStarted","Data":"28b8ce1606482a268f5f5d55f593209015f24b492c753d3f756c9be34172547d"}
Sep 04 21:54:46.401547 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.401495    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f6fc74b6-wvp76" podStartSLOduration=2.819941066 podStartE2EDuration="12.401480766s" totalImagesPullingTime="9.5815397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:46.400225234 +0000 UTC m=+83.172238235" watchObservedRunningTime="2026-09-04 21:54:46.401480766 +0000 UTC m=+83.173493776"
Sep 04 21:54:46.417760 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.417712    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59758df95f-jmhrh" podStartSLOduration=2.845682543 podStartE2EDuration="12.417698538s" totalImagesPullingTime="9.572015995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:46.416053225 +0000 UTC m=+83.188066236" watchObservedRunningTime="2026-09-04 21:54:46.417698538 +0000 UTC m=+83.189711548"
Sep 04 21:54:46.436552 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.436514    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-685f9cff48-j54ld" podStartSLOduration=2.861306903 podStartE2EDuration="12.436495642s" totalImagesPullingTime="9.575188739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:46.436151667 +0000 UTC m=+83.208164677" watchObservedRunningTime="2026-09-04 21:54:46.436495642 +0000 UTC m=+83.208508652"
Sep 04 21:54:46.451669 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.451612    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54f49b4598-skdwz" podStartSLOduration=2.864020161 podStartE2EDuration="12.451601445s" totalImagesPullingTime="9.587581284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:46.451058096 +0000 UTC m=+83.223071107" watchObservedRunningTime="2026-09-04 21:54:46.451601445 +0000 UTC m=+83.223614455"
Sep 04 21:54:46.582090 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:46.582055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:47.948969 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:47.948926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.048152 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.048116    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.166278 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.166224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.237124 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.237006    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v5pmq"]
Sep 04 21:54:48.252247 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.252219    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.256084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.254903    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 04 21:54:48.256084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.255144    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 04 21:54:48.256084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.255406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 04 21:54:48.256084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.255727    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 04 21:54:48.256084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.255928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2cnfl\""
Sep 04 21:54:48.257786 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-sys\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.257786 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.257786 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-wtmp\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.257786 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-textfile\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.258066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5afad4f5-8523-4b19-9ecb-5e0b7210144c-metrics-client-ca\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.258066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.258066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-root\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.258066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8rr\" (UniqueName: \"kubernetes.io/projected/5afad4f5-8523-4b19-9ecb-5e0b7210144c-kube-api-access-qg8rr\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.258066 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.257941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.281519 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.281473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.340282 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.339961    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kntzg"
Sep 04 21:54:48.358457 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-textfile\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358593 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5afad4f5-8523-4b19-9ecb-5e0b7210144c-metrics-client-ca\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358715 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358794 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-root\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358794 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8rr\" (UniqueName: \"kubernetes.io/projected/5afad4f5-8523-4b19-9ecb-5e0b7210144c-kube-api-access-qg8rr\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358893 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358893 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-sys\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.358893 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.359291 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-wtmp\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.359291 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.358987    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-textfile\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.359291 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.359100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-wtmp\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.359291 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.359284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5afad4f5-8523-4b19-9ecb-5e0b7210144c-metrics-client-ca\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.359481 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.359302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-sys\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.359481 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:48.359360    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 04 21:54:48.359481 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:48.359400    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls podName:5afad4f5-8523-4b19-9ecb-5e0b7210144c nodeName:}" failed. No retries permitted until 2026-09-04 21:54:48.859388419 +0000 UTC m=+85.631401421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls") pod "node-exporter-v5pmq" (UID: "5afad4f5-8523-4b19-9ecb-5e0b7210144c") : secret "node-exporter-tls" not found
Sep 04 21:54:48.359623 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.359502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5afad4f5-8523-4b19-9ecb-5e0b7210144c-root\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.360444 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.360327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.363042 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.363014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.374351 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.374279    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.380291 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.380245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8rr\" (UniqueName: \"kubernetes.io/projected/5afad4f5-8523-4b19-9ecb-5e0b7210144c-kube-api-access-qg8rr\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.544545 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.544324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.647345 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.647303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.717438 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.717325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:48.863448 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.863042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:48.863448 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:48.863163    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 04 21:54:48.863448 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:54:48.863227    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls podName:5afad4f5-8523-4b19-9ecb-5e0b7210144c nodeName:}" failed. No retries permitted until 2026-09-04 21:54:49.863206984 +0000 UTC m=+86.635219989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls") pod "node-exporter-v5pmq" (UID: "5afad4f5-8523-4b19-9ecb-5e0b7210144c") : secret "node-exporter-tls" not found
Sep 04 21:54:48.967685 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:48.967588    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.197504 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.197376    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.279950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.279865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.399725 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.399674    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.532433 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.532400    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.636997 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.636965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.735938 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.735904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:49.870972 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.870892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:49.875881 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:49.873350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5afad4f5-8523-4b19-9ecb-5e0b7210144c-node-exporter-tls\") pod \"node-exporter-v5pmq\" (UID: \"5afad4f5-8523-4b19-9ecb-5e0b7210144c\") " pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:50.066254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:50.066222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5pmq"
Sep 04 21:54:50.276137 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:50.276101    2577 patch_prober.go:28] interesting pod/image-registry-78f87c87fc-m9qlm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 04 21:54:50.276318 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:50.276163    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" podUID="1d30f914-a461-490e-ab74-c52677dbee40" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 21:54:51.144045 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:51.143999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:51.276195 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:51.276110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:51.374092 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:51.374055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.086251 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.086211    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.181073 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.180994    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.244653 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.244611    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:54:52.400968 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.400872    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.498058 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.498011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.558315 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.558271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.896614 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.896578    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:52.979991 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:52.979957    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:53.100101 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:53.100061    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:53.166154 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:53.166083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:54.422732 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:54.422694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:54.784470 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:54.784432    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:54.883537 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:54.883494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:55.261477 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.261443    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:55.261658 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.261548    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:55.267520 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.267496    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:55.432481 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.432444    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:54:55.760846 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.760812    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:55.863278 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.863243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:55.963832 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:55.963803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:56.034286 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:54:56.034259    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afad4f5_8523_4b19_9ecb_5e0b7210144c.slice/crio-78606a8e43cd9085d9bf287896a88d3b4152579a926035b1c59a6d7e92715c74 WatchSource:0}: Error finding container 78606a8e43cd9085d9bf287896a88d3b4152579a926035b1c59a6d7e92715c74: Status 404 returned error can't find the container with id 78606a8e43cd9085d9bf287896a88d3b4152579a926035b1c59a6d7e92715c74
Sep 04 21:54:56.181224 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:56.181158    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:56.433142 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:56.433112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5pmq" event={"ID":"5afad4f5-8523-4b19-9ecb-5e0b7210144c","Type":"ContainerStarted","Data":"78606a8e43cd9085d9bf287896a88d3b4152579a926035b1c59a6d7e92715c74"}
Sep 04 21:54:57.440464 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:57.440413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-t7vpj" event={"ID":"99d2eb09-b6bc-4752-95ed-fec54d0cadd8","Type":"ContainerStarted","Data":"1416555d665a22637db120c5e4eeb745fc7604d780cf15467b1e4a6a158a08bf"}
Sep 04 21:54:57.440967 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:57.440484    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:57.451024 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:57.450995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-t7vpj"
Sep 04 21:54:57.457334 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:57.457292    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-t7vpj" podStartSLOduration=3.403040373 podStartE2EDuration="23.457275449s" totalImagesPullingTime="20.054235076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:57.455722305 +0000 UTC m=+94.227735317" watchObservedRunningTime="2026-09-04 21:54:57.457275449 +0000 UTC m=+94.229288461"
Sep 04 21:54:57.476433 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:57.476398    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:57.532894 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:57.532864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:58.447625 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:58.447585    2577 generic.go:356] "Generic (PLEG): container finished" podID="5afad4f5-8523-4b19-9ecb-5e0b7210144c" containerID="63e2628316f3e06851eb45607b15c6e5daf84212c50ac7423c8a84f4467077a7" exitCode=0
Sep 04 21:54:58.448240 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:58.447689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5pmq" event={"ID":"5afad4f5-8523-4b19-9ecb-5e0b7210144c","Type":"ContainerDied","Data":"63e2628316f3e06851eb45607b15c6e5daf84212c50ac7423c8a84f4467077a7"}
Sep 04 21:54:58.627568 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:58.627540    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f87c87fc-m9qlm"]
Sep 04 21:54:58.706832 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:58.706744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:58.807697 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:58.807622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:59.455601 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:59.455559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5pmq" event={"ID":"5afad4f5-8523-4b19-9ecb-5e0b7210144c","Type":"ContainerStarted","Data":"55dca93049e041fd17836f41675c80660456940137a6257cf7e2ed32c95c5690"}
Sep 04 21:54:59.456042 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:59.455621    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5pmq" event={"ID":"5afad4f5-8523-4b19-9ecb-5e0b7210144c","Type":"ContainerStarted","Data":"a32888779c040020ea9877027f0beafcc73604ed0dd1115e78401540159d26af"}
Sep 04 21:54:59.479653 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:59.476785    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v5pmq" podStartSLOduration=9.929557941 podStartE2EDuration="11.476759122s" totalImagesPullingTime="1.466022669s" totalInitContainerRuntime="81.178512ms" isStatefulPod=true podCreationTimestamp="2026-09-04 21:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:54:59.473654873 +0000 UTC m=+96.245667882" watchObservedRunningTime="2026-09-04 21:54:59.476759122 +0000 UTC m=+96.248772133"
Sep 04 21:54:59.652888 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:59.652845    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:54:59.713095 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:54:59.713018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:01.229406 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:01.229373    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bfglg"
Sep 04 21:55:02.148235 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:02.148194    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:02.300775 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:02.300739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:05.921161 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:05.921109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:06.021331 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:06.021299    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:06.479041 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:06.479003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:06.576942 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:06.576912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:08.661022 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:08.660987    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:08.761648 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:08.761612    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:10.807203 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:10.807167    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6fc74b6-wvp76"]
Sep 04 21:55:10.941775 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:10.941745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:11.064080 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:11.064009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:11.121615 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:11.121589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:17.540249 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:17.540215    2577 generic.go:356] "Generic (PLEG): container finished" podID="3db4739a-47e2-47ea-8e10-b68b9e58c8d8" containerID="2267457f83f992c71f060c4e7eb645f0e8571f0cea4e9bac7fbfc5c65ada3f4b" exitCode=0
Sep 04 21:55:17.540742 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:17.540295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb" event={"ID":"3db4739a-47e2-47ea-8e10-b68b9e58c8d8","Type":"ContainerDied","Data":"2267457f83f992c71f060c4e7eb645f0e8571f0cea4e9bac7fbfc5c65ada3f4b"}
Sep 04 21:55:17.540742 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:17.540727    2577 scope.go:117] "RemoveContainer" containerID="2267457f83f992c71f060c4e7eb645f0e8571f0cea4e9bac7fbfc5c65ada3f4b"
Sep 04 21:55:18.547173 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:18.546536    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xkcpb" event={"ID":"3db4739a-47e2-47ea-8e10-b68b9e58c8d8","Type":"ContainerStarted","Data":"e801a55b6f8a1ea65dfbb81273413696254bed9d441d57f20ee9e26c35676732"}
Sep 04 21:55:19.552793 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:19.552755    2577 generic.go:356] "Generic (PLEG): container finished" podID="6bb671cf-5a76-465a-8bcb-9f815bf3a057" containerID="bf3e6895f9910acd7d0a443acd6ceb018b2dc6aae7afbc2ad23ac940c2e505df" exitCode=0
Sep 04 21:55:19.553272 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:19.552817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf" event={"ID":"6bb671cf-5a76-465a-8bcb-9f815bf3a057","Type":"ContainerDied","Data":"bf3e6895f9910acd7d0a443acd6ceb018b2dc6aae7afbc2ad23ac940c2e505df"}
Sep 04 21:55:19.553272 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:19.553168    2577 scope.go:117] "RemoveContainer" containerID="bf3e6895f9910acd7d0a443acd6ceb018b2dc6aae7afbc2ad23ac940c2e505df"
Sep 04 21:55:20.558821 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:20.558788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-fhgsf" event={"ID":"6bb671cf-5a76-465a-8bcb-9f815bf3a057","Type":"ContainerStarted","Data":"361f021b36f941662e6cb10e144eeed210a6bd70200cf99fd85a4f52760e0b83"}
Sep 04 21:55:20.926620 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:20.926543    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:21.001618 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:21.001592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:23.659728 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:23.659678    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" podUID="1d30f914-a461-490e-ab74-c52677dbee40" containerName="registry" containerID="cri-o://d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba" gracePeriod=30
Sep 04 21:55:23.935860 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:23.935802    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:55:24.045763 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045733    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-installation-pull-secrets\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.045892 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tcqr\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-kube-api-access-9tcqr\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.045892 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045819    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-bound-sa-token\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.045892 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045838    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-registry-certificates\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.045892 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045863    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-image-registry-private-configuration\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.046094 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.046094 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.045983    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-trusted-ca\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.046094 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.046007    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d30f914-a461-490e-ab74-c52677dbee40-ca-trust-extracted\") pod \"1d30f914-a461-490e-ab74-c52677dbee40\" (UID: \"1d30f914-a461-490e-ab74-c52677dbee40\") "
Sep 04 21:55:24.046446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.046388    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:55:24.046681 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.046611    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:55:24.048112 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.048082    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:55:24.048473 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.048445    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 21:55:24.048558 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.048522    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 21:55:24.048620 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.048579    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:55:24.048620 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.048602    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-kube-api-access-9tcqr" (OuterVolumeSpecName: "kube-api-access-9tcqr") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "kube-api-access-9tcqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 21:55:24.054482 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.054460    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d30f914-a461-490e-ab74-c52677dbee40-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1d30f914-a461-490e-ab74-c52677dbee40" (UID: "1d30f914-a461-490e-ab74-c52677dbee40"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 21:55:24.147301 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147277    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-registry-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147301 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147299    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-trusted-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147425 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147309    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d30f914-a461-490e-ab74-c52677dbee40-ca-trust-extracted\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147425 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147318    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-installation-pull-secrets\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147425 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147341    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tcqr\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-kube-api-access-9tcqr\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147425 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147349    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d30f914-a461-490e-ab74-c52677dbee40-bound-sa-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147425 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147358    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d30f914-a461-490e-ab74-c52677dbee40-registry-certificates\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.147425 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.147366    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d30f914-a461-490e-ab74-c52677dbee40-image-registry-private-configuration\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:24.576251 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.576221    2577 generic.go:356] "Generic (PLEG): container finished" podID="1d30f914-a461-490e-ab74-c52677dbee40" containerID="d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba" exitCode=0
Sep 04 21:55:24.576432 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.576275    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm"
Sep 04 21:55:24.576432 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.576308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" event={"ID":"1d30f914-a461-490e-ab74-c52677dbee40","Type":"ContainerDied","Data":"d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba"}
Sep 04 21:55:24.576432 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.576359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f87c87fc-m9qlm" event={"ID":"1d30f914-a461-490e-ab74-c52677dbee40","Type":"ContainerDied","Data":"0f6d93d15d752cb314ae50d9a2edb54110440a003de9dbb7cd459a60b9ae8a7e"}
Sep 04 21:55:24.576432 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.576382    2577 scope.go:117] "RemoveContainer" containerID="d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba"
Sep 04 21:55:24.585250 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.585236    2577 scope.go:117] "RemoveContainer" containerID="d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba"
Sep 04 21:55:24.585499 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:55:24.585481    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba\": container with ID starting with d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba not found: ID does not exist" containerID="d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba"
Sep 04 21:55:24.585570 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.585507    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba"} err="failed to get container status \"d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba\": rpc error: code = NotFound desc = could not find container \"d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba\": container with ID starting with d9e35b31234364d66393408d1606e4dc70d35e2e84611af44ade3f6025b255ba not found: ID does not exist"
Sep 04 21:55:24.602181 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.602158    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f87c87fc-m9qlm"]
Sep 04 21:55:24.605877 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:24.605856    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78f87c87fc-m9qlm"]
Sep 04 21:55:25.850383 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:25.850346    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d30f914-a461-490e-ab74-c52677dbee40" path="/var/lib/kubelet/pods/1d30f914-a461-490e-ab74-c52677dbee40/volumes"
Sep 04 21:55:27.391171 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:27.391134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:27.453341 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:27.453313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:55:33.617391 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:33.617359    2577 generic.go:356] "Generic (PLEG): container finished" podID="bff74870-50dd-444a-9cf3-00135ed88165" containerID="1bf221acb2b24b8d5f07169db2405dfae0ada96d6e7ee6573a391dce3bbc48c3" exitCode=0
Sep 04 21:55:33.617819 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:33.617404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q" event={"ID":"bff74870-50dd-444a-9cf3-00135ed88165","Type":"ContainerDied","Data":"1bf221acb2b24b8d5f07169db2405dfae0ada96d6e7ee6573a391dce3bbc48c3"}
Sep 04 21:55:33.617819 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:33.617738    2577 scope.go:117] "RemoveContainer" containerID="1bf221acb2b24b8d5f07169db2405dfae0ada96d6e7ee6573a391dce3bbc48c3"
Sep 04 21:55:34.623825 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:34.623789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-8rx8q" event={"ID":"bff74870-50dd-444a-9cf3-00135ed88165","Type":"ContainerStarted","Data":"f44d470c89fae654a436a92a0bd777e3183b8fd8929b36aad8ea6407f06d08c5"}
Sep 04 21:55:35.827784 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:35.827739    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66f6fc74b6-wvp76" podUID="082d903d-8332-426d-aab5-2aeb71fd92b6" containerName="console" containerID="cri-o://64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64" gracePeriod=15
Sep 04 21:55:36.098888 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.098824    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:55:36.234341 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234311    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-serving-cert\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234341 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234342    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5jbh\" (UniqueName: \"kubernetes.io/projected/082d903d-8332-426d-aab5-2aeb71fd92b6-kube-api-access-f5jbh\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234622 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234377    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-console-config\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234622 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234505    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-trusted-ca-bundle\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234622 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-service-ca\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234622 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234580    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-oauth-config\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234622 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234615    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-oauth-serving-cert\") pod \"082d903d-8332-426d-aab5-2aeb71fd92b6\" (UID: \"082d903d-8332-426d-aab5-2aeb71fd92b6\") "
Sep 04 21:55:36.234917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234756    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-console-config" (OuterVolumeSpecName: "console-config") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:55:36.234917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234897    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:55:36.235024 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234926    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-console-config\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.235024 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.234942    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:55:36.235175 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.235147    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:55:36.236810 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.236780    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:55:36.236895 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.236814    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082d903d-8332-426d-aab5-2aeb71fd92b6-kube-api-access-f5jbh" (OuterVolumeSpecName: "kube-api-access-f5jbh") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "kube-api-access-f5jbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 21:55:36.236895 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.236874    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "082d903d-8332-426d-aab5-2aeb71fd92b6" (UID: "082d903d-8332-426d-aab5-2aeb71fd92b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:55:36.335901 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.335877    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-serving-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.335901 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.335897    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5jbh\" (UniqueName: \"kubernetes.io/projected/082d903d-8332-426d-aab5-2aeb71fd92b6-kube-api-access-f5jbh\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.336019 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.335907    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-trusted-ca-bundle\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.336019 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.335915    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.336019 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.335923    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/082d903d-8332-426d-aab5-2aeb71fd92b6-console-oauth-config\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.336019 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.335932    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/082d903d-8332-426d-aab5-2aeb71fd92b6-oauth-serving-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:55:36.633265 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.633234    2577 generic.go:356] "Generic (PLEG): container finished" podID="082d903d-8332-426d-aab5-2aeb71fd92b6" containerID="64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64" exitCode=0
Sep 04 21:55:36.633446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.633284    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6fc74b6-wvp76"
Sep 04 21:55:36.633446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.633323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6fc74b6-wvp76" event={"ID":"082d903d-8332-426d-aab5-2aeb71fd92b6","Type":"ContainerDied","Data":"64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64"}
Sep 04 21:55:36.633446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.633376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6fc74b6-wvp76" event={"ID":"082d903d-8332-426d-aab5-2aeb71fd92b6","Type":"ContainerDied","Data":"849c55bca619963c9871d433f14fac3149490b4f89d7ebb6597635646a2d8b41"}
Sep 04 21:55:36.633446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.633397    2577 scope.go:117] "RemoveContainer" containerID="64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64"
Sep 04 21:55:36.641841 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.641822    2577 scope.go:117] "RemoveContainer" containerID="64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64"
Sep 04 21:55:36.642103 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:55:36.642084    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64\": container with ID starting with 64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64 not found: ID does not exist" containerID="64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64"
Sep 04 21:55:36.642152 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.642111    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64"} err="failed to get container status \"64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64\": rpc error: code = NotFound desc = could not find container \"64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64\": container with ID starting with 64cecfdef612a501d790bba8d18d496282ad64dcda553454a6f430483dcd0c64 not found: ID does not exist"
Sep 04 21:55:36.652685 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.652663    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6fc74b6-wvp76"]
Sep 04 21:55:36.656944 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:36.656924    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f6fc74b6-wvp76"]
Sep 04 21:55:37.849697 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:55:37.849669    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082d903d-8332-426d-aab5-2aeb71fd92b6" path="/var/lib/kubelet/pods/082d903d-8332-426d-aab5-2aeb71fd92b6/volumes"
Sep 04 21:56:04.376898 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:04.376863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:04.479194 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:04.479158    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:16.144575 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:16.144488    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:16.217334 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:16.217303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:19.752546 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:19.752504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:19.813436 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:19.813400    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:20.007084 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:20.007009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:20.477793 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:20.477709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:20.941177 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:20.941146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:21.038352 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:21.038312    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:21.123755 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:21.123721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:25.160544 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:25.160510    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:30.192217 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:30.192178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:30.248711 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:30.248679    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:30.306759 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:30.306725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:37.322933 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:37.322889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:37.382204 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:37.382179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:58.622032 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:58.621998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:56:58.721285 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:56:58.721257    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:20.273650 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:20.273599    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:21.107852 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:21.107822    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:23.886264 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:23.886228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:23.990928 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:23.990890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:25.970613 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:25.970581    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:26.073400 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:26.073368    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:26.711689 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:26.711619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:26.895043 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:26.895009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:28.393446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:28.393408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:28.578740 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:28.578710    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:30.467881 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:30.467838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:30.568096 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:30.568067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:34.533308 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:34.533268    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:34.598370 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:34.598343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:35.792285 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:35.792246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:42.080126 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:42.080088    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:42.179818 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:42.179779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:49.177241 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:49.177163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:49.273816 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:49.273785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:57:50.970832 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:57:50.970802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:02.816964 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:02.816927    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:03.860296 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860265    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"]
Sep 04 21:58:03.860668 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860552    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d30f914-a461-490e-ab74-c52677dbee40" containerName="registry"
Sep 04 21:58:03.860668 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860564    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d30f914-a461-490e-ab74-c52677dbee40" containerName="registry"
Sep 04 21:58:03.860668 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860573    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="082d903d-8332-426d-aab5-2aeb71fd92b6" containerName="console"
Sep 04 21:58:03.860668 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860579    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="082d903d-8332-426d-aab5-2aeb71fd92b6" containerName="console"
Sep 04 21:58:03.860668 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860628    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="082d903d-8332-426d-aab5-2aeb71fd92b6" containerName="console"
Sep 04 21:58:03.860668 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.860650    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d30f914-a461-490e-ab74-c52677dbee40" containerName="registry"
Sep 04 21:58:03.862432 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.862416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:03.868149 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.868123    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 04 21:58:03.868149 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.868148    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 04 21:58:03.868329 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.868123    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 04 21:58:03.868329 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.868253    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 04 21:58:03.868606 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.868590    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jrmss\""
Sep 04 21:58:03.887369 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.887345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"]
Sep 04 21:58:03.967122 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.967094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2875c0a6-a410-4e1f-b499-367225ffd9e6-tmp\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:03.967239 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.967136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2875c0a6-a410-4e1f-b499-367225ffd9e6-manifests\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:03.967501 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.967156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2875c0a6-a410-4e1f-b499-367225ffd9e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:03.967590 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.967570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6ppn\" (UniqueName: \"kubernetes.io/projected/2875c0a6-a410-4e1f-b499-367225ffd9e6-kube-api-access-z6ppn\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:03.967687 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:03.967671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2875c0a6-a410-4e1f-b499-367225ffd9e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.068933 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.068898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6ppn\" (UniqueName: \"kubernetes.io/projected/2875c0a6-a410-4e1f-b499-367225ffd9e6-kube-api-access-z6ppn\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.069093 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.068947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2875c0a6-a410-4e1f-b499-367225ffd9e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.069093 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.068978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2875c0a6-a410-4e1f-b499-367225ffd9e6-tmp\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.069093 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.069025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2875c0a6-a410-4e1f-b499-367225ffd9e6-manifests\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.069093 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.069048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2875c0a6-a410-4e1f-b499-367225ffd9e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.069524 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.069491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2875c0a6-a410-4e1f-b499-367225ffd9e6-manifests\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.071616 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.071595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2875c0a6-a410-4e1f-b499-367225ffd9e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.071780 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.071755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2875c0a6-a410-4e1f-b499-367225ffd9e6-tmp\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.071942 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.071925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2875c0a6-a410-4e1f-b499-367225ffd9e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.076897 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.076876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6ppn\" (UniqueName: \"kubernetes.io/projected/2875c0a6-a410-4e1f-b499-367225ffd9e6-kube-api-access-z6ppn\") pod \"opendatahub-operator-controller-manager-764b98687b-dxlhg\" (UID: \"2875c0a6-a410-4e1f-b499-367225ffd9e6\") " pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.172800 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.172721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:04.299454 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.299416    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:04.398503 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.398465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:04.450910 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.450865    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"]
Sep 04 21:58:04.453293 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:58:04.453264    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2875c0a6_a410_4e1f_b499_367225ffd9e6.slice/crio-f5824f1048b11632de422e0277f5bd3ad4308beeb44006d9926ab16de52f1e9c WatchSource:0}: Error finding container f5824f1048b11632de422e0277f5bd3ad4308beeb44006d9926ab16de52f1e9c: Status 404 returned error can't find the container with id f5824f1048b11632de422e0277f5bd3ad4308beeb44006d9926ab16de52f1e9c
Sep 04 21:58:04.490825 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:04.490795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:05.203844 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:05.203765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg" event={"ID":"2875c0a6-a410-4e1f-b499-367225ffd9e6","Type":"ContainerStarted","Data":"f5824f1048b11632de422e0277f5bd3ad4308beeb44006d9926ab16de52f1e9c"}
Sep 04 21:58:08.218213 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:08.218180    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg" event={"ID":"2875c0a6-a410-4e1f-b499-367225ffd9e6","Type":"ContainerStarted","Data":"d057e8af753eea9d8e82b483c2c5246a040efc70a3562ae988558e3700562634"}
Sep 04 21:58:09.191187 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:09.191154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:09.228788 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:09.228756    2577 generic.go:356] "Generic (PLEG): container finished" podID="2875c0a6-a410-4e1f-b499-367225ffd9e6" containerID="d057e8af753eea9d8e82b483c2c5246a040efc70a3562ae988558e3700562634" exitCode=0
Sep 04 21:58:09.229201 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:09.228837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg" event={"ID":"2875c0a6-a410-4e1f-b499-367225ffd9e6","Type":"ContainerDied","Data":"d057e8af753eea9d8e82b483c2c5246a040efc70a3562ae988558e3700562634"}
Sep 04 21:58:09.268368 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:09.268336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:10.235482 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:10.235449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg" event={"ID":"2875c0a6-a410-4e1f-b499-367225ffd9e6","Type":"ContainerStarted","Data":"11c66bf88e3a00061be1e4e7fb020c70525ade2fcb7d220f596641d1413b1ce8"}
Sep 04 21:58:10.235936 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:10.235586    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:10.256409 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:10.256355    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg" podStartSLOduration=2.845526252 podStartE2EDuration="7.256334602s" totalImagesPullingTime="3.364481024s" totalInitContainerRuntime="1.046327326s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:58:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:58:10.255542037 +0000 UTC m=+287.027555046" watchObservedRunningTime="2026-09-04 21:58:10.256334602 +0000 UTC m=+287.028347614"
Sep 04 21:58:21.242446 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:21.242416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-764b98687b-dxlhg"
Sep 04 21:58:23.172596 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:23.172555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:23.292262 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:23.292227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:23.635732 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:23.635703    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 21:58:23.635934 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:23.635913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 21:58:23.645607 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:23.645588    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 04 21:58:27.566677 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:27.566617    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:27.626478 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:27.626442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:33.911411 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.911372    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:33.964917 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.964888    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"]
Sep 04 21:58:33.967531 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.967507    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:33.969672 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.969631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 04 21:58:33.969782 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.969711    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 04 21:58:33.987865 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.987841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"]
Sep 04 21:58:33.991188 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.991161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/578d2029-0fa5-4df3-9700-13c43b5c8514-tls-certs\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:33.991280 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.991210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/578d2029-0fa5-4df3-9700-13c43b5c8514-tmp\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:33.991343 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:33.991271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlm8p\" (UniqueName: \"kubernetes.io/projected/578d2029-0fa5-4df3-9700-13c43b5c8514-kube-api-access-rlm8p\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.092048 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.092022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/578d2029-0fa5-4df3-9700-13c43b5c8514-tls-certs\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.092149 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.092063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/578d2029-0fa5-4df3-9700-13c43b5c8514-tmp\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.092189 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:58:34.092149    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 04 21:58:34.092189 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.092173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlm8p\" (UniqueName: \"kubernetes.io/projected/578d2029-0fa5-4df3-9700-13c43b5c8514-kube-api-access-rlm8p\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.092271 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:58:34.092207    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578d2029-0fa5-4df3-9700-13c43b5c8514-tls-certs podName:578d2029-0fa5-4df3-9700-13c43b5c8514 nodeName:}" failed. No retries permitted until 2026-09-04 21:58:34.592191752 +0000 UTC m=+311.364204740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/578d2029-0fa5-4df3-9700-13c43b5c8514-tls-certs") pod "kube-auth-proxy-85db8bc976-rqrh9" (UID: "578d2029-0fa5-4df3-9700-13c43b5c8514") : secret "kube-auth-proxy-tls" not found
Sep 04 21:58:34.094245 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.094216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/578d2029-0fa5-4df3-9700-13c43b5c8514-tmp\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.105707 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.105681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlm8p\" (UniqueName: \"kubernetes.io/projected/578d2029-0fa5-4df3-9700-13c43b5c8514-kube-api-access-rlm8p\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.201761 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.201693    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-467nx"]
Sep 04 21:58:34.204327 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.204308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.207259 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.207241    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-26b7d\""
Sep 04 21:58:34.207351 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.207242    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 04 21:58:34.215532 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.215508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-467nx"]
Sep 04 21:58:34.235772 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.235745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:34.294301 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.294271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f5caba1-be57-4c2d-9927-cd9f38e312ab-cert\") pod \"odh-model-controller-7998c67dc4-467nx\" (UID: \"1f5caba1-be57-4c2d-9927-cd9f38e312ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.294488 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.294350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhz4\" (UniqueName: \"kubernetes.io/projected/1f5caba1-be57-4c2d-9927-cd9f38e312ab-kube-api-access-fqhz4\") pod \"odh-model-controller-7998c67dc4-467nx\" (UID: \"1f5caba1-be57-4c2d-9927-cd9f38e312ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.325624 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.325590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:34.395265 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.395235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f5caba1-be57-4c2d-9927-cd9f38e312ab-cert\") pod \"odh-model-controller-7998c67dc4-467nx\" (UID: \"1f5caba1-be57-4c2d-9927-cd9f38e312ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.395456 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.395321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhz4\" (UniqueName: \"kubernetes.io/projected/1f5caba1-be57-4c2d-9927-cd9f38e312ab-kube-api-access-fqhz4\") pod \"odh-model-controller-7998c67dc4-467nx\" (UID: \"1f5caba1-be57-4c2d-9927-cd9f38e312ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.398104 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.398068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f5caba1-be57-4c2d-9927-cd9f38e312ab-cert\") pod \"odh-model-controller-7998c67dc4-467nx\" (UID: \"1f5caba1-be57-4c2d-9927-cd9f38e312ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.403030 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.402999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhz4\" (UniqueName: \"kubernetes.io/projected/1f5caba1-be57-4c2d-9927-cd9f38e312ab-kube-api-access-fqhz4\") pod \"odh-model-controller-7998c67dc4-467nx\" (UID: \"1f5caba1-be57-4c2d-9927-cd9f38e312ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.427322 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.427285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:34.517312 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.517271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:34.597733 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.597656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/578d2029-0fa5-4df3-9700-13c43b5c8514-tls-certs\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.600003 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.599977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/578d2029-0fa5-4df3-9700-13c43b5c8514-tls-certs\") pod \"kube-auth-proxy-85db8bc976-rqrh9\" (UID: \"578d2029-0fa5-4df3-9700-13c43b5c8514\") " pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.792169 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.792140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-467nx"]
Sep 04 21:58:34.794914 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:58:34.794881    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5caba1_be57_4c2d_9927_cd9f38e312ab.slice/crio-3c5784fd3cc67d40801948c44061f5225e75feda681a09361ee4f85ea6830072 WatchSource:0}: Error finding container 3c5784fd3cc67d40801948c44061f5225e75feda681a09361ee4f85ea6830072: Status 404 returned error can't find the container with id 3c5784fd3cc67d40801948c44061f5225e75feda681a09361ee4f85ea6830072
Sep 04 21:58:34.796225 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.796206    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 21:58:34.876580 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.876548    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:34.877338 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.877319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"
Sep 04 21:58:34.967622 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.967591    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8fs79"]
Sep 04 21:58:34.970448 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.970427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:34.974207 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.974186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 04 21:58:34.974485 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.974465    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wwh2q\""
Sep 04 21:58:34.987158 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:34.987140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8fs79"]
Sep 04 21:58:35.000598 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.000573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/684bbab4-d316-4ea8-aabb-0438d6d33f2d-tls-certs\") pod \"model-serving-api-54d89bd5fc-8fs79\" (UID: \"684bbab4-d316-4ea8-aabb-0438d6d33f2d\") " pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.000699 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.000657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28l58\" (UniqueName: \"kubernetes.io/projected/684bbab4-d316-4ea8-aabb-0438d6d33f2d-kube-api-access-28l58\") pod \"model-serving-api-54d89bd5fc-8fs79\" (UID: \"684bbab4-d316-4ea8-aabb-0438d6d33f2d\") " pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.009227 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.009203    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:35.101336 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.101265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28l58\" (UniqueName: \"kubernetes.io/projected/684bbab4-d316-4ea8-aabb-0438d6d33f2d-kube-api-access-28l58\") pod \"model-serving-api-54d89bd5fc-8fs79\" (UID: \"684bbab4-d316-4ea8-aabb-0438d6d33f2d\") " pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.101336 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.101323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/684bbab4-d316-4ea8-aabb-0438d6d33f2d-tls-certs\") pod \"model-serving-api-54d89bd5fc-8fs79\" (UID: \"684bbab4-d316-4ea8-aabb-0438d6d33f2d\") " pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.104182 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.104159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/684bbab4-d316-4ea8-aabb-0438d6d33f2d-tls-certs\") pod \"model-serving-api-54d89bd5fc-8fs79\" (UID: \"684bbab4-d316-4ea8-aabb-0438d6d33f2d\") " pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.109937 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.109888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28l58\" (UniqueName: \"kubernetes.io/projected/684bbab4-d316-4ea8-aabb-0438d6d33f2d-kube-api-access-28l58\") pod \"model-serving-api-54d89bd5fc-8fs79\" (UID: \"684bbab4-d316-4ea8-aabb-0438d6d33f2d\") " pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.154778 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.154748    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9"]
Sep 04 21:58:35.155117 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:58:35.155094    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578d2029_0fa5_4df3_9700_13c43b5c8514.slice/crio-4cc6035d92411b9d0abb30fd782acfe21efc7ac33c74aaead37d0281f1651cbc WatchSource:0}: Error finding container 4cc6035d92411b9d0abb30fd782acfe21efc7ac33c74aaead37d0281f1651cbc: Status 404 returned error can't find the container with id 4cc6035d92411b9d0abb30fd782acfe21efc7ac33c74aaead37d0281f1651cbc
Sep 04 21:58:35.180755 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.180727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:35.185724 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.185701    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"]
Sep 04 21:58:35.189416 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.189395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.197377 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.197350    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 04 21:58:35.197491 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.197343    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 04 21:58:35.197491 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.197459    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 04 21:58:35.197593 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.197523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ccwvs\""
Sep 04 21:58:35.197593 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.197361    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 04 21:58:35.202430 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.202363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"]
Sep 04 21:58:35.280036 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.280006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:35.280188 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.280061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:35.302945 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.302921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.303062 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.302954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.303062 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.302981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26df712f-2953-4848-8a89-bc4244652e06-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.303138 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.303087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2dqk\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-kube-api-access-g2dqk\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.303138 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.303128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.303223 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.303205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.303264 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.303243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.348800 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.348767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9" event={"ID":"578d2029-0fa5-4df3-9700-13c43b5c8514","Type":"ContainerStarted","Data":"4cc6035d92411b9d0abb30fd782acfe21efc7ac33c74aaead37d0281f1651cbc"}
Sep 04 21:58:35.350030 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.349995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-467nx" event={"ID":"1f5caba1-be57-4c2d-9927-cd9f38e312ab","Type":"ContainerStarted","Data":"3c5784fd3cc67d40801948c44061f5225e75feda681a09361ee4f85ea6830072"}
Sep 04 21:58:35.403798 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.403719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.403798 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.403755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.403798 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.403789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.404074 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.404051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.404134 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.404108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26df712f-2953-4848-8a89-bc4244652e06-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.404190 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.404137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2dqk\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-kube-api-access-g2dqk\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.404190 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.404160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.404824 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.404761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.406483 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.406455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.406691 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.406671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.406772 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.406675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26df712f-2953-4848-8a89-bc4244652e06-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.406816 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.406782    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.411306 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.411282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2dqk\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-kube-api-access-g2dqk\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.411419 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.411402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vt6h5\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.509856 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.509822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:35.555902 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.555492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8fs79"]
Sep 04 21:58:35.801416 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:35.801302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"]
Sep 04 21:58:35.805211 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:58:35.805177    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26df712f_2953_4848_8a89_bc4244652e06.slice/crio-c918f59790f8e877e42ae56fc75147f22b9996a6e231a1378da43235af24b928 WatchSource:0}: Error finding container c918f59790f8e877e42ae56fc75147f22b9996a6e231a1378da43235af24b928: Status 404 returned error can't find the container with id c918f59790f8e877e42ae56fc75147f22b9996a6e231a1378da43235af24b928
Sep 04 21:58:36.229626 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:36.229516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:36.358762 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:36.358703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79" event={"ID":"684bbab4-d316-4ea8-aabb-0438d6d33f2d","Type":"ContainerStarted","Data":"a2f20d3c6385d5e685a7c70f264b0ecf5f9008a819ffda4a6f56deaa8b133a25"}
Sep 04 21:58:36.360496 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:36.360465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" event={"ID":"26df712f-2953-4848-8a89-bc4244652e06","Type":"ContainerStarted","Data":"c918f59790f8e877e42ae56fc75147f22b9996a6e231a1378da43235af24b928"}
Sep 04 21:58:38.163863 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:38.163828    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:41.532283 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:41.532233    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 21:58:41.532672 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:41.532376    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 21:58:42.395181 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.395142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9" event={"ID":"578d2029-0fa5-4df3-9700-13c43b5c8514","Type":"ContainerStarted","Data":"ad5b8d64ccad915b0e9aeaf9bac78710e1932b7ea5ee11ac160ed978ff66b231"}
Sep 04 21:58:42.396746 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.396717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-467nx" event={"ID":"1f5caba1-be57-4c2d-9927-cd9f38e312ab","Type":"ContainerStarted","Data":"f411fcef446cd8d5dee51d7bf18f6798a1fd88d224948ec91d5276bca4f1bc3c"}
Sep 04 21:58:42.396891 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.396868    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:42.398318 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.398292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79" event={"ID":"684bbab4-d316-4ea8-aabb-0438d6d33f2d","Type":"ContainerStarted","Data":"2a77dc87c53ff6a4b9660311b007c4c610a81f69aeea9d2db5a134340ace7179"}
Sep 04 21:58:42.398460 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.398396    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:58:42.399864 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.399844    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" event={"ID":"26df712f-2953-4848-8a89-bc4244652e06","Type":"ContainerStarted","Data":"9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b"}
Sep 04 21:58:42.399973 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.399958    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:42.401707 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.401685    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-vt6h5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 21:58:42.401789 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.401736    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" podUID="26df712f-2953-4848-8a89-bc4244652e06" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 21:58:42.414620 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.414582    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9" podStartSLOduration=3.033621387 podStartE2EDuration="9.414569581s" totalImagesPullingTime="6.380948194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:58:42.413044561 +0000 UTC m=+319.185057588" watchObservedRunningTime="2026-09-04 21:58:42.414569581 +0000 UTC m=+319.186582629"
Sep 04 21:58:42.437350 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.437300    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-467nx" podStartSLOduration=1.705377426 podStartE2EDuration="8.437284144s" totalImagesPullingTime="6.731906718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:58:42.435421108 +0000 UTC m=+319.207434109" watchObservedRunningTime="2026-09-04 21:58:42.437284144 +0000 UTC m=+319.209297155"
Sep 04 21:58:42.460743 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.459942    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79" podStartSLOduration=2.478902027 podStartE2EDuration="8.459926006s" totalImagesPullingTime="5.981023979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:58:42.458092098 +0000 UTC m=+319.230105109" watchObservedRunningTime="2026-09-04 21:58:42.459926006 +0000 UTC m=+319.231939016"
Sep 04 21:58:42.482868 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.482822    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" podStartSLOduration=1.7593352119999999 podStartE2EDuration="7.482804282s" totalImagesPullingTime="5.72346907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:58:42.482446791 +0000 UTC m=+319.254459799" watchObservedRunningTime="2026-09-04 21:58:42.482804282 +0000 UTC m=+319.254817293"
Sep 04 21:58:42.543195 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.543144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:42.711985 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.711897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:42.969138 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:42.969062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:43.177963 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:43.177916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:43.276610 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:43.276572    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:43.405873 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:43.405845    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:45.711907 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.711861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:45.764301 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.764270    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"]
Sep 04 21:58:45.768456 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.768434    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:45.772170 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.772147    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 04 21:58:45.772420 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.772385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qmjfr\""
Sep 04 21:58:45.789293 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.789269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"]
Sep 04 21:58:45.801423 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.801399    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:45.803801 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.803780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s66h2\" (UniqueName: \"kubernetes.io/projected/3a630392-dc86-4290-a0e6-de385a8387b5-kube-api-access-s66h2\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:45.803926 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.803903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a630392-dc86-4290-a0e6-de385a8387b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:45.876073 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.876033    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:45.904705 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.904677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a630392-dc86-4290-a0e6-de385a8387b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:45.904822 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.904787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s66h2\" (UniqueName: \"kubernetes.io/projected/3a630392-dc86-4290-a0e6-de385a8387b5-kube-api-access-s66h2\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:45.904822 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:58:45.904806    2577 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 04 21:58:45.904913 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:58:45.904868    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a630392-dc86-4290-a0e6-de385a8387b5-cert podName:3a630392-dc86-4290-a0e6-de385a8387b5 nodeName:}" failed. No retries permitted until 2026-09-04 21:58:46.404848495 +0000 UTC m=+323.176861499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a630392-dc86-4290-a0e6-de385a8387b5-cert") pod "kserve-controller-manager-d6f4b65b8-fggs5" (UID: "3a630392-dc86-4290-a0e6-de385a8387b5") : secret "kserve-webhook-server-cert" not found
Sep 04 21:58:45.914182 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:45.914153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s66h2\" (UniqueName: \"kubernetes.io/projected/3a630392-dc86-4290-a0e6-de385a8387b5-kube-api-access-s66h2\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:46.042886 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:46.042843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:46.417153 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:46.417034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a630392-dc86-4290-a0e6-de385a8387b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:46.419716 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:46.419685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a630392-dc86-4290-a0e6-de385a8387b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-fggs5\" (UID: \"3a630392-dc86-4290-a0e6-de385a8387b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:46.681270 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:46.681177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:46.978003 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:46.977793    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"]
Sep 04 21:58:46.984804 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:58:46.984769    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a630392_dc86_4290_a0e6_de385a8387b5.slice/crio-0624ae72168288445d0dc9086199229c8c4e65c498a30347f43193e0f724ad21 WatchSource:0}: Error finding container 0624ae72168288445d0dc9086199229c8c4e65c498a30347f43193e0f724ad21: Status 404 returned error can't find the container with id 0624ae72168288445d0dc9086199229c8c4e65c498a30347f43193e0f724ad21
Sep 04 21:58:46.997341 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:46.997312    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:47.097275 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:47.097243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:47.240227 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:47.240167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:47.426728 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:47.426702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5" event={"ID":"3a630392-dc86-4290-a0e6-de385a8387b5","Type":"ContainerStarted","Data":"0624ae72168288445d0dc9086199229c8c4e65c498a30347f43193e0f724ad21"}
Sep 04 21:58:48.801654 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:48.801615    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"]
Sep 04 21:58:48.802176 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:48.801832    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" podUID="26df712f-2953-4848-8a89-bc4244652e06" containerName="discovery" containerID="cri-o://9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b" gracePeriod=30
Sep 04 21:58:49.311463 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.311441    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:49.436726 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.436631    2577 generic.go:356] "Generic (PLEG): container finished" podID="26df712f-2953-4848-8a89-bc4244652e06" containerID="9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b" exitCode=0
Sep 04 21:58:49.436726 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.436702    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"
Sep 04 21:58:49.436726 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.436661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" event={"ID":"26df712f-2953-4848-8a89-bc4244652e06","Type":"ContainerDied","Data":"9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b"}
Sep 04 21:58:49.436950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.436762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5" event={"ID":"26df712f-2953-4848-8a89-bc4244652e06","Type":"ContainerDied","Data":"c918f59790f8e877e42ae56fc75147f22b9996a6e231a1378da43235af24b928"}
Sep 04 21:58:49.436950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.436796    2577 scope.go:117] "RemoveContainer" containerID="9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b"
Sep 04 21:58:49.438329 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.438310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5" event={"ID":"3a630392-dc86-4290-a0e6-de385a8387b5","Type":"ContainerStarted","Data":"7d17b1a5d8ff6145555051a44f9a60f1561138e6ce38113e6f658cb4b452ba1d"}
Sep 04 21:58:49.438418 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.438367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:58:49.444914 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.444895    2577 scope.go:117] "RemoveContainer" containerID="9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b"
Sep 04 21:58:49.445166 ip-10-0-128-61 kubenswrapper[2577]: E0904 21:58:49.445149    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b\": container with ID starting with 9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b not found: ID does not exist" containerID="9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b"
Sep 04 21:58:49.445214 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.445175    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b"} err="failed to get container status \"9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b\": rpc error: code = NotFound desc = could not find container \"9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b\": container with ID starting with 9e0ba252fadae0390bc5f6cb48f916f5a5ab5ee86b43992b25c4977d17b4b21b not found: ID does not exist"
Sep 04 21:58:49.450415 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450396    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-kubeconfig\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450505 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-dns-cert\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450505 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450468    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-ca-configmap\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450505 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450500    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-cacerts\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450680 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2dqk\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-kube-api-access-g2dqk\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450680 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450601    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-istio-token\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450798 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450631    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26df712f-2953-4848-8a89-bc4244652e06-local-certs\") pod \"26df712f-2953-4848-8a89-bc4244652e06\" (UID: \"26df712f-2953-4848-8a89-bc4244652e06\") "
Sep 04 21:58:49.450938 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.450906    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 21:58:49.451085 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.451060    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-ca-configmap\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.453007 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.452969    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26df712f-2953-4848-8a89-bc4244652e06-local-certs" (OuterVolumeSpecName: "local-certs") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 21:58:49.453099 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.453041    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-istio-token" (OuterVolumeSpecName: "istio-token") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 21:58:49.453099 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.453067    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-kube-api-access-g2dqk" (OuterVolumeSpecName: "kube-api-access-g2dqk") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "kube-api-access-g2dqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 21:58:49.453201 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.453135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:58:49.453201 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.453149    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:58:49.453265 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.453252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-cacerts" (OuterVolumeSpecName: "cacerts") pod "26df712f-2953-4848-8a89-bc4244652e06" (UID: "26df712f-2953-4848-8a89-bc4244652e06"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 21:58:49.459986 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.459950    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5" podStartSLOduration=2.216598256 podStartE2EDuration="4.459936204s" totalImagesPullingTime="2.243337948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:58:49.458285661 +0000 UTC m=+326.230298670" watchObservedRunningTime="2026-09-04 21:58:49.459936204 +0000 UTC m=+326.231949213"
Sep 04 21:58:49.552299 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.552275    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.552299 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.552295    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26df712f-2953-4848-8a89-bc4244652e06-local-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.552299 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.552304    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-kubeconfig\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.552458 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.552312    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-istio-csr-dns-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.552458 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.552320    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26df712f-2953-4848-8a89-bc4244652e06-cacerts\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.552458 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.552329    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2dqk\" (UniqueName: \"kubernetes.io/projected/26df712f-2953-4848-8a89-bc4244652e06-kube-api-access-g2dqk\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 21:58:49.759060 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.759034    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"]
Sep 04 21:58:49.762015 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.761990    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5"]
Sep 04 21:58:49.850950 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:49.850920    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26df712f-2953-4848-8a89-bc4244652e06" path="/var/lib/kubelet/pods/26df712f-2953-4848-8a89-bc4244652e06/volumes"
Sep 04 21:58:51.982943 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:51.982903    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:52.084001 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:52.083974    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:58:53.407629 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:53.407602    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-467nx"
Sep 04 21:58:53.412146 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:58:53.412116    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8fs79"
Sep 04 21:59:20.448354 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:20.448273    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fggs5"
Sep 04 21:59:35.350158 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:35.350121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:59:35.445756 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:35.445712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:59:54.942007 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.941968    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76957fc459-wh9bm"]
Sep 04 21:59:54.942555 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.942328    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26df712f-2953-4848-8a89-bc4244652e06" containerName="discovery"
Sep 04 21:59:54.942555 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.942340    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26df712f-2953-4848-8a89-bc4244652e06" containerName="discovery"
Sep 04 21:59:54.942555 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.942409    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26df712f-2953-4848-8a89-bc4244652e06" containerName="discovery"
Sep 04 21:59:54.945444 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.945423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:54.947733 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.947709    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 04 21:59:54.947865 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.947728    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 04 21:59:54.948254 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.948237    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 04 21:59:54.948363 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.948327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 04 21:59:54.948431 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.948408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l72hl\""
Sep 04 21:59:54.948520 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.948490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 04 21:59:54.953935 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.953591    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 04 21:59:54.957509 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.957485    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76957fc459-wh9bm"]
Sep 04 21:59:54.995195 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:54.995163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:59:55.049930 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.049888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 21:59:55.051882 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.051866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-trusted-ca-bundle\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.051949 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.051894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-oauth-config\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.051949 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.051921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-oauth-serving-cert\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.051949 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.051942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb4tm\" (UniqueName: \"kubernetes.io/projected/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-kube-api-access-nb4tm\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.052044 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.051987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-serving-cert\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.052044 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.052036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-config\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.052108 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.052073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-service-ca\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153196 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-oauth-config\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-oauth-serving-cert\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb4tm\" (UniqueName: \"kubernetes.io/projected/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-kube-api-access-nb4tm\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-serving-cert\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-config\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-service-ca\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153361 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-trusted-ca-bundle\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.153991 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.153965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-oauth-serving-cert\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.154104 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.154062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-config\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.154104 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.154079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-service-ca\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.154373 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.154327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-trusted-ca-bundle\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.155730 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.155705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-oauth-config\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.155932 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.155908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-console-serving-cert\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.162556 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.162535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb4tm\" (UniqueName: \"kubernetes.io/projected/76fbdcdd-0308-4d63-af2b-6bd2da7440e7-kube-api-access-nb4tm\") pod \"console-76957fc459-wh9bm\" (UID: \"76fbdcdd-0308-4d63-af2b-6bd2da7440e7\") " pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.257110 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.257080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 21:59:55.530165 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.530142    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76957fc459-wh9bm"]
Sep 04 21:59:55.532525 ip-10-0-128-61 kubenswrapper[2577]: W0904 21:59:55.532495    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fbdcdd_0308_4d63_af2b_6bd2da7440e7.slice/crio-1a9685ee4722f3ffb835e3912ef8fb43d6ed8a0be47b9a87ae8f3ff6030a483d WatchSource:0}: Error finding container 1a9685ee4722f3ffb835e3912ef8fb43d6ed8a0be47b9a87ae8f3ff6030a483d: Status 404 returned error can't find the container with id 1a9685ee4722f3ffb835e3912ef8fb43d6ed8a0be47b9a87ae8f3ff6030a483d
Sep 04 21:59:55.750223 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.750178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76957fc459-wh9bm" event={"ID":"76fbdcdd-0308-4d63-af2b-6bd2da7440e7","Type":"ContainerStarted","Data":"2faadb6b7c05211dfd9adf779789387dd4a4e20d9402a9d62c68bce57d6baa24"}
Sep 04 21:59:55.750428 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.750237    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76957fc459-wh9bm" event={"ID":"76fbdcdd-0308-4d63-af2b-6bd2da7440e7","Type":"ContainerStarted","Data":"1a9685ee4722f3ffb835e3912ef8fb43d6ed8a0be47b9a87ae8f3ff6030a483d"}
Sep 04 21:59:55.768674 ip-10-0-128-61 kubenswrapper[2577]: I0904 21:59:55.768610    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76957fc459-wh9bm" podStartSLOduration=1.768595162 podStartE2EDuration="1.768595162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 21:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 21:59:55.767091149 +0000 UTC m=+392.539104160" watchObservedRunningTime="2026-09-04 21:59:55.768595162 +0000 UTC m=+392.540608168"
Sep 04 22:00:05.257848 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:05.257816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 22:00:05.258233 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:05.257916    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 22:00:05.262699 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:05.262677    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 22:00:05.799085 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:05.799062    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76957fc459-wh9bm"
Sep 04 22:00:05.964172 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:05.964131    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:06.017819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:06.017791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:06.078238 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:06.078162    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:09.790789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:09.790751    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:11.617038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.617003    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"]
Sep 04 22:00:11.620555 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.620539    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:11.624120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.624097    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 04 22:00:11.624249 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.624146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fwj7w\""
Sep 04 22:00:11.624249 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.624185    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 04 22:00:11.624593 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.624577    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 04 22:00:11.633178 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.633155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"]
Sep 04 22:00:11.687857 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.687824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jxqf\" (UniqueName: \"kubernetes.io/projected/92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c-kube-api-access-8jxqf\") pod \"dns-operator-controller-manager-5985564776-k8pp9\" (UID: \"92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:11.788833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.788795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jxqf\" (UniqueName: \"kubernetes.io/projected/92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c-kube-api-access-8jxqf\") pod \"dns-operator-controller-manager-5985564776-k8pp9\" (UID: \"92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:11.802150 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.802118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jxqf\" (UniqueName: \"kubernetes.io/projected/92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c-kube-api-access-8jxqf\") pod \"dns-operator-controller-manager-5985564776-k8pp9\" (UID: \"92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:11.930940 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:11.930865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:12.181938 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:12.181854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:12.209838 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:12.209816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"]
Sep 04 22:00:12.212433 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:12.212411    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fe8ffe_a883_4e2e_a0ec_ebb9ec2cbc9c.slice/crio-74171aa29df4ab2b13811ceceecb9af2537ed8417bf39dd1f4cfc7e98e292f54 WatchSource:0}: Error finding container 74171aa29df4ab2b13811ceceecb9af2537ed8417bf39dd1f4cfc7e98e292f54: Status 404 returned error can't find the container with id 74171aa29df4ab2b13811ceceecb9af2537ed8417bf39dd1f4cfc7e98e292f54
Sep 04 22:00:12.586940 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:12.586907    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:12.826841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:12.826810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9" event={"ID":"92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c","Type":"ContainerStarted","Data":"74171aa29df4ab2b13811ceceecb9af2537ed8417bf39dd1f4cfc7e98e292f54"}
Sep 04 22:00:12.971520 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:12.971439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:13.848872 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:13.848837    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:15.713402 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:15.713361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:15.834378 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:15.834342    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:15.842548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:15.842513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9" event={"ID":"92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c","Type":"ContainerStarted","Data":"83c34e46b7028e4a4ffb56cf589576388a9cb72eafe0c61e6c216be8b4b234ce"}
Sep 04 22:00:15.842710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:15.842590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:15.872971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:15.872926    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9" podStartSLOduration=2.278311501 podStartE2EDuration="4.872911843s" totalImagesPullingTime="2.594600342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:15.870659544 +0000 UTC m=+412.642672555" watchObservedRunningTime="2026-09-04 22:00:15.872911843 +0000 UTC m=+412.644924853"
Sep 04 22:00:15.931141 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:15.931103    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:16.358799 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.358766    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"]
Sep 04 22:00:16.362250 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.362232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.364788 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.364761    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7dqjc\""
Sep 04 22:00:16.380577 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.380550    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"]
Sep 04 22:00:16.529593 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.529566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.529812 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.529625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc9tn\" (UniqueName: \"kubernetes.io/projected/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-kube-api-access-mc9tn\") pod \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.617335 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.617260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:16.630300 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.630274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc9tn\" (UniqueName: \"kubernetes.io/projected/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-kube-api-access-mc9tn\") pod \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.630396 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.630321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.630617 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.630602    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.639715 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.639691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc9tn\" (UniqueName: \"kubernetes.io/projected/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-kube-api-access-mc9tn\") pod \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.672481 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.672454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:16.953073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:16.953008    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"]
Sep 04 22:00:16.956144 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:16.956117    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b5d65f_ae96_4bd8_a0ab_7bff84edfc80.slice/crio-042e046e1bda14142c82902646c5e17cce612a30f6a874e7345c626000a306a1 WatchSource:0}: Error finding container 042e046e1bda14142c82902646c5e17cce612a30f6a874e7345c626000a306a1: Status 404 returned error can't find the container with id 042e046e1bda14142c82902646c5e17cce612a30f6a874e7345c626000a306a1
Sep 04 22:00:17.853225 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:17.853184    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz" event={"ID":"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80","Type":"ContainerStarted","Data":"042e046e1bda14142c82902646c5e17cce612a30f6a874e7345c626000a306a1"}
Sep 04 22:00:18.002563 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.002529    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"]
Sep 04 22:00:18.005516 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.005497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:18.008515 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.008490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pmkkt\""
Sep 04 22:00:18.022239 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.022218    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"]
Sep 04 22:00:18.144486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.144409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d2c\" (UniqueName: \"kubernetes.io/projected/3e7e2b1e-9785-46ca-8002-b5b6e43c9630-kube-api-access-l8d2c\") pod \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" (UID: \"3e7e2b1e-9785-46ca-8002-b5b6e43c9630\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:18.201026 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.200990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:18.245278 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.245245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d2c\" (UniqueName: \"kubernetes.io/projected/3e7e2b1e-9785-46ca-8002-b5b6e43c9630-kube-api-access-l8d2c\") pod \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" (UID: \"3e7e2b1e-9785-46ca-8002-b5b6e43c9630\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:18.256842 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.256816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d2c\" (UniqueName: \"kubernetes.io/projected/3e7e2b1e-9785-46ca-8002-b5b6e43c9630-kube-api-access-l8d2c\") pod \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" (UID: \"3e7e2b1e-9785-46ca-8002-b5b6e43c9630\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:18.316884 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.316856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:18.471150 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.471040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:18.604295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.604264    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"]
Sep 04 22:00:18.606507 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:18.606476    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7e2b1e_9785_46ca_8002_b5b6e43c9630.slice/crio-81dbcbec4a90fa9efb6d0ccde1b9839659d0d0380dd7f7ecbac2eea6cf57bb4f WatchSource:0}: Error finding container 81dbcbec4a90fa9efb6d0ccde1b9839659d0d0380dd7f7ecbac2eea6cf57bb4f: Status 404 returned error can't find the container with id 81dbcbec4a90fa9efb6d0ccde1b9839659d0d0380dd7f7ecbac2eea6cf57bb4f
Sep 04 22:00:18.612283 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.612241    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:18.859102 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:18.859065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x" event={"ID":"3e7e2b1e-9785-46ca-8002-b5b6e43c9630","Type":"ContainerStarted","Data":"81dbcbec4a90fa9efb6d0ccde1b9839659d0d0380dd7f7ecbac2eea6cf57bb4f"}
Sep 04 22:00:20.631357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.631237    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:20.750687 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.750631    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:20.760960 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.760927    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-kqll5"]
Sep 04 22:00:20.764579 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.764558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:20.772209 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.772187    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cgvmk\""
Sep 04 22:00:20.779470 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.779447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-kqll5"]
Sep 04 22:00:20.869957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.869929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltpk\" (UniqueName: \"kubernetes.io/projected/4197b7e5-2b49-412b-8c79-ea6f934ad91a-kube-api-access-dltpk\") pod \"authorino-operator-68d88948d8-kqll5\" (UID: \"4197b7e5-2b49-412b-8c79-ea6f934ad91a\") " pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:20.971262 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.971180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dltpk\" (UniqueName: \"kubernetes.io/projected/4197b7e5-2b49-412b-8c79-ea6f934ad91a-kube-api-access-dltpk\") pod \"authorino-operator-68d88948d8-kqll5\" (UID: \"4197b7e5-2b49-412b-8c79-ea6f934ad91a\") " pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:20.983750 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:20.983711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltpk\" (UniqueName: \"kubernetes.io/projected/4197b7e5-2b49-412b-8c79-ea6f934ad91a-kube-api-access-dltpk\") pod \"authorino-operator-68d88948d8-kqll5\" (UID: \"4197b7e5-2b49-412b-8c79-ea6f934ad91a\") " pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:21.077363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.077327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:21.790964 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.790937    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-kqll5"]
Sep 04 22:00:21.792665 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:21.792607    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4197b7e5_2b49_412b_8c79_ea6f934ad91a.slice/crio-e2b9691e4d96815eaecabae93724e9adc217cba7293b57a6471cbcc4c88d5839 WatchSource:0}: Error finding container e2b9691e4d96815eaecabae93724e9adc217cba7293b57a6471cbcc4c88d5839: Status 404 returned error can't find the container with id e2b9691e4d96815eaecabae93724e9adc217cba7293b57a6471cbcc4c88d5839
Sep 04 22:00:21.875699 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.875661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz" event={"ID":"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80","Type":"ContainerStarted","Data":"d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a"}
Sep 04 22:00:21.875885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.875856    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:21.877284 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.877263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x" event={"ID":"3e7e2b1e-9785-46ca-8002-b5b6e43c9630","Type":"ContainerStarted","Data":"0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948"}
Sep 04 22:00:21.877389 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.877310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:21.878541 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.878519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5" event={"ID":"4197b7e5-2b49-412b-8c79-ea6f934ad91a","Type":"ContainerStarted","Data":"e2b9691e4d96815eaecabae93724e9adc217cba7293b57a6471cbcc4c88d5839"}
Sep 04 22:00:21.897028 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.896989    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz" podStartSLOduration=1.328901015 podStartE2EDuration="5.896975497s" totalImagesPullingTime="4.568074482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:21.894886145 +0000 UTC m=+418.666899156" watchObservedRunningTime="2026-09-04 22:00:21.896975497 +0000 UTC m=+418.668988507"
Sep 04 22:00:21.916264 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:21.916222    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x" podStartSLOduration=2.010128799 podStartE2EDuration="4.916209024s" totalImagesPullingTime="2.906080225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:21.91460875 +0000 UTC m=+418.686621772" watchObservedRunningTime="2026-09-04 22:00:21.916209024 +0000 UTC m=+418.688222034"
Sep 04 22:00:22.181846 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:22.181777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:22.281709 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:22.281677    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:23.889521 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:23.889487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5" event={"ID":"4197b7e5-2b49-412b-8c79-ea6f934ad91a","Type":"ContainerStarted","Data":"443f92343b379b42a5d2321485e24f33af0a2fad585e398e2d6c2c760d42998e"}
Sep 04 22:00:23.889970 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:23.889548    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:23.908068 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:23.908026    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5" podStartSLOduration=2.34214134 podStartE2EDuration="3.908010745s" totalImagesPullingTime="1.565869405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:23.906589359 +0000 UTC m=+420.678602394" watchObservedRunningTime="2026-09-04 22:00:23.908010745 +0000 UTC m=+420.680023754"
Sep 04 22:00:24.284745 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.284701    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:24.288599 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.288573    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"]
Sep 04 22:00:24.299533 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.299507    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.300057 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.300034    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"]
Sep 04 22:00:24.301786 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.301768    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 04 22:00:24.302191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.302065    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 04 22:00:24.302191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.302105    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mlfpp\""
Sep 04 22:00:24.401022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.400997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a832b64a-a1de-4b3c-945b-a2d80e469e18-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.401144 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.401064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a832b64a-a1de-4b3c-945b-a2d80e469e18-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.401144 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.401090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z28j7\" (UniqueName: \"kubernetes.io/projected/a832b64a-a1de-4b3c-945b-a2d80e469e18-kube-api-access-z28j7\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.501823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.501800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a832b64a-a1de-4b3c-945b-a2d80e469e18-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.501968 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.501830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z28j7\" (UniqueName: \"kubernetes.io/projected/a832b64a-a1de-4b3c-945b-a2d80e469e18-kube-api-access-z28j7\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.501968 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.501869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a832b64a-a1de-4b3c-945b-a2d80e469e18-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.502603 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.502578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a832b64a-a1de-4b3c-945b-a2d80e469e18-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.504530 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.504508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a832b64a-a1de-4b3c-945b-a2d80e469e18-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.513175 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.513152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z28j7\" (UniqueName: \"kubernetes.io/projected/a832b64a-a1de-4b3c-945b-a2d80e469e18-kube-api-access-z28j7\") pod \"kuadrant-console-plugin-598f86468b-rlv5s\" (UID: \"a832b64a-a1de-4b3c-945b-a2d80e469e18\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.609487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.609401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"
Sep 04 22:00:24.657847 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.657551    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:24.754405 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.754368    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:24.879116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.879093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s"]
Sep 04 22:00:24.881148 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:24.881117    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda832b64a_a1de_4b3c_945b_a2d80e469e18.slice/crio-e34d2661f3bf906a6555ebcb47b62393eb319ed6ca0bb4961abeb74e6e54524b WatchSource:0}: Error finding container e34d2661f3bf906a6555ebcb47b62393eb319ed6ca0bb4961abeb74e6e54524b: Status 404 returned error can't find the container with id e34d2661f3bf906a6555ebcb47b62393eb319ed6ca0bb4961abeb74e6e54524b
Sep 04 22:00:24.896085 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:24.896053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s" event={"ID":"a832b64a-a1de-4b3c-945b-a2d80e469e18","Type":"ContainerStarted","Data":"e34d2661f3bf906a6555ebcb47b62393eb319ed6ca0bb4961abeb74e6e54524b"}
Sep 04 22:00:26.850253 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:26.850226    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-k8pp9"
Sep 04 22:00:26.980223 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:26.980174    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:27.081157 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:27.081119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:27.190731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:27.190600    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:27.343201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:27.343155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:28.210049 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:28.210013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:28.311928 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:28.311895    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:29.926239 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:29.926206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s" event={"ID":"a832b64a-a1de-4b3c-945b-a2d80e469e18","Type":"ContainerStarted","Data":"a9a12f7b64cc4f87cae2e1d257b66f847961c21e936e9af38114db2fcc698557"}
Sep 04 22:00:29.943999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:29.943922    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-rlv5s" podStartSLOduration=1.52210611 podStartE2EDuration="5.943904004s" totalImagesPullingTime="4.421797894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:29.943271573 +0000 UTC m=+426.715284582" watchObservedRunningTime="2026-09-04 22:00:29.943904004 +0000 UTC m=+426.715917012"
Sep 04 22:00:32.886292 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:32.886263    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:32.886730 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:32.886559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:33.919774 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:33.919738    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:34.048148 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:34.048113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:34.898654 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:34.898615    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-kqll5"
Sep 04 22:00:34.978560 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:34.978531    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"]
Sep 04 22:00:34.983313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:34.983290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:34.999628 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:34.999607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"]
Sep 04 22:00:35.090548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.090521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3e12-1a58-415d-b11e-b96617046582-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7ks72\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.090689 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.090554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhcl\" (UniqueName: \"kubernetes.io/projected/141e3e12-1a58-415d-b11e-b96617046582-kube-api-access-mlhcl\") pod \"kuadrant-operator-controller-manager-68cf589589-7ks72\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.168085 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.168025    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"]
Sep 04 22:00:35.168244 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.168215    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" containerName="manager" containerID="cri-o://d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a" gracePeriod=2
Sep 04 22:00:35.184283 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.184262    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"]
Sep 04 22:00:35.187909 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.187877    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-bvvxz\": pods \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.191350 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.191323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3e12-1a58-415d-b11e-b96617046582-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7ks72\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.191437 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.191365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhcl\" (UniqueName: \"kubernetes.io/projected/141e3e12-1a58-415d-b11e-b96617046582-kube-api-access-mlhcl\") pod \"kuadrant-operator-controller-manager-68cf589589-7ks72\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.191695 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.191676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3e12-1a58-415d-b11e-b96617046582-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7ks72\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.214624 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.214603    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"]
Sep 04 22:00:35.214891 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.214872    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mlhcl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72" podUID="141e3e12-1a58-415d-b11e-b96617046582"
Sep 04 22:00:35.216362 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.216336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhcl\" (UniqueName: \"kubernetes.io/projected/141e3e12-1a58-415d-b11e-b96617046582-kube-api-access-mlhcl\") pod \"kuadrant-operator-controller-manager-68cf589589-7ks72\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.234590 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.234561    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"]
Sep 04 22:00:35.234976 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.234960    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" containerName="manager"
Sep 04 22:00:35.235020 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.234978    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" containerName="manager"
Sep 04 22:00:35.235175 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.235066    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" containerName="manager"
Sep 04 22:00:35.238862 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.238839    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"]
Sep 04 22:00:35.238974 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.238941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.261659 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.261613    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"]
Sep 04 22:00:35.263735 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.263715    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"]
Sep 04 22:00:35.263916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.263895    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" containerName="manager" containerID="cri-o://0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948" gracePeriod=2
Sep 04 22:00:35.278693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.278671    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"]
Sep 04 22:00:35.282609 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.282591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.287099 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.287079    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"]
Sep 04 22:00:35.292517 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.292496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k7lg\" (UniqueName: \"kubernetes.io/projected/9c121b42-45df-4f3e-81e2-c8641a032647-kube-api-access-2k7lg\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8r4j\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.292605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.292528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c121b42-45df-4f3e-81e2-c8641a032647-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8r4j\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.292605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.292566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6ls\" (UniqueName: \"kubernetes.io/projected/7252c102-30ac-4f44-8555-f286c1d58416-kube-api-access-7v6ls\") pod \"kuadrant-operator-controller-manager-68cf589589-xfmqh\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.292706 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.292628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7252c102-30ac-4f44-8555-f286c1d58416-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xfmqh\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.303894 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.303875    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"]
Sep 04 22:00:35.304220 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.304209    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" containerName="manager"
Sep 04 22:00:35.304262 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.304222    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" containerName="manager"
Sep 04 22:00:35.304307 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.304298    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" containerName="manager"
Sep 04 22:00:35.307220 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.307204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:35.327474 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.327450    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.329975 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.329937    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.331036 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.331003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"]
Sep 04 22:00:35.331835 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.331796    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:35.347649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.347616    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"]
Sep 04 22:00:35.347901 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.347883    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-7v6ls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh" podUID="7252c102-30ac-4f44-8555-f286c1d58416"
Sep 04 22:00:35.357739 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.357717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"]
Sep 04 22:00:35.393036 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393008    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"]
Sep 04 22:00:35.393361 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6ls\" (UniqueName: \"kubernetes.io/projected/7252c102-30ac-4f44-8555-f286c1d58416-kube-api-access-7v6ls\") pod \"kuadrant-operator-controller-manager-68cf589589-xfmqh\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.393505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7252c102-30ac-4f44-8555-f286c1d58416-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xfmqh\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.393505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qcs\" (UniqueName: \"kubernetes.io/projected/a8afae98-1d24-4d64-900d-47f594dc2be3-kube-api-access-m9qcs\") pod \"limitador-operator-controller-manager-6c549b6d85-6xbzg\" (UID: \"a8afae98-1d24-4d64-900d-47f594dc2be3\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:35.393623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k7lg\" (UniqueName: \"kubernetes.io/projected/9c121b42-45df-4f3e-81e2-c8641a032647-kube-api-access-2k7lg\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8r4j\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.393623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c121b42-45df-4f3e-81e2-c8641a032647-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8r4j\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.393842 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.393800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7252c102-30ac-4f44-8555-f286c1d58416-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xfmqh\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.394100 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.394075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c121b42-45df-4f3e-81e2-c8641a032647-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8r4j\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.397716 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.397172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.414311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.414270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6ls\" (UniqueName: \"kubernetes.io/projected/7252c102-30ac-4f44-8555-f286c1d58416-kube-api-access-7v6ls\") pod \"kuadrant-operator-controller-manager-68cf589589-xfmqh\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.415230 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.415212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k7lg\" (UniqueName: \"kubernetes.io/projected/9c121b42-45df-4f3e-81e2-c8641a032647-kube-api-access-2k7lg\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8r4j\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.423222 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.423163    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"]
Sep 04 22:00:35.452729 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.452518    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.483717 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.483688    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:35.494217 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.494189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5fkgv\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.494345 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.494324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwdtv\" (UniqueName: \"kubernetes.io/projected/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-kube-api-access-bwdtv\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5fkgv\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.494408 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.494372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qcs\" (UniqueName: \"kubernetes.io/projected/a8afae98-1d24-4d64-900d-47f594dc2be3-kube-api-access-m9qcs\") pod \"limitador-operator-controller-manager-6c549b6d85-6xbzg\" (UID: \"a8afae98-1d24-4d64-900d-47f594dc2be3\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:35.498246 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.498222    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.500321 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.500297    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:35.501955 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.501930    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.505424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.505406    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:35.507108 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.507088    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bvvxz\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.507706 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.507686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qcs\" (UniqueName: \"kubernetes.io/projected/a8afae98-1d24-4d64-900d-47f594dc2be3-kube-api-access-m9qcs\") pod \"limitador-operator-controller-manager-6c549b6d85-6xbzg\" (UID: \"a8afae98-1d24-4d64-900d-47f594dc2be3\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:35.508744 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.508724    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-gwh5x\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:35.561793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.561770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.594825 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.594799    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-extensions-socket-volume\") pod \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") "
Sep 04 22:00:35.594978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.594849    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8d2c\" (UniqueName: \"kubernetes.io/projected/3e7e2b1e-9785-46ca-8002-b5b6e43c9630-kube-api-access-l8d2c\") pod \"3e7e2b1e-9785-46ca-8002-b5b6e43c9630\" (UID: \"3e7e2b1e-9785-46ca-8002-b5b6e43c9630\") "
Sep 04 22:00:35.594978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.594875    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc9tn\" (UniqueName: \"kubernetes.io/projected/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-kube-api-access-mc9tn\") pod \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\" (UID: \"15b5d65f-ae96-4bd8-a0ab-7bff84edfc80\") "
Sep 04 22:00:35.594978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.594969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5fkgv\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.595148 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.595056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwdtv\" (UniqueName: \"kubernetes.io/projected/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-kube-api-access-bwdtv\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5fkgv\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.595270 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.595235    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" (UID: "15b5d65f-ae96-4bd8-a0ab-7bff84edfc80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:00:35.595424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.595398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5fkgv\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.597140 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.597097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-kube-api-access-mc9tn" (OuterVolumeSpecName: "kube-api-access-mc9tn") pod "15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" (UID: "15b5d65f-ae96-4bd8-a0ab-7bff84edfc80"). InnerVolumeSpecName "kube-api-access-mc9tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:00:35.597301 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.597277    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7e2b1e-9785-46ca-8002-b5b6e43c9630-kube-api-access-l8d2c" (OuterVolumeSpecName: "kube-api-access-l8d2c") pod "3e7e2b1e-9785-46ca-8002-b5b6e43c9630" (UID: "3e7e2b1e-9785-46ca-8002-b5b6e43c9630"). InnerVolumeSpecName "kube-api-access-l8d2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:00:35.606499 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.606474    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwdtv\" (UniqueName: \"kubernetes.io/projected/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-kube-api-access-bwdtv\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5fkgv\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.650853 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.650825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:35.696696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.696571    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-extensions-socket-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:35.696696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.696606    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8d2c\" (UniqueName: \"kubernetes.io/projected/3e7e2b1e-9785-46ca-8002-b5b6e43c9630-kube-api-access-l8d2c\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:35.696696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.696619    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc9tn\" (UniqueName: \"kubernetes.io/projected/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80-kube-api-access-mc9tn\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:35.710939 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.710915    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:35.851544 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.851513    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" path="/var/lib/kubelet/pods/15b5d65f-ae96-4bd8-a0ab-7bff84edfc80/volumes"
Sep 04 22:00:35.852216 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.851983    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" path="/var/lib/kubelet/pods/3e7e2b1e-9785-46ca-8002-b5b6e43c9630/volumes"
Sep 04 22:00:35.854112 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.854091    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"]
Sep 04 22:00:35.856174 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:35.856149    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c121b42_45df_4f3e_81e2_c8641a032647.slice/crio-22772a0822b655c151dbca6b3b7a1ee7517f3678a7686f17f69e65b8b4e3b08f WatchSource:0}: Error finding container 22772a0822b655c151dbca6b3b7a1ee7517f3678a7686f17f69e65b8b4e3b08f: Status 404 returned error can't find the container with id 22772a0822b655c151dbca6b3b7a1ee7517f3678a7686f17f69e65b8b4e3b08f
Sep 04 22:00:35.924235 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.924212    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"]
Sep 04 22:00:35.926088 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:35.926058    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8afae98_1d24_4d64_900d_47f594dc2be3.slice/crio-0c786fb92bef02b6ff4b0250a0e06a421aa69f8fc5606a550e961a9b37efbe80 WatchSource:0}: Error finding container 0c786fb92bef02b6ff4b0250a0e06a421aa69f8fc5606a550e961a9b37efbe80: Status 404 returned error can't find the container with id 0c786fb92bef02b6ff4b0250a0e06a421aa69f8fc5606a550e961a9b37efbe80
Sep 04 22:00:35.957831 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.957808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j" event={"ID":"9c121b42-45df-4f3e-81e2-c8641a032647","Type":"ContainerStarted","Data":"d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931"}
Sep 04 22:00:35.957943 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.957853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j" event={"ID":"9c121b42-45df-4f3e-81e2-c8641a032647","Type":"ContainerStarted","Data":"22772a0822b655c151dbca6b3b7a1ee7517f3678a7686f17f69e65b8b4e3b08f"}
Sep 04 22:00:35.958064 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.958039    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:35.959308 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.959285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg" event={"ID":"a8afae98-1d24-4d64-900d-47f594dc2be3","Type":"ContainerStarted","Data":"0c786fb92bef02b6ff4b0250a0e06a421aa69f8fc5606a550e961a9b37efbe80"}
Sep 04 22:00:35.960544 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.960524    2577 generic.go:356] "Generic (PLEG): container finished" podID="15b5d65f-ae96-4bd8-a0ab-7bff84edfc80" containerID="d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a" exitCode=0
Sep 04 22:00:35.960632 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.960572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bvvxz"
Sep 04 22:00:35.960632 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.960615    2577 scope.go:117] "RemoveContainer" containerID="d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a"
Sep 04 22:00:35.962997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.962953    2577 generic.go:356] "Generic (PLEG): container finished" podID="3e7e2b1e-9785-46ca-8002-b5b6e43c9630" containerID="0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948" exitCode=0
Sep 04 22:00:35.963108 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.963011    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-gwh5x"
Sep 04 22:00:35.963108 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.963094    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.963212 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.963125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.970359 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.970345    2577 scope.go:117] "RemoveContainer" containerID="d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a"
Sep 04 22:00:35.970712 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.970622    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a\": container with ID starting with d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a not found: ID does not exist" containerID="d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a"
Sep 04 22:00:35.970793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.970746    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a"} err="failed to get container status \"d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a\": rpc error: code = NotFound desc = could not find container \"d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a\": container with ID starting with d62bf0be2afa07c960b1da637103ad5d8550856bb550702d3ea0e8264541ad1a not found: ID does not exist"
Sep 04 22:00:35.970793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.970773    2577 scope.go:117] "RemoveContainer" containerID="0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948"
Sep 04 22:00:35.979772 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.979751    2577 scope.go:117] "RemoveContainer" containerID="0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948"
Sep 04 22:00:35.980224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.979879    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.980224 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.980042    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948\": container with ID starting with 0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948 not found: ID does not exist" containerID="0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948"
Sep 04 22:00:35.980224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.980069    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948"} err="failed to get container status \"0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948\": rpc error: code = NotFound desc = could not find container \"0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948\": container with ID starting with 0ed8935dfca142c51279b8170b06685ebd27439a1967f78be388832b29671948 not found: ID does not exist"
Sep 04 22:00:35.981226 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.981177    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j" podStartSLOduration=0.981162502 podStartE2EDuration="981.162502ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:35.980380387 +0000 UTC m=+432.752393400" watchObservedRunningTime="2026-09-04 22:00:35.981162502 +0000 UTC m=+432.753175514"
Sep 04 22:00:35.982203 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:35.982175    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-7ks72\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="141e3e12-1a58-415d-b11e-b96617046582" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:35.983707 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.983688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:35.994820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.994700    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"]
Sep 04 22:00:35.997477 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:00:35.997456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfe86b8_4dda_44ce_9daa_49aad673c3a3.slice/crio-4785a860112fa8a52e777de2a9b9b1e112efba11e7f411e9fb402bd6b16c642b WatchSource:0}: Error finding container 4785a860112fa8a52e777de2a9b9b1e112efba11e7f411e9fb402bd6b16c642b: Status 404 returned error can't find the container with id 4785a860112fa8a52e777de2a9b9b1e112efba11e7f411e9fb402bd6b16c642b
Sep 04 22:00:35.998946 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.998927    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3e12-1a58-415d-b11e-b96617046582-extensions-socket-volume\") pod \"141e3e12-1a58-415d-b11e-b96617046582\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") "
Sep 04 22:00:35.999046 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.998992    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlhcl\" (UniqueName: \"kubernetes.io/projected/141e3e12-1a58-415d-b11e-b96617046582-kube-api-access-mlhcl\") pod \"141e3e12-1a58-415d-b11e-b96617046582\" (UID: \"141e3e12-1a58-415d-b11e-b96617046582\") "
Sep 04 22:00:35.999046 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.999036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v6ls\" (UniqueName: \"kubernetes.io/projected/7252c102-30ac-4f44-8555-f286c1d58416-kube-api-access-7v6ls\") pod \"7252c102-30ac-4f44-8555-f286c1d58416\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") "
Sep 04 22:00:35.999154 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.999060    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7252c102-30ac-4f44-8555-f286c1d58416-extensions-socket-volume\") pod \"7252c102-30ac-4f44-8555-f286c1d58416\" (UID: \"7252c102-30ac-4f44-8555-f286c1d58416\") "
Sep 04 22:00:35.999269 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.999189    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/141e3e12-1a58-415d-b11e-b96617046582-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "141e3e12-1a58-415d-b11e-b96617046582" (UID: "141e3e12-1a58-415d-b11e-b96617046582"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:00:35.999346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.999327    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3e12-1a58-415d-b11e-b96617046582-extensions-socket-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:35.999411 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:35.999330    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7252c102-30ac-4f44-8555-f286c1d58416-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7252c102-30ac-4f44-8555-f286c1d58416" (UID: "7252c102-30ac-4f44-8555-f286c1d58416"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:00:36.001505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.001480    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141e3e12-1a58-415d-b11e-b96617046582-kube-api-access-mlhcl" (OuterVolumeSpecName: "kube-api-access-mlhcl") pod "141e3e12-1a58-415d-b11e-b96617046582" (UID: "141e3e12-1a58-415d-b11e-b96617046582"). InnerVolumeSpecName "kube-api-access-mlhcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:00:36.001589 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.001526    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7252c102-30ac-4f44-8555-f286c1d58416-kube-api-access-7v6ls" (OuterVolumeSpecName: "kube-api-access-7v6ls") pod "7252c102-30ac-4f44-8555-f286c1d58416" (UID: "7252c102-30ac-4f44-8555-f286c1d58416"). InnerVolumeSpecName "kube-api-access-7v6ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:00:36.018339 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:36.018313    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-7ks72\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="141e3e12-1a58-415d-b11e-b96617046582" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:36.100681 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.100631    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlhcl\" (UniqueName: \"kubernetes.io/projected/141e3e12-1a58-415d-b11e-b96617046582-kube-api-access-mlhcl\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:36.100681 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.100679    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v6ls\" (UniqueName: \"kubernetes.io/projected/7252c102-30ac-4f44-8555-f286c1d58416-kube-api-access-7v6ls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:36.100864 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.100690    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7252c102-30ac-4f44-8555-f286c1d58416-extensions-socket-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:36.970275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.970241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg" event={"ID":"a8afae98-1d24-4d64-900d-47f594dc2be3","Type":"ContainerStarted","Data":"a6200bd897c74e152509f7728d2e700347f527903947b7c1e29b41c269e4adbf"}
Sep 04 22:00:36.970442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.970353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:36.972800 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.972773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"
Sep 04 22:00:36.972938 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.972797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv" event={"ID":"3bfe86b8-4dda-44ce-9daa-49aad673c3a3","Type":"ContainerStarted","Data":"5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a"}
Sep 04 22:00:36.972938 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.972835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv" event={"ID":"3bfe86b8-4dda-44ce-9daa-49aad673c3a3","Type":"ContainerStarted","Data":"4785a860112fa8a52e777de2a9b9b1e112efba11e7f411e9fb402bd6b16c642b"}
Sep 04 22:00:36.972938 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.972774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:36.972938 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:36.972886    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:36.975071 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:36.975041    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-7ks72\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="141e3e12-1a58-415d-b11e-b96617046582" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:37.006267 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:37.006227    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg" podStartSLOduration=2.006214352 podStartE2EDuration="2.006214352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:37.002577303 +0000 UTC m=+433.774590313" watchObservedRunningTime="2026-09-04 22:00:37.006214352 +0000 UTC m=+433.778227362"
Sep 04 22:00:37.055921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:37.055894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"]
Sep 04 22:00:37.064782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:37.064761    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xfmqh"]
Sep 04 22:00:37.116275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:37.116224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv" podStartSLOduration=2.116208185 podStartE2EDuration="2.116208185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:00:37.115486502 +0000 UTC m=+433.887499512" watchObservedRunningTime="2026-09-04 22:00:37.116208185 +0000 UTC m=+433.888221191"
Sep 04 22:00:37.117390 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:37.117364    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-7ks72\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="141e3e12-1a58-415d-b11e-b96617046582" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7ks72"
Sep 04 22:00:37.851079 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:37.851047    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141e3e12-1a58-415d-b11e-b96617046582" path="/var/lib/kubelet/pods/141e3e12-1a58-415d-b11e-b96617046582/volumes"
Sep 04 22:00:37.851308 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:37.851297    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7252c102-30ac-4f44-8555-f286c1d58416" path="/var/lib/kubelet/pods/7252c102-30ac-4f44-8555-f286c1d58416/volumes"
Sep 04 22:00:38.636214 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:38.636178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:38.729819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:38.729785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:41.248018 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:41.247980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:41.347420 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:41.347387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:46.624053 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:46.623971    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:46.679251 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:46.679222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:46.974968 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:46.974895    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:47.040541 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:47.040507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:47.141279 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:47.141246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:47.433431 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:47.433396    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:47.630228 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:47.630192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:47.979763 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:47.979729    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:00:47.979957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:47.979904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6xbzg"
Sep 04 22:00:48.037125 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.037093    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"]
Sep 04 22:00:48.037310 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.037284    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j" podUID="9c121b42-45df-4f3e-81e2-c8641a032647" containerName="manager" containerID="cri-o://d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931" gracePeriod=10
Sep 04 22:00:48.272200 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.272180    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:48.401427 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.401401    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c121b42-45df-4f3e-81e2-c8641a032647-extensions-socket-volume\") pod \"9c121b42-45df-4f3e-81e2-c8641a032647\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") "
Sep 04 22:00:48.401567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.401465    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k7lg\" (UniqueName: \"kubernetes.io/projected/9c121b42-45df-4f3e-81e2-c8641a032647-kube-api-access-2k7lg\") pod \"9c121b42-45df-4f3e-81e2-c8641a032647\" (UID: \"9c121b42-45df-4f3e-81e2-c8641a032647\") "
Sep 04 22:00:48.401796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.401769    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c121b42-45df-4f3e-81e2-c8641a032647-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c121b42-45df-4f3e-81e2-c8641a032647" (UID: "9c121b42-45df-4f3e-81e2-c8641a032647"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:00:48.403242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.403219    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c121b42-45df-4f3e-81e2-c8641a032647-kube-api-access-2k7lg" (OuterVolumeSpecName: "kube-api-access-2k7lg") pod "9c121b42-45df-4f3e-81e2-c8641a032647" (UID: "9c121b42-45df-4f3e-81e2-c8641a032647"). InnerVolumeSpecName "kube-api-access-2k7lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:00:48.502120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.502091    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k7lg\" (UniqueName: \"kubernetes.io/projected/9c121b42-45df-4f3e-81e2-c8641a032647-kube-api-access-2k7lg\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:48.502120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:48.502113    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c121b42-45df-4f3e-81e2-c8641a032647-extensions-socket-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:00:49.041818 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.041781    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c121b42-45df-4f3e-81e2-c8641a032647" containerID="d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931" exitCode=0
Sep 04 22:00:49.042219 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.041828    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"
Sep 04 22:00:49.042219 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.041872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j" event={"ID":"9c121b42-45df-4f3e-81e2-c8641a032647","Type":"ContainerDied","Data":"d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931"}
Sep 04 22:00:49.042219 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.041928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j" event={"ID":"9c121b42-45df-4f3e-81e2-c8641a032647","Type":"ContainerDied","Data":"22772a0822b655c151dbca6b3b7a1ee7517f3678a7686f17f69e65b8b4e3b08f"}
Sep 04 22:00:49.042219 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.041957    2577 scope.go:117] "RemoveContainer" containerID="d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931"
Sep 04 22:00:49.051183 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.051167    2577 scope.go:117] "RemoveContainer" containerID="d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931"
Sep 04 22:00:49.051422 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:00:49.051407    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931\": container with ID starting with d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931 not found: ID does not exist" containerID="d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931"
Sep 04 22:00:49.051463 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.051430    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931"} err="failed to get container status \"d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931\": rpc error: code = NotFound desc = could not find container \"d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931\": container with ID starting with d0dc9d7f1e85c2a59f8f5b312babb2cdfb9a32e20a39f4295f46023388a63931 not found: ID does not exist"
Sep 04 22:00:49.063344 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.063321    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"]
Sep 04 22:00:49.074449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.074428    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8r4j"]
Sep 04 22:00:49.851133 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:49.851099    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c121b42-45df-4f3e-81e2-c8641a032647" path="/var/lib/kubelet/pods/9c121b42-45df-4f3e-81e2-c8641a032647/volumes"
Sep 04 22:00:54.227035 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:54.227002    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:54.375573 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:54.375536    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:59.029486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:59.029444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:59.084758 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:59.084728    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:59.635761 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:59.635726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:00:59.736143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:00:59.736109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:04.453012 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:04.452977    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:04.582005 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:04.581972    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:06.519438 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:06.519394    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:06.631081 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:06.631044    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:06.689411 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:06.689366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:07.348075 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.348031    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:07.449408 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.449375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:07.454188 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.454163    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-cppd8"]
Sep 04 22:01:07.454554 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.454541    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c121b42-45df-4f3e-81e2-c8641a032647" containerName="manager"
Sep 04 22:01:07.454598 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.454556    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c121b42-45df-4f3e-81e2-c8641a032647" containerName="manager"
Sep 04 22:01:07.454657 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.454626    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c121b42-45df-4f3e-81e2-c8641a032647" containerName="manager"
Sep 04 22:01:07.472290 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.472265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-cppd8"]
Sep 04 22:01:07.472440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.472350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:07.476875 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.476849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d9fqh\""
Sep 04 22:01:07.549815 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.549783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq82p\" (UniqueName: \"kubernetes.io/projected/1abc1cc2-d80a-4c24-8604-d8400c59d7e8-kube-api-access-gq82p\") pod \"authorino-c548b5d7d-cppd8\" (UID: \"1abc1cc2-d80a-4c24-8604-d8400c59d7e8\") " pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:07.651297 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.651222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq82p\" (UniqueName: \"kubernetes.io/projected/1abc1cc2-d80a-4c24-8604-d8400c59d7e8-kube-api-access-gq82p\") pod \"authorino-c548b5d7d-cppd8\" (UID: \"1abc1cc2-d80a-4c24-8604-d8400c59d7e8\") " pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:07.661220 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.661192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq82p\" (UniqueName: \"kubernetes.io/projected/1abc1cc2-d80a-4c24-8604-d8400c59d7e8-kube-api-access-gq82p\") pod \"authorino-c548b5d7d-cppd8\" (UID: \"1abc1cc2-d80a-4c24-8604-d8400c59d7e8\") " pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:07.781969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:07.781943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:08.048925 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:08.048896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-cppd8"]
Sep 04 22:01:08.051439 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:01:08.051405    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1abc1cc2_d80a_4c24_8604_d8400c59d7e8.slice/crio-30c90805de7fca861d41d13a157c22980afbbc980af4b594b5e529b5d767ddff WatchSource:0}: Error finding container 30c90805de7fca861d41d13a157c22980afbbc980af4b594b5e529b5d767ddff: Status 404 returned error can't find the container with id 30c90805de7fca861d41d13a157c22980afbbc980af4b594b5e529b5d767ddff
Sep 04 22:01:08.138149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:08.138120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-cppd8" event={"ID":"1abc1cc2-d80a-4c24-8604-d8400c59d7e8","Type":"ContainerStarted","Data":"30c90805de7fca861d41d13a157c22980afbbc980af4b594b5e529b5d767ddff"}
Sep 04 22:01:10.151449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:10.151409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-cppd8" event={"ID":"1abc1cc2-d80a-4c24-8604-d8400c59d7e8","Type":"ContainerStarted","Data":"7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1"}
Sep 04 22:01:10.167218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:10.167175    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-cppd8" podStartSLOduration=1.495025056 podStartE2EDuration="3.167160648s" totalImagesPullingTime="1.672135592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:01:10.166105503 +0000 UTC m=+466.938118513" watchObservedRunningTime="2026-09-04 22:01:10.167160648 +0000 UTC m=+466.939173659"
Sep 04 22:01:32.849206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:32.849168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:32.948705 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:32.948665    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:33.334034 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:33.333995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:45.827071 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:45.827027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:46.304580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.304553    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:46.365378 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.365345    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55f8c7845b-nvntr"]
Sep 04 22:01:46.378320 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.378294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55f8c7845b-nvntr"]
Sep 04 22:01:46.378492 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.378392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.380779 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.380748    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 04 22:01:46.464805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.464772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxxn7\" (UniqueName: \"kubernetes.io/projected/6fbd65dd-3855-4268-a4d8-6282c354aadd-kube-api-access-bxxn7\") pod \"authorino-55f8c7845b-nvntr\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") " pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.464953 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.464817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fbd65dd-3855-4268-a4d8-6282c354aadd-tls-cert\") pod \"authorino-55f8c7845b-nvntr\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") " pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.565484 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.565402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxxn7\" (UniqueName: \"kubernetes.io/projected/6fbd65dd-3855-4268-a4d8-6282c354aadd-kube-api-access-bxxn7\") pod \"authorino-55f8c7845b-nvntr\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") " pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.565484 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.565442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fbd65dd-3855-4268-a4d8-6282c354aadd-tls-cert\") pod \"authorino-55f8c7845b-nvntr\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") " pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.568006 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.567979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fbd65dd-3855-4268-a4d8-6282c354aadd-tls-cert\") pod \"authorino-55f8c7845b-nvntr\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") " pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.572931 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.572908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxxn7\" (UniqueName: \"kubernetes.io/projected/6fbd65dd-3855-4268-a4d8-6282c354aadd-kube-api-access-bxxn7\") pod \"authorino-55f8c7845b-nvntr\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") " pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.688180 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.688149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:01:46.959690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:46.959605    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55f8c7845b-nvntr"]
Sep 04 22:01:46.962708 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:01:46.962680    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fbd65dd_3855_4268_a4d8_6282c354aadd.slice/crio-9acf4d2fae3d5d955b2e244a92fc262a83623d67671414559f69606940d48f58 WatchSource:0}: Error finding container 9acf4d2fae3d5d955b2e244a92fc262a83623d67671414559f69606940d48f58: Status 404 returned error can't find the container with id 9acf4d2fae3d5d955b2e244a92fc262a83623d67671414559f69606940d48f58
Sep 04 22:01:47.329995 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:47.329959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55f8c7845b-nvntr" event={"ID":"6fbd65dd-3855-4268-a4d8-6282c354aadd","Type":"ContainerStarted","Data":"9acf4d2fae3d5d955b2e244a92fc262a83623d67671414559f69606940d48f58"}
Sep 04 22:01:48.335686 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.335653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55f8c7845b-nvntr" event={"ID":"6fbd65dd-3855-4268-a4d8-6282c354aadd","Type":"ContainerStarted","Data":"380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355"}
Sep 04 22:01:48.353649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.353590    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55f8c7845b-nvntr" podStartSLOduration=1.831410221 podStartE2EDuration="2.353576813s" totalImagesPullingTime="522.166592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:01:48.351602366 +0000 UTC m=+505.123615376" watchObservedRunningTime="2026-09-04 22:01:48.353576813 +0000 UTC m=+505.125589822"
Sep 04 22:01:48.381525 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.381494    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-cppd8"]
Sep 04 22:01:48.381686 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.381647    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-cppd8" podUID="1abc1cc2-d80a-4c24-8604-d8400c59d7e8" containerName="authorino" containerID="cri-o://7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1" gracePeriod=30
Sep 04 22:01:48.629673 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.629647    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:48.682128 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.682095    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq82p\" (UniqueName: \"kubernetes.io/projected/1abc1cc2-d80a-4c24-8604-d8400c59d7e8-kube-api-access-gq82p\") pod \"1abc1cc2-d80a-4c24-8604-d8400c59d7e8\" (UID: \"1abc1cc2-d80a-4c24-8604-d8400c59d7e8\") "
Sep 04 22:01:48.684029 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.684000    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1abc1cc2-d80a-4c24-8604-d8400c59d7e8-kube-api-access-gq82p" (OuterVolumeSpecName: "kube-api-access-gq82p") pod "1abc1cc2-d80a-4c24-8604-d8400c59d7e8" (UID: "1abc1cc2-d80a-4c24-8604-d8400c59d7e8"). InnerVolumeSpecName "kube-api-access-gq82p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:01:48.783470 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:48.783444    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq82p\" (UniqueName: \"kubernetes.io/projected/1abc1cc2-d80a-4c24-8604-d8400c59d7e8-kube-api-access-gq82p\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:01:49.341503 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.341469    2577 generic.go:356] "Generic (PLEG): container finished" podID="1abc1cc2-d80a-4c24-8604-d8400c59d7e8" containerID="7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1" exitCode=0
Sep 04 22:01:49.341947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.341512    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-cppd8"
Sep 04 22:01:49.341947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.341551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-cppd8" event={"ID":"1abc1cc2-d80a-4c24-8604-d8400c59d7e8","Type":"ContainerDied","Data":"7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1"}
Sep 04 22:01:49.341947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.341590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-cppd8" event={"ID":"1abc1cc2-d80a-4c24-8604-d8400c59d7e8","Type":"ContainerDied","Data":"30c90805de7fca861d41d13a157c22980afbbc980af4b594b5e529b5d767ddff"}
Sep 04 22:01:49.341947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.341608    2577 scope.go:117] "RemoveContainer" containerID="7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1"
Sep 04 22:01:49.349962 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.349942    2577 scope.go:117] "RemoveContainer" containerID="7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1"
Sep 04 22:01:49.350225 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:01:49.350208    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1\": container with ID starting with 7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1 not found: ID does not exist" containerID="7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1"
Sep 04 22:01:49.350275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.350234    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1"} err="failed to get container status \"7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1\": rpc error: code = NotFound desc = could not find container \"7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1\": container with ID starting with 7d767bc53aa6e8e467269490c50e4973190403e2b2a7f9c56f8990110f8fb5b1 not found: ID does not exist"
Sep 04 22:01:49.361229 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.361209    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-cppd8"]
Sep 04 22:01:49.364787 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.364768    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-cppd8"]
Sep 04 22:01:49.850782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:49.850754    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1abc1cc2-d80a-4c24-8604-d8400c59d7e8" path="/var/lib/kubelet/pods/1abc1cc2-d80a-4c24-8604-d8400c59d7e8/volumes"
Sep 04 22:01:53.162755 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:53.162719    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:53.260893 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:53.260860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:53.360280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:53.360238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:53.423430 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:53.423349    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:53.540931 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:53.540899    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:56.754561 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:56.754524    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:01:56.855549 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:01:56.855513    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:08.097944 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:08.097897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:08.153309 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:08.153274    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:30.482830 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:30.482792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:30.580668 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:30.580605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:31.903550 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:31.903517    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:32.006528 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.006494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:32.090997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.090966    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:32.382210 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.382180    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:32.477163 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.477129    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:32.520135 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.520105    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"]
Sep 04 22:02:32.520459 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.520447    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abc1cc2-d80a-4c24-8604-d8400c59d7e8" containerName="authorino"
Sep 04 22:02:32.520508 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.520461    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abc1cc2-d80a-4c24-8604-d8400c59d7e8" containerName="authorino"
Sep 04 22:02:32.520549 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.520529    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1abc1cc2-d80a-4c24-8604-d8400c59d7e8" containerName="authorino"
Sep 04 22:02:32.524565 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.524544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.527008 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.526984    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bpvpg\""
Sep 04 22:02:32.527192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.527177    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 04 22:02:32.536862 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.536841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"]
Sep 04 22:02:32.610266 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.610230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c150594-d718-4b18-b6a2-2b81db2745dc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9c2ks\" (UID: \"5c150594-d718-4b18-b6a2-2b81db2745dc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.610461 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.610390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtctb\" (UniqueName: \"kubernetes.io/projected/5c150594-d718-4b18-b6a2-2b81db2745dc-kube-api-access-rtctb\") pod \"payload-processing-5b54b7fbb7-9c2ks\" (UID: \"5c150594-d718-4b18-b6a2-2b81db2745dc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.711605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.711499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtctb\" (UniqueName: \"kubernetes.io/projected/5c150594-d718-4b18-b6a2-2b81db2745dc-kube-api-access-rtctb\") pod \"payload-processing-5b54b7fbb7-9c2ks\" (UID: \"5c150594-d718-4b18-b6a2-2b81db2745dc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.711605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.711579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c150594-d718-4b18-b6a2-2b81db2745dc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9c2ks\" (UID: \"5c150594-d718-4b18-b6a2-2b81db2745dc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.712577 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.712550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c150594-d718-4b18-b6a2-2b81db2745dc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9c2ks\" (UID: \"5c150594-d718-4b18-b6a2-2b81db2745dc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.723892 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.723867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtctb\" (UniqueName: \"kubernetes.io/projected/5c150594-d718-4b18-b6a2-2b81db2745dc-kube-api-access-rtctb\") pod \"payload-processing-5b54b7fbb7-9c2ks\" (UID: \"5c150594-d718-4b18-b6a2-2b81db2745dc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.834996 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.834955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:32.961480 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:32.961448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:33.114208 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:33.114184    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"]
Sep 04 22:02:33.115832 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:02:33.115802    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c150594_d718_4b18_b6a2_2b81db2745dc.slice/crio-8522496c1c04e23cadedf7a066aee949e7704d323215929d8aacea8b28da3727 WatchSource:0}: Error finding container 8522496c1c04e23cadedf7a066aee949e7704d323215929d8aacea8b28da3727: Status 404 returned error can't find the container with id 8522496c1c04e23cadedf7a066aee949e7704d323215929d8aacea8b28da3727
Sep 04 22:02:33.559901 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:33.559868    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks" event={"ID":"5c150594-d718-4b18-b6a2-2b81db2745dc","Type":"ContainerStarted","Data":"8522496c1c04e23cadedf7a066aee949e7704d323215929d8aacea8b28da3727"}
Sep 04 22:02:36.577403 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:36.577370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks" event={"ID":"5c150594-d718-4b18-b6a2-2b81db2745dc","Type":"ContainerStarted","Data":"126e035adcd732e4bf9db4bab495ffb1a8819afe56518f9fb07fc0a44e7b0258"}
Sep 04 22:02:36.577817 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:36.577467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:02:36.595406 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:36.595320    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks" podStartSLOduration=1.6906110559999998 podStartE2EDuration="4.595309375s" totalImagesPullingTime="2.904698319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:02:36.594226458 +0000 UTC m=+553.366239469" watchObservedRunningTime="2026-09-04 22:02:36.595309375 +0000 UTC m=+553.367322394"
Sep 04 22:02:44.788963 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:44.788924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:44.884232 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:44.884197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:02:47.585164 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:02:47.585127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9c2ks"
Sep 04 22:03:07.471317 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:07.471252    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:20.829519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.829488    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"]
Sep 04 22:03:20.831889 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.831865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.835808 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.835786    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 04 22:03:20.836173 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.836151    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6vlzh\""
Sep 04 22:03:20.836173 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.836168    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 04 22:03:20.836364 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.836168    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 04 22:03:20.844259 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.844238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"]
Sep 04 22:03:20.870657 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.870612    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bed8ce1d-cc76-4316-877e-ce60d3472da6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.870755 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.870668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.870755 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.870723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.870837 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.870758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.870837 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.870779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.870837 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.870801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd62q\" (UniqueName: \"kubernetes.io/projected/bed8ce1d-cc76-4316-877e-ce60d3472da6-kube-api-access-nd62q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.873194 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.873159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:20.971529 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.971667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.971667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd62q\" (UniqueName: \"kubernetes.io/projected/bed8ce1d-cc76-4316-877e-ce60d3472da6-kube-api-access-nd62q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.971795 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bed8ce1d-cc76-4316-877e-ce60d3472da6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.971795 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.971795 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.971984 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.972022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.971982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.972129 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.972105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.973915 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.973890    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bed8ce1d-cc76-4316-877e-ce60d3472da6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.974164 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.974145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bed8ce1d-cc76-4316-877e-ce60d3472da6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:20.981797 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:20.981775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd62q\" (UniqueName: \"kubernetes.io/projected/bed8ce1d-cc76-4316-877e-ce60d3472da6-kube-api-access-nd62q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hqwnl\" (UID: \"bed8ce1d-cc76-4316-877e-ce60d3472da6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:21.144069 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:21.144008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:21.421393 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:21.421362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"]
Sep 04 22:03:21.422921 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:03:21.422893    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed8ce1d_cc76_4316_877e_ce60d3472da6.slice/crio-a688040efcd0050f8222cfc1703109ccf9c4cf9a698d2ad651912764a96d402c WatchSource:0}: Error finding container a688040efcd0050f8222cfc1703109ccf9c4cf9a698d2ad651912764a96d402c: Status 404 returned error can't find the container with id a688040efcd0050f8222cfc1703109ccf9c4cf9a698d2ad651912764a96d402c
Sep 04 22:03:21.800972 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:21.800935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl" event={"ID":"bed8ce1d-cc76-4316-877e-ce60d3472da6","Type":"ContainerStarted","Data":"a688040efcd0050f8222cfc1703109ccf9c4cf9a698d2ad651912764a96d402c"}
Sep 04 22:03:22.812484 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:22.812448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl" event={"ID":"bed8ce1d-cc76-4316-877e-ce60d3472da6","Type":"ContainerStarted","Data":"ac0adb568483f54d48059bf24951a60a37987ba88a91ec5a583fdeafff4674bf"}
Sep 04 22:03:22.830339 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:22.830289    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl" podStartSLOduration=1.8197014820000001 podStartE2EDuration="2.830276003s" totalImagesPullingTime="1.010574521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:03:22.827889185 +0000 UTC m=+599.599902194" watchObservedRunningTime="2026-09-04 22:03:22.830276003 +0000 UTC m=+599.602289013"
Sep 04 22:03:23.666624 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:23.666599    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:03:23.667312 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:23.667287    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:03:27.864879 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:27.864848    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:31.144431 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:31.144398    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:31.144826 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:31.144485    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:31.157252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:31.157228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:31.580386 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:31.580353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:31.641335 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:31.641309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:31.865010 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:31.864935    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hqwnl"
Sep 04 22:03:37.218520 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:37.218490    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:44.862119 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.862085    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"]
Sep 04 22:03:44.864504 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.864485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:44.867323 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.867302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 04 22:03:44.877867 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.877846    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"]
Sep 04 22:03:44.905224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.905193    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:44.969781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.969753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5dd81e-f505-4499-a217-98e3d58e3a1a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:44.969922 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.969783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwv8n\" (UniqueName: \"kubernetes.io/projected/dd5dd81e-f505-4499-a217-98e3d58e3a1a-kube-api-access-pwv8n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:44.969922 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.969814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:44.969922 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.969866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:44.969922 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.969910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:44.970117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:44.969990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5dd81e-f505-4499-a217-98e3d58e3a1a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwv8n\" (UniqueName: \"kubernetes.io/projected/dd5dd81e-f505-4499-a217-98e3d58e3a1a-kube-api-access-pwv8n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071809 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071929 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.071929 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.071859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.073460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.073435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd5dd81e-f505-4499-a217-98e3d58e3a1a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.073777 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.073756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5dd81e-f505-4499-a217-98e3d58e3a1a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.081940 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.081921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwv8n\" (UniqueName: \"kubernetes.io/projected/dd5dd81e-f505-4499-a217-98e3d58e3a1a-kube-api-access-pwv8n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl\" (UID: \"dd5dd81e-f505-4499-a217-98e3d58e3a1a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.174920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.174870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:45.447810 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.447733    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"]
Sep 04 22:03:45.450908 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:03:45.450878    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5dd81e_f505_4499_a217_98e3d58e3a1a.slice/crio-a12cbf6326fa1e1ccec8240f12df135c28b320c08597728dd554b6f3f2a20700 WatchSource:0}: Error finding container a12cbf6326fa1e1ccec8240f12df135c28b320c08597728dd554b6f3f2a20700: Status 404 returned error can't find the container with id a12cbf6326fa1e1ccec8240f12df135c28b320c08597728dd554b6f3f2a20700
Sep 04 22:03:45.452261 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.452243    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:03:45.923288 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.923249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl" event={"ID":"dd5dd81e-f505-4499-a217-98e3d58e3a1a","Type":"ContainerStarted","Data":"0a4e0883433cf119217346d44cf0272e16312dabf67876cc5be0c90efe99ddd9"}
Sep 04 22:03:45.923819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.923312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl" event={"ID":"dd5dd81e-f505-4499-a217-98e3d58e3a1a","Type":"ContainerStarted","Data":"a12cbf6326fa1e1ccec8240f12df135c28b320c08597728dd554b6f3f2a20700"}
Sep 04 22:03:45.947684 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:45.947579    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl" podStartSLOduration=1.78461238 podStartE2EDuration="1.947559269s" totalImagesPullingTime="162.946889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:03:45.946034078 +0000 UTC m=+622.718047088" watchObservedRunningTime="2026-09-04 22:03:45.947559269 +0000 UTC m=+622.719572279"
Sep 04 22:03:47.405059 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:47.405024    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:03:55.175272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:55.175237    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:55.175848 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:55.175299    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:55.188180 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:55.188153    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:03:55.986995 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:03:55.986965    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl"
Sep 04 22:04:02.466614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:02.466546    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:13.268446 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:13.268404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:33.564004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:33.563954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:33.694829 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:33.694798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:41.769445 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:41.769407    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:51.465673 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:51.465619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:53.850955 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:53.850918    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:04:53.938969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:04:53.938940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:14.487749 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.487708    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55f8c7845b-nvntr"]
Sep 04 22:05:14.488341 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.487910    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-55f8c7845b-nvntr" podUID="6fbd65dd-3855-4268-a4d8-6282c354aadd" containerName="authorino" containerID="cri-o://380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355" gracePeriod=30
Sep 04 22:05:14.741683 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.741614    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:05:14.828739 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.828702    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fbd65dd-3855-4268-a4d8-6282c354aadd-tls-cert\") pod \"6fbd65dd-3855-4268-a4d8-6282c354aadd\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") "
Sep 04 22:05:14.828889 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.828803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxxn7\" (UniqueName: \"kubernetes.io/projected/6fbd65dd-3855-4268-a4d8-6282c354aadd-kube-api-access-bxxn7\") pod \"6fbd65dd-3855-4268-a4d8-6282c354aadd\" (UID: \"6fbd65dd-3855-4268-a4d8-6282c354aadd\") "
Sep 04 22:05:14.830806 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.830781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbd65dd-3855-4268-a4d8-6282c354aadd-kube-api-access-bxxn7" (OuterVolumeSpecName: "kube-api-access-bxxn7") pod "6fbd65dd-3855-4268-a4d8-6282c354aadd" (UID: "6fbd65dd-3855-4268-a4d8-6282c354aadd"). InnerVolumeSpecName "kube-api-access-bxxn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:05:14.838858 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.838835    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbd65dd-3855-4268-a4d8-6282c354aadd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6fbd65dd-3855-4268-a4d8-6282c354aadd" (UID: "6fbd65dd-3855-4268-a4d8-6282c354aadd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:05:14.929877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.929839    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fbd65dd-3855-4268-a4d8-6282c354aadd-tls-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:05:14.929877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:14.929875    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxxn7\" (UniqueName: \"kubernetes.io/projected/6fbd65dd-3855-4268-a4d8-6282c354aadd-kube-api-access-bxxn7\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:05:15.024543 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.024506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:15.128031 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.127985    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:15.371143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.371061    2577 generic.go:356] "Generic (PLEG): container finished" podID="6fbd65dd-3855-4268-a4d8-6282c354aadd" containerID="380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355" exitCode=0
Sep 04 22:05:15.371143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.371107    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55f8c7845b-nvntr"
Sep 04 22:05:15.371143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.371108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55f8c7845b-nvntr" event={"ID":"6fbd65dd-3855-4268-a4d8-6282c354aadd","Type":"ContainerDied","Data":"380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355"}
Sep 04 22:05:15.371381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.371152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55f8c7845b-nvntr" event={"ID":"6fbd65dd-3855-4268-a4d8-6282c354aadd","Type":"ContainerDied","Data":"9acf4d2fae3d5d955b2e244a92fc262a83623d67671414559f69606940d48f58"}
Sep 04 22:05:15.371381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.371172    2577 scope.go:117] "RemoveContainer" containerID="380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355"
Sep 04 22:05:15.380414 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.380388    2577 scope.go:117] "RemoveContainer" containerID="380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355"
Sep 04 22:05:15.380731 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:05:15.380705    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355\": container with ID starting with 380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355 not found: ID does not exist" containerID="380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355"
Sep 04 22:05:15.380830 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.380746    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355"} err="failed to get container status \"380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355\": rpc error: code = NotFound desc = could not find container \"380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355\": container with ID starting with 380eef06134d192e45d835f24f30263867768322a50a92ecc06996bbcd310355 not found: ID does not exist"
Sep 04 22:05:15.392753 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.392732    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55f8c7845b-nvntr"]
Sep 04 22:05:15.395882 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.395857    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55f8c7845b-nvntr"]
Sep 04 22:05:15.851988 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:15.851957    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbd65dd-3855-4268-a4d8-6282c354aadd" path="/var/lib/kubelet/pods/6fbd65dd-3855-4268-a4d8-6282c354aadd/volumes"
Sep 04 22:05:16.212577 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:16.212494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:16.314053 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:16.314014    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:31.981818 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:31.981787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:32.113307 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.113266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:32.284878 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.284842    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"]
Sep 04 22:05:32.285580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.285557    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbd65dd-3855-4268-a4d8-6282c354aadd" containerName="authorino"
Sep 04 22:05:32.285580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.285579    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbd65dd-3855-4268-a4d8-6282c354aadd" containerName="authorino"
Sep 04 22:05:32.285814 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.285703    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbd65dd-3855-4268-a4d8-6282c354aadd" containerName="authorino"
Sep 04 22:05:32.290273 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.290252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.293207 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.293187    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a5e1c2-openshift-default-dockercfg-2qgmp\""
Sep 04 22:05:32.293378 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.293358    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 04 22:05:32.303150 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.303132    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"]
Sep 04 22:05:32.314285 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.314258    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:32.379310 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47953eae-eeab-4bb3-9f16-59921ad3c77d-istiod-ca-cert\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379310 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4ks\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-kube-api-access-gq4ks\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379490 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-certs\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379490 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-token\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379490 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-credential-socket\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-envoy\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-socket\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-data\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.379765 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.379627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-podinfo\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.480911 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.480876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-token\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.480911 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.480914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-credential-socket\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.480932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-envoy\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-socket\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-data\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-podinfo\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47953eae-eeab-4bb3-9f16-59921ad3c77d-istiod-ca-cert\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-credential-socket\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4ks\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-kube-api-access-gq4ks\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-certs\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481572 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-socket\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481572 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-data\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481748 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-certs\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.481965 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.481948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47953eae-eeab-4bb3-9f16-59921ad3c77d-istiod-ca-cert\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.483823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.483792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-envoy\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.484009 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.483989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-podinfo\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.488950 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.488921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4ks\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-kube-api-access-gq4ks\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.489212 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.489191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-token\") pod \"e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") " pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.601460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.601389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:32.879786 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:32.879722    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"]
Sep 04 22:05:32.882344 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:05:32.882309    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47953eae_eeab_4bb3_9f16_59921ad3c77d.slice/crio-1039377d966aa7e1e4ed05e32640040d4fc017b43a0adad63604a197ea9c50da WatchSource:0}: Error finding container 1039377d966aa7e1e4ed05e32640040d4fc017b43a0adad63604a197ea9c50da: Status 404 returned error can't find the container with id 1039377d966aa7e1e4ed05e32640040d4fc017b43a0adad63604a197ea9c50da
Sep 04 22:05:33.212350 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:33.212259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:33.409378 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:33.409342    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:33.465055 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:33.464979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" event={"ID":"47953eae-eeab-4bb3-9f16-59921ad3c77d","Type":"ContainerStarted","Data":"1039377d966aa7e1e4ed05e32640040d4fc017b43a0adad63604a197ea9c50da"}
Sep 04 22:05:33.508294 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:33.508259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:33.888318 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:33.888222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:35.541202 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:35.541167    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:35.541444 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:35.541248    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:35.541444 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:35.541275    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:36.481683 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:36.481624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" event={"ID":"47953eae-eeab-4bb3-9f16-59921ad3c77d","Type":"ContainerStarted","Data":"34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"}
Sep 04 22:05:36.505630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:36.505579    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podStartSLOduration=1.849266501 podStartE2EDuration="4.505562371s" totalImagesPullingTime="2.65629587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:05:36.503406702 +0000 UTC m=+733.275419713" watchObservedRunningTime="2026-09-04 22:05:36.505562371 +0000 UTC m=+733.277575381"
Sep 04 22:05:36.602483 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:36.602449    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:36.607425 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:36.607400    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:37.487295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:37.487265    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:37.488284 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:37.488260    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:38.410022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:38.409990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:38.513075 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:38.513048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:39.629432 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:39.629395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:39.701582 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:39.701542    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:39.827018 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:39.826986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:40.120011 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:40.119972    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:40.229252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:40.229214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:41.332554 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.332519    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:41.403149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.403118    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:41.553951 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.553920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:41.823455 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.823422    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"]
Sep 04 22:05:41.828028 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.828003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.830695 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.830670    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f81019dc-openshift-default-dockercfg-dr8zh\""
Sep 04 22:05:41.837950 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.837928    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"]
Sep 04 22:05:41.877812 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.877773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:41.972648 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istiod-ca-cert\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.972841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-token\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.972841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-podinfo\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.972841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-certs\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.972841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-credential-socket\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.972998 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-socket\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.972998 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.972917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-data\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.973078 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.973001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjxlj\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-kube-api-access-tjxlj\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:41.973078 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:41.973022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-envoy\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074468 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjxlj\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-kube-api-access-tjxlj\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074468 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-envoy\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074744 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istiod-ca-cert\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074744 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-token\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074744 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-podinfo\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074744 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-certs\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-credential-socket\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-socket\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.074945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.074817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-data\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.075196 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.075162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-credential-socket\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.075196 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.075187    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-certs\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.075361 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.075232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-data\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.075361 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.075258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-socket\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.075440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.075367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istiod-ca-cert\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.076733 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.076714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-envoy\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.077227 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.077203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-podinfo\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.084570 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.084549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjxlj\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-kube-api-access-tjxlj\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.086300 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.086276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-token\") pod \"e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") " pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.111152 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.111121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:42.141265 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.141232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:42.427034 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.427008    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"]
Sep 04 22:05:42.428883 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:05:42.428858    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fc3bf8_c23b_45f7_a1fa_64bc97dacfb6.slice/crio-6e8c5d84c4b3bd8fd062b1bf6c3212df2a094f2c433fe925800d3e626845f627 WatchSource:0}: Error finding container 6e8c5d84c4b3bd8fd062b1bf6c3212df2a094f2c433fe925800d3e626845f627: Status 404 returned error can't find the container with id 6e8c5d84c4b3bd8fd062b1bf6c3212df2a094f2c433fe925800d3e626845f627
Sep 04 22:05:42.431964 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.431930    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:42.432062 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.431998    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:42.432062 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.432025    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:42.514715 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.514669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" event={"ID":"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6","Type":"ContainerStarted","Data":"4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"}
Sep 04 22:05:42.514831 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.514739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" event={"ID":"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6","Type":"ContainerStarted","Data":"6e8c5d84c4b3bd8fd062b1bf6c3212df2a094f2c433fe925800d3e626845f627"}
Sep 04 22:05:42.537088 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:42.537040    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podStartSLOduration=1.537024341 podStartE2EDuration="1.537024341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:05:42.534934404 +0000 UTC m=+739.306947415" watchObservedRunningTime="2026-09-04 22:05:42.537024341 +0000 UTC m=+739.309037350"
Sep 04 22:05:43.141445 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:43.141407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:43.146775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:43.146749    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:43.519864 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:43.519837    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:43.520804 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:43.520787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:05:43.898004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:43.897920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:43.994953 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:43.994922    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:45.081820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.081784    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:45.184295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.184260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:45.492411 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.492330    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:45.645684 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.645603    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:45.744593 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.744512    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:45.753687 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.753662    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"]
Sep 04 22:05:45.757027 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.757008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:45.760605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.760587    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f81019dc\""
Sep 04 22:05:45.760716 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.760621    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f81019dc-dockercfg-mc4d8\""
Sep 04 22:05:45.770506 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.770480    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"]
Sep 04 22:05:45.784157 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.784133    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"]
Sep 04 22:05:45.788430 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.788406    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:45.801664 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.801615    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"]
Sep 04 22:05:45.911538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.911488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fn5q\" (UniqueName: \"kubernetes.io/projected/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-kube-api-access-9fn5q\") pod \"payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") " pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:45.911538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.911533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-plugins-config-volume\") pod \"payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") " pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:45.911538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.911553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlsdx\" (UniqueName: \"kubernetes.io/projected/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-kube-api-access-qlsdx\") pod \"payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:45.911949 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:45.911679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.012990 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.012941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fn5q\" (UniqueName: \"kubernetes.io/projected/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-kube-api-access-9fn5q\") pod \"payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") " pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:46.013192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.013009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-plugins-config-volume\") pod \"payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") " pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:46.013192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.013039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsdx\" (UniqueName: \"kubernetes.io/projected/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-kube-api-access-qlsdx\") pod \"payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.013192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.013090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.014794 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.014762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-plugins-config-volume\") pod \"payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") " pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:46.016124 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.016095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.023091 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.023058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fn5q\" (UniqueName: \"kubernetes.io/projected/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-kube-api-access-9fn5q\") pod \"payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") " pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:46.023275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.023251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsdx\" (UniqueName: \"kubernetes.io/projected/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-kube-api-access-qlsdx\") pod \"payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.069565 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.069532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.102145 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.100789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:46.365312 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.365284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"]
Sep 04 22:05:46.366827 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:05:46.366798    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e81d53_5d6e_4e19_8c92_195cfcc2dc43.slice/crio-f2bc167012dec8b6130eb04f5e111eae8598b5626015b2c7ce9242a1b03e80fc WatchSource:0}: Error finding container f2bc167012dec8b6130eb04f5e111eae8598b5626015b2c7ce9242a1b03e80fc: Status 404 returned error can't find the container with id f2bc167012dec8b6130eb04f5e111eae8598b5626015b2c7ce9242a1b03e80fc
Sep 04 22:05:46.417698 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.412173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"]
Sep 04 22:05:46.422045 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:05:46.422017    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b9dd2f_5289_4163_836b_50d5c4fc1ea7.slice/crio-cdfdb8ee8359c3b7dc4662a94adb8e10f0683a6136113f5bb10f334017172662 WatchSource:0}: Error finding container cdfdb8ee8359c3b7dc4662a94adb8e10f0683a6136113f5bb10f334017172662: Status 404 returned error can't find the container with id cdfdb8ee8359c3b7dc4662a94adb8e10f0683a6136113f5bb10f334017172662
Sep 04 22:05:46.538024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.537502    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf" event={"ID":"94e81d53-5d6e-4e19-8c92-195cfcc2dc43","Type":"ContainerStarted","Data":"8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375"}
Sep 04 22:05:46.538024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.537568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf" event={"ID":"94e81d53-5d6e-4e19-8c92-195cfcc2dc43","Type":"ContainerStarted","Data":"f2bc167012dec8b6130eb04f5e111eae8598b5626015b2c7ce9242a1b03e80fc"}
Sep 04 22:05:46.538024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.537623    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:46.539405 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.539373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln" event={"ID":"97b9dd2f-5289-4163-836b-50d5c4fc1ea7","Type":"ContainerStarted","Data":"8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a"}
Sep 04 22:05:46.539540 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.539430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln" event={"ID":"97b9dd2f-5289-4163-836b-50d5c4fc1ea7","Type":"ContainerStarted","Data":"cdfdb8ee8359c3b7dc4662a94adb8e10f0683a6136113f5bb10f334017172662"}
Sep 04 22:05:46.539540 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.539460    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:46.554734 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.554684    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf" podStartSLOduration=1.5546245060000001 podStartE2EDuration="1.554624506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:05:46.552272995 +0000 UTC m=+743.324286005" watchObservedRunningTime="2026-09-04 22:05:46.554624506 +0000 UTC m=+743.326637545"
Sep 04 22:05:46.566896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:46.566844    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln" podStartSLOduration=1.5668273780000002 podStartE2EDuration="1.566827378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:05:46.566523519 +0000 UTC m=+743.338536530" watchObservedRunningTime="2026-09-04 22:05:46.566827378 +0000 UTC m=+743.338840388"
Sep 04 22:05:50.703437 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:50.703402    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:50.800397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:50.800364    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:50.927531 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:50.927500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:51.677269 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:51.677236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:53.529813 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:53.529763    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:05:53.530312 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:53.529852    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:05:55.589702 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:55.589656    2577 generic.go:356] "Generic (PLEG): container finished" podID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerID="34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8" exitCode=0
Sep 04 22:05:55.590239 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:55.589746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" event={"ID":"47953eae-eeab-4bb3-9f16-59921ad3c77d","Type":"ContainerDied","Data":"34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"}
Sep 04 22:05:55.590390 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:55.590368    2577 scope.go:117] "RemoveContainer" containerID="34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"
Sep 04 22:05:55.593748 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:55.593695    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:55.593863 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:55.593816    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:55.593926 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:55.593902    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:05:56.600475 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:56.600438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" event={"ID":"47953eae-eeab-4bb3-9f16-59921ad3c77d","Type":"ContainerStarted","Data":"feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f"}
Sep 04 22:05:56.602252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:56.602226    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:05:56.602507 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:56.602488    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 04 22:05:56.602665 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:56.602625    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 04 22:05:57.017322 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.017281    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:57.082741 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.082705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:57.183488 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.183459    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:57.281696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.281550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:57.381932 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.381897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:57.547219 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.547131    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:05:57.547219 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.547196    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:05:57.603263 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.603227    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 04 22:05:57.603855 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:57.603810    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 04 22:05:58.510351 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:58.510317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:58.580243 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:58.580209    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:05:58.602757 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:58.602721    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 04 22:05:58.603057 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:58.603030    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 04 22:05:59.602269 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:59.602224    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 04 22:05:59.602777 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:05:59.602294    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 04 22:06:00.522550 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:00.522424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:00.602945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:00.602463    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 04 22:06:00.602945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:00.602534    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 04 22:06:01.603293 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:01.602834    2577 patch_prober.go:28] interesting pod/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 04 22:06:01.603293 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:01.602900    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 04 22:06:02.605554 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:02.605525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:06:02.606926 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:02.605887    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:06:02.606926 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:02.606700    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:06:03.385125 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.385087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:03.485784 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.485747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:03.665473 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.665395    2577 generic.go:356] "Generic (PLEG): container finished" podID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerID="4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334" exitCode=0
Sep 04 22:06:03.665879 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.665471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" event={"ID":"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6","Type":"ContainerDied","Data":"4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"}
Sep 04 22:06:03.665942 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.665928    2577 scope.go:117] "RemoveContainer" containerID="4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"
Sep 04 22:06:03.666954 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.666921    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:03.667053 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.667009    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:03.667098 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.667072    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:03.729926 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:03.729897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:04.015118 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.015081    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"]
Sep 04 22:06:04.029286 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.029258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.031496 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.031472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"]
Sep 04 22:06:04.032304 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.032272    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d4ad2d-openshift-default-dockercfg-j7n55\""
Sep 04 22:06:04.041491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.041464    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:04.111944 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.111911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-data\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.111944 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.111946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-socket\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112162 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.111970    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-podinfo\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112162 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.112013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-certs\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112162 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.112044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-token\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112162 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.112117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-credential-socket\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112302 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.112161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-envoy\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112336 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.112300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zgmp\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-kube-api-access-9zgmp\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.112371 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.112343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istiod-ca-cert\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.143929 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.143875    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:04.214099 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.214022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-data\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.214694 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.214666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-data\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.214906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.214664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-socket\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215064 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-podinfo\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215207 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-certs\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215329 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-token\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-credential-socket\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-envoy\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215815 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-credential-socket\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215815 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.214774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-socket\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.215953 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.215522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-certs\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.216192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.216174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zgmp\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-kube-api-access-9zgmp\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.216369 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.216351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istiod-ca-cert\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.217109 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.217083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istiod-ca-cert\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.218550 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.218525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-podinfo\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.218959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.218942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-envoy\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.223662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.223604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-token\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.224368 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.224349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zgmp\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-kube-api-access-9zgmp\") pod \"e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") " pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.344298 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.344204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:04.648850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.648826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"]
Sep 04 22:06:04.650883 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:06:04.650855    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b7a54b_68a8_4483_ae2c_cc4f90412133.slice/crio-194ba1255e7f946a924435b6efadf033852ea28c43bafe41f2bc4808b6e38e0b WatchSource:0}: Error finding container 194ba1255e7f946a924435b6efadf033852ea28c43bafe41f2bc4808b6e38e0b: Status 404 returned error can't find the container with id 194ba1255e7f946a924435b6efadf033852ea28c43bafe41f2bc4808b6e38e0b
Sep 04 22:06:04.653322 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.653291    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:04.653388 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.653365    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:04.653427 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.653397    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:04.673275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.673247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" event={"ID":"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6","Type":"ContainerStarted","Data":"156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a"}
Sep 04 22:06:04.675098 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:04.675069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" event={"ID":"a9b7a54b-68a8-4483-ae2c-cc4f90412133","Type":"ContainerStarted","Data":"194ba1255e7f946a924435b6efadf033852ea28c43bafe41f2bc4808b6e38e0b"}
Sep 04 22:06:05.142043 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:05.142002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:06:05.142278 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:05.142250    2577 patch_prober.go:28] interesting pod/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:06:05.142329 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:05.142307    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 04 22:06:05.681877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:05.681837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" event={"ID":"a9b7a54b-68a8-4483-ae2c-cc4f90412133","Type":"ContainerStarted","Data":"f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"}
Sep 04 22:06:05.705810 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:05.705746    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podStartSLOduration=2.705723415 podStartE2EDuration="2.705723415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:06:05.701200334 +0000 UTC m=+762.473213346" watchObservedRunningTime="2026-09-04 22:06:05.705723415 +0000 UTC m=+762.477736426"
Sep 04 22:06:06.142023 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.141989    2577 patch_prober.go:28] interesting pod/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:06:06.142210 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.142046    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 04 22:06:06.162216 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.162169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:06.344489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.344452    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:06.349369 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.349343    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:06.687460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.687430    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:06.688532 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:06.688507    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:07.142237 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:07.142203    2577 patch_prober.go:28] interesting pod/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:06:07.142419 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:07.142260    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 04 22:06:07.648046 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:07.648009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:07.744028 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:07.743992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:08.141904 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:08.141867    2577 patch_prober.go:28] interesting pod/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:06:08.142097 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:08.141925    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 04 22:06:08.802789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:08.802752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:08.905575 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:08.905540    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:09.007316 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:09.007277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:09.142346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:09.142256    2577 patch_prober.go:28] interesting pod/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:06:09.142346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:09.142319    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 04 22:06:09.307513 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:09.307469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:09.406667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:09.406556    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:09.932143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:09.932107    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:10.146141 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:10.146113    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:06:10.146410 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:10.146386    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:06:10.147158 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:10.147142    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:06:10.714493 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:10.714447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:22.729929 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.728803    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:06:22.729929 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.728876    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:06:22.799507 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.799471    2577 generic.go:356] "Generic (PLEG): container finished" podID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerID="f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183" exitCode=0
Sep 04 22:06:22.799678 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.799556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" event={"ID":"a9b7a54b-68a8-4483-ae2c-cc4f90412133","Type":"ContainerDied","Data":"f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"}
Sep 04 22:06:22.800133 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.800113    2577 scope.go:117] "RemoveContainer" containerID="f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"
Sep 04 22:06:22.801374 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.801328    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:22.801461 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.801432    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:22.801528 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:22.801510    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:23.810939 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:23.810903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" event={"ID":"a9b7a54b-68a8-4483-ae2c-cc4f90412133","Type":"ContainerStarted","Data":"9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6"}
Sep 04 22:06:24.345062 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:24.345029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:24.345295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:24.345216    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 04 22:06:24.345295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:24.345269    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 04 22:06:25.263447 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.263406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:25.345417 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.345377    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 04 22:06:25.345612 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.345448    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 04 22:06:25.941585 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.941543    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:25.977275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.977239    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"]
Sep 04 22:06:25.977523 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.977495    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln" podUID="97b9dd2f-5289-4163-836b-50d5c4fc1ea7" containerName="payload-processing" containerID="cri-o://8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a" gracePeriod=30
Sep 04 22:06:25.986418 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.986390    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"]
Sep 04 22:06:25.986811 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:25.986780    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf" podUID="94e81d53-5d6e-4e19-8c92-195cfcc2dc43" containerName="payload-pre-processing" containerID="cri-o://8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375" gracePeriod=30
Sep 04 22:06:26.034436 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.034319    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:26.100694 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.099320    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:26.166961 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.166823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:26.274279 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.274240    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"]
Sep 04 22:06:26.275309 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.275279    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy" containerID="cri-o://156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a" gracePeriod=30
Sep 04 22:06:26.293335 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.293259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:26.345149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.345116    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 04 22:06:26.345256 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.345185    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 04 22:06:26.349185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.349162    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:06:26.352342 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.352324    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:06:26.444629 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.444594    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fn5q\" (UniqueName: \"kubernetes.io/projected/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-kube-api-access-9fn5q\") pod \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") "
Sep 04 22:06:26.444816 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.444676    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlsdx\" (UniqueName: \"kubernetes.io/projected/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-kube-api-access-qlsdx\") pod \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") "
Sep 04 22:06:26.444816 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.444773    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-plugins-config-volume\") pod \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\" (UID: \"94e81d53-5d6e-4e19-8c92-195cfcc2dc43\") "
Sep 04 22:06:26.444816 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.444810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-plugins-config-volume\") pod \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\" (UID: \"97b9dd2f-5289-4163-836b-50d5c4fc1ea7\") "
Sep 04 22:06:26.445207 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.445177    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97b9dd2f-5289-4163-836b-50d5c4fc1ea7" (UID: "97b9dd2f-5289-4163-836b-50d5c4fc1ea7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:06:26.445207 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.445185    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94e81d53-5d6e-4e19-8c92-195cfcc2dc43" (UID: "94e81d53-5d6e-4e19-8c92-195cfcc2dc43"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:06:26.446838 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.446814    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-kube-api-access-qlsdx" (OuterVolumeSpecName: "kube-api-access-qlsdx") pod "94e81d53-5d6e-4e19-8c92-195cfcc2dc43" (UID: "94e81d53-5d6e-4e19-8c92-195cfcc2dc43"). InnerVolumeSpecName "kube-api-access-qlsdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:06:26.447102 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.447075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-kube-api-access-9fn5q" (OuterVolumeSpecName: "kube-api-access-9fn5q") pod "97b9dd2f-5289-4163-836b-50d5c4fc1ea7" (UID: "97b9dd2f-5289-4163-836b-50d5c4fc1ea7"). InnerVolumeSpecName "kube-api-access-9fn5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:06:26.546567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.546515    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fn5q\" (UniqueName: \"kubernetes.io/projected/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-kube-api-access-9fn5q\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:26.546567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.546559    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlsdx\" (UniqueName: \"kubernetes.io/projected/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-kube-api-access-qlsdx\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:26.546567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.546573    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94e81d53-5d6e-4e19-8c92-195cfcc2dc43-plugins-config-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:26.546852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.546589    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b9dd2f-5289-4163-836b-50d5c4fc1ea7-plugins-config-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:26.766459 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.766419    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:26.831076 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.830985    2577 generic.go:356] "Generic (PLEG): container finished" podID="94e81d53-5d6e-4e19-8c92-195cfcc2dc43" containerID="8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375" exitCode=0
Sep 04 22:06:26.831076 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.831030    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"
Sep 04 22:06:26.831318 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.831070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf" event={"ID":"94e81d53-5d6e-4e19-8c92-195cfcc2dc43","Type":"ContainerDied","Data":"8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375"}
Sep 04 22:06:26.831318 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.831123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf" event={"ID":"94e81d53-5d6e-4e19-8c92-195cfcc2dc43","Type":"ContainerDied","Data":"f2bc167012dec8b6130eb04f5e111eae8598b5626015b2c7ce9242a1b03e80fc"}
Sep 04 22:06:26.831318 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.831151    2577 scope.go:117] "RemoveContainer" containerID="8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375"
Sep 04 22:06:26.832474 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.832448    2577 generic.go:356] "Generic (PLEG): container finished" podID="97b9dd2f-5289-4163-836b-50d5c4fc1ea7" containerID="8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a" exitCode=0
Sep 04 22:06:26.832599 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.832480    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"
Sep 04 22:06:26.832599 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.832533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln" event={"ID":"97b9dd2f-5289-4163-836b-50d5c4fc1ea7","Type":"ContainerDied","Data":"8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a"}
Sep 04 22:06:26.832599 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.832581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln" event={"ID":"97b9dd2f-5289-4163-836b-50d5c4fc1ea7","Type":"ContainerDied","Data":"cdfdb8ee8359c3b7dc4662a94adb8e10f0683a6136113f5bb10f334017172662"}
Sep 04 22:06:26.841690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.841670    2577 scope.go:117] "RemoveContainer" containerID="8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375"
Sep 04 22:06:26.841988 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:06:26.841970    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375\": container with ID starting with 8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375 not found: ID does not exist" containerID="8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375"
Sep 04 22:06:26.842028 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.841996    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375"} err="failed to get container status \"8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375\": rpc error: code = NotFound desc = could not find container \"8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375\": container with ID starting with 8b8bfabf40fb10cddec45537e00cebb0e31e43c5cd9fcc3029ec28fd0b74f375 not found: ID does not exist"
Sep 04 22:06:26.842028 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.842011    2577 scope.go:117] "RemoveContainer" containerID="8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a"
Sep 04 22:06:26.850547 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.850529    2577 scope.go:117] "RemoveContainer" containerID="8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a"
Sep 04 22:06:26.850846 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:06:26.850825    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a\": container with ID starting with 8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a not found: ID does not exist" containerID="8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a"
Sep 04 22:06:26.850911 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.850857    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a"} err="failed to get container status \"8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a\": rpc error: code = NotFound desc = could not find container \"8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a\": container with ID starting with 8e326e2077113e06c5340c2b4d7b5c23c9c5bc6c13e52c7e0ff4df729f03aa0a not found: ID does not exist"
Sep 04 22:06:26.862259 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.862239    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"]
Sep 04 22:06:26.867206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.867188    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln"]
Sep 04 22:06:26.875556 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.875511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:26.881418 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.881400    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"]
Sep 04 22:06:26.885621 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.885602    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf"]
Sep 04 22:06:26.993307 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:26.993268    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.289460    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"]
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.290085    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e81d53-5d6e-4e19-8c92-195cfcc2dc43" containerName="payload-pre-processing"
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.290102    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e81d53-5d6e-4e19-8c92-195cfcc2dc43" containerName="payload-pre-processing"
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.290125    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b9dd2f-5289-4163-836b-50d5c4fc1ea7" containerName="payload-processing"
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.290134    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b9dd2f-5289-4163-836b-50d5c4fc1ea7" containerName="payload-processing"
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.290239    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94e81d53-5d6e-4e19-8c92-195cfcc2dc43" containerName="payload-pre-processing"
Sep 04 22:06:27.291662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.290250    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b9dd2f-5289-4163-836b-50d5c4fc1ea7" containerName="payload-processing"
Sep 04 22:06:27.323660 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.305210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.323660 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.307042    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"]
Sep 04 22:06:27.323660 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.311132    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6fda89ac-gw-openshift-default-dockercfg-6lfsz\""
Sep 04 22:06:27.344082 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.344049    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:27.344896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.344874    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 04 22:06:27.344984 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.344923    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 04 22:06:27.455029 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.454989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblm7\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-kube-api-access-bblm7\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455188 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istiod-ca-cert\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455188 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-envoy\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455284 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-token\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455284 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-socket\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455284 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455270    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-credential-socket\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455400 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-podinfo\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455400 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-data\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.455400 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.455339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-certs\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.556685 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblm7\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-kube-api-access-bblm7\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.556685 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istiod-ca-cert\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.556685 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-envoy\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-token\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-socket\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-credential-socket\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-podinfo\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-data\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.556845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-certs\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557376 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.557323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-data\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557417 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.557383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-credential-socket\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.557432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-certs\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.557439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-socket\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.557783 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.557741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istiod-ca-cert\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.559392 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.559369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-envoy\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.559732 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.559712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-podinfo\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.573145 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.573118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-token\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.575024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.575000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblm7\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-kube-api-access-bblm7\") pod \"e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") " pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.625209 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.625171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:27.852157 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.852080    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e81d53-5d6e-4e19-8c92-195cfcc2dc43" path="/var/lib/kubelet/pods/94e81d53-5d6e-4e19-8c92-195cfcc2dc43/volumes"
Sep 04 22:06:27.852456 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.852443    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b9dd2f-5289-4163-836b-50d5c4fc1ea7" path="/var/lib/kubelet/pods/97b9dd2f-5289-4163-836b-50d5c4fc1ea7/volumes"
Sep 04 22:06:27.905447 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.904489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"]
Sep 04 22:06:27.911424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.910972    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:27.911424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.911055    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:27.911424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:27.911094    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:28.095415 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:28.095371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:28.345131 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:28.345099    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 04 22:06:28.345509 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:28.345156    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 04 22:06:28.846740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:28.846704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" event={"ID":"b16ca4f9-0043-47c5-95b4-a77630c2f94e","Type":"ContainerStarted","Data":"c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"}
Sep 04 22:06:28.846902 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:28.846762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" event={"ID":"b16ca4f9-0043-47c5-95b4-a77630c2f94e","Type":"ContainerStarted","Data":"b52c68ab273c9ef343d3169988c86b9c124b34fc997a0cf2f22c62c14b064f70"}
Sep 04 22:06:28.869389 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:28.869342    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podStartSLOduration=1.869325793 podStartE2EDuration="1.869325793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:06:28.867404361 +0000 UTC m=+785.639417370" watchObservedRunningTime="2026-09-04 22:06:28.869325793 +0000 UTC m=+785.641338802"
Sep 04 22:06:29.348420 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.348387    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:29.348847 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.348678    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:29.349460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.349439    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:06:29.626016 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.625928    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:29.630956 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.630926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:29.738441 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.738409    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:29.852822 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.852789    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:29.853779 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:29.853757    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:30.462512 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:30.462479    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:30.564425 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:30.564379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:30.764766 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:30.764735    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:30.824696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:30.824661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:30.937000 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:30.936967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:31.243950 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.243863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:31.330528 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.330495    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:31.551037 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.551013    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:06:31.598691 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598663    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-data\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.598844 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598701    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-podinfo\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.598844 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598729    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-envoy\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.598844 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598775    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjxlj\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-kube-api-access-tjxlj\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.598844 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598794    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-token\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.598844 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598834    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istiod-ca-cert\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.599192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598884    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-socket\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.599192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-certs\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.599192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.598987    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:06:31.599192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599188    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:06:31.599399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599003    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-credential-socket\") pod \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\" (UID: \"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6\") "
Sep 04 22:06:31.599399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599276    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:06:31.599399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599319    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:06:31.599556 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599445    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:06:31.599824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599734    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.599824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599759    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.599824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599772    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.599824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599787    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.599824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.599801    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.601436 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.601413    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:06:31.601436 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.601417    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:06:31.601660 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.601523    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:06:31.601949 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.601923    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-kube-api-access-tjxlj" (OuterVolumeSpecName: "kube-api-access-tjxlj") pod "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" (UID: "97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6"). InnerVolumeSpecName "kube-api-access-tjxlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:06:31.700580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.700548    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjxlj\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-kube-api-access-tjxlj\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.700580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.700579    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.700580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.700591    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.700896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.700604    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:06:31.785242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.785146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:31.867911 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.867885    2577 generic.go:356] "Generic (PLEG): container finished" podID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerID="156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a" exitCode=0
Sep 04 22:06:31.868043 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.867929    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"
Sep 04 22:06:31.868043 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.867967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" event={"ID":"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6","Type":"ContainerDied","Data":"156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a"}
Sep 04 22:06:31.870120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.868360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg" event={"ID":"97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6","Type":"ContainerDied","Data":"6e8c5d84c4b3bd8fd062b1bf6c3212df2a094f2c433fe925800d3e626845f627"}
Sep 04 22:06:31.870120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.868431    2577 scope.go:117] "RemoveContainer" containerID="156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a"
Sep 04 22:06:31.882547 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.882524    2577 scope.go:117] "RemoveContainer" containerID="4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"
Sep 04 22:06:31.891348 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.891326    2577 scope.go:117] "RemoveContainer" containerID="156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a"
Sep 04 22:06:31.891699 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:06:31.891675    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a\": container with ID starting with 156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a not found: ID does not exist" containerID="156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a"
Sep 04 22:06:31.891750 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.891710    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a"} err="failed to get container status \"156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a\": rpc error: code = NotFound desc = could not find container \"156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a\": container with ID starting with 156fea36b59dcabfd83822be3ac956ab8240546c351535e760476a877cddb48a not found: ID does not exist"
Sep 04 22:06:31.891750 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.891729    2577 scope.go:117] "RemoveContainer" containerID="4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"
Sep 04 22:06:31.892005 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:06:31.891984    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334\": container with ID starting with 4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334 not found: ID does not exist" containerID="4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"
Sep 04 22:06:31.892064 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.892015    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334"} err="failed to get container status \"4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334\": rpc error: code = NotFound desc = could not find container \"4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334\": container with ID starting with 4352147b8c7b30a459a4e1a01fe1106a2b7a919fde8775661b36ab7095c41334 not found: ID does not exist"
Sep 04 22:06:31.898868 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.898843    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"]
Sep 04 22:06:31.904325 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:31.904305    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg"]
Sep 04 22:06:32.563064 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:32.563027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:32.740217 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:32.740177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:33.851987 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:33.851953    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" path="/var/lib/kubelet/pods/97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6/volumes"
Sep 04 22:06:45.042697 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.042324    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:55772->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Sep 04 22:06:45.042697 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.042391    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:55772->10.132.0.54:15021: read: connection reset by peer"
Sep 04 22:06:45.522684 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.522649    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:45.971930 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.971824    2577 generic.go:356] "Generic (PLEG): container finished" podID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerID="c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a" exitCode=0
Sep 04 22:06:45.971930 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.971898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" event={"ID":"b16ca4f9-0043-47c5-95b4-a77630c2f94e","Type":"ContainerDied","Data":"c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"}
Sep 04 22:06:45.972311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.972296    2577 scope.go:117] "RemoveContainer" containerID="c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"
Sep 04 22:06:45.973441 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.973411    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:45.973505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.973492    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:45.973544 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:45.973531    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:06:46.979057 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:46.979024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" event={"ID":"b16ca4f9-0043-47c5-95b4-a77630c2f94e","Type":"ContainerStarted","Data":"de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c"}
Sep 04 22:06:47.626346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:47.626305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:47.626538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:47.626468    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:06:47.626538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:47.626514    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 04 22:06:48.626023 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:48.625983    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:06:48.626494 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:48.626043    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 04 22:06:49.626421 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:49.626388    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:06:49.626838 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:49.626457    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 04 22:06:50.626101 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:50.626049    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:06:50.626310 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:50.626133    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 04 22:06:51.625996 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:51.625956    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:06:51.626396 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:51.626033    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 04 22:06:52.629433 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:52.629400    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:52.629974 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:52.629822    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:52.630460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:52.630444    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:06:54.065733 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:54.065690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:06:55.354288 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.354245    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"]
Sep 04 22:06:55.354700 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.354670    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy"
Sep 04 22:06:55.354700 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.354683    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy"
Sep 04 22:06:55.354785 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.354767    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy"
Sep 04 22:06:55.354785 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.354775    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy"
Sep 04 22:06:55.357891 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.357875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:06:55.360043 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.360016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:06:55.360162 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.360055    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:06:55.364548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.364524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"]
Sep 04 22:06:55.439197 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.439159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac5fc7-eb18-461b-b39b-b5f589743987-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5\" (UID: \"15ac5fc7-eb18-461b-b39b-b5f589743987\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:06:55.540694 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.540632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac5fc7-eb18-461b-b39b-b5f589743987-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5\" (UID: \"15ac5fc7-eb18-461b-b39b-b5f589743987\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:06:55.541267 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.541244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac5fc7-eb18-461b-b39b-b5f589743987-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5\" (UID: \"15ac5fc7-eb18-461b-b39b-b5f589743987\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:06:55.670503 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.670424    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:06:55.948289 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:55.948262    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"]
Sep 04 22:06:55.950092 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:06:55.950063    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ac5fc7_eb18_461b_b39b_b5f589743987.slice/crio-a9f2be3388d5bdb281b7aaecf149a94dbdc977a4c78f82caae7e46c7ba54923f WatchSource:0}: Error finding container a9f2be3388d5bdb281b7aaecf149a94dbdc977a4c78f82caae7e46c7ba54923f: Status 404 returned error can't find the container with id a9f2be3388d5bdb281b7aaecf149a94dbdc977a4c78f82caae7e46c7ba54923f
Sep 04 22:06:56.043521 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:56.043428    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5" event={"ID":"15ac5fc7-eb18-461b-b39b-b5f589743987","Type":"ContainerStarted","Data":"a9f2be3388d5bdb281b7aaecf149a94dbdc977a4c78f82caae7e46c7ba54923f"}
Sep 04 22:06:59.062928 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:59.062894    2577 generic.go:356] "Generic (PLEG): container finished" podID="15ac5fc7-eb18-461b-b39b-b5f589743987" containerID="35a5d4969e846a83a33a7400a9b1d0101430a69a03bf4ff9a77f604d5c067686" exitCode=0
Sep 04 22:06:59.063319 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:06:59.062984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5" event={"ID":"15ac5fc7-eb18-461b-b39b-b5f589743987","Type":"ContainerDied","Data":"35a5d4969e846a83a33a7400a9b1d0101430a69a03bf4ff9a77f604d5c067686"}
Sep 04 22:07:00.204378 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:00.204344    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:07:00.391192 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:00.391107    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac5fc7-eb18-461b-b39b-b5f589743987-maas-api-service-ca\") pod \"15ac5fc7-eb18-461b-b39b-b5f589743987\" (UID: \"15ac5fc7-eb18-461b-b39b-b5f589743987\") "
Sep 04 22:07:00.391426 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:00.391403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ac5fc7-eb18-461b-b39b-b5f589743987-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15ac5fc7-eb18-461b-b39b-b5f589743987" (UID: "15ac5fc7-eb18-461b-b39b-b5f589743987"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:07:00.492235 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:00.492199    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac5fc7-eb18-461b-b39b-b5f589743987-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:01.074767 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:01.074738    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"
Sep 04 22:07:01.074963 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:01.074742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5" event={"ID":"15ac5fc7-eb18-461b-b39b-b5f589743987","Type":"ContainerDied","Data":"a9f2be3388d5bdb281b7aaecf149a94dbdc977a4c78f82caae7e46c7ba54923f"}
Sep 04 22:07:01.074963 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:01.074863    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9f2be3388d5bdb281b7aaecf149a94dbdc977a4c78f82caae7e46c7ba54923f"
Sep 04 22:07:01.979519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:01.979482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:02.081521 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.081493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:02.182018 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.181976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:02.218811 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.218771    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"]
Sep 04 22:07:02.224484 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.224447    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6fda89ac-wbjl5"]
Sep 04 22:07:02.280595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.280561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:02.364630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.364598    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"]
Sep 04 22:07:02.364899 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.364874    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" containerID="cri-o://de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c" gracePeriod=30
Sep 04 22:07:02.391509 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.391468    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:02.831326 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:02.831290    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:03.138297 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.138210    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"]
Sep 04 22:07:03.138907 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.138886    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ac5fc7-eb18-461b-b39b-b5f589743987" containerName="revoke-keys"
Sep 04 22:07:03.138970 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.138909    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ac5fc7-eb18-461b-b39b-b5f589743987" containerName="revoke-keys"
Sep 04 22:07:03.138970 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.138928    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy"
Sep 04 22:07:03.138970 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.138937    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fc3bf8-c23b-45f7-a1fa-64bc97dacfb6" containerName="istio-proxy"
Sep 04 22:07:03.139127 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.139031    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ac5fc7-eb18-461b-b39b-b5f589743987" containerName="revoke-keys"
Sep 04 22:07:03.142592 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.142574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.145385 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.145363    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a43b7e35-openshift-default-dockercfg-4rgdm\""
Sep 04 22:07:03.154063 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.154040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"]
Sep 04 22:07:03.166015 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.165983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:03.320911 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.320869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-podinfo\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.320920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-token\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.320951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-socket\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.320981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istiod-ca-cert\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.321017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-certs\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.321037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhbb7\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-kube-api-access-vhbb7\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.321087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-data\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.321164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-envoy\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.321242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.321222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-credential-socket\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.421978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.421872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-data\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.421978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.421937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-envoy\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.421978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.421957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-credential-socket\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-podinfo\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-token\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-socket\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istiod-ca-cert\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-certs\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhbb7\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-kube-api-access-vhbb7\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-data\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422724 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-credential-socket\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422724 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-socket\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.422724 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.422655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-certs\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.423024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.423004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istiod-ca-cert\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.424410 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.424388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-envoy\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.424599 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.424580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-podinfo\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.430242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.430216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-token\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.430382 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.430362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhbb7\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-kube-api-access-vhbb7\") pod \"e2e-ait-a43b7e35-openshift-default-5997467596-4nksj\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") " pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.456054 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.456025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:03.505972 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.505941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:03.736310 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.736280    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"]
Sep 04 22:07:03.737529 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:07:03.737505    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcbd1c8_93fb_462c_a9d4_1fcf9259644f.slice/crio-f83d79500f2ee7f57b5574ca22ae48e78f2dc1b074a6fb82297f9507f92687e3 WatchSource:0}: Error finding container f83d79500f2ee7f57b5574ca22ae48e78f2dc1b074a6fb82297f9507f92687e3: Status 404 returned error can't find the container with id f83d79500f2ee7f57b5574ca22ae48e78f2dc1b074a6fb82297f9507f92687e3
Sep 04 22:07:03.740259 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.740225    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:03.740336 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.740293    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:03.740336 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.740333    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:03.852780 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:03.852747    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ac5fc7-eb18-461b-b39b-b5f589743987" path="/var/lib/kubelet/pods/15ac5fc7-eb18-461b-b39b-b5f589743987/volumes"
Sep 04 22:07:04.093395 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:04.093352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" event={"ID":"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f","Type":"ContainerStarted","Data":"f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"}
Sep 04 22:07:04.093594 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:04.093422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" event={"ID":"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f","Type":"ContainerStarted","Data":"f83d79500f2ee7f57b5574ca22ae48e78f2dc1b074a6fb82297f9507f92687e3"}
Sep 04 22:07:04.114841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:04.114786    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podStartSLOduration=1.114770753 podStartE2EDuration="1.114770753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:07:04.113825803 +0000 UTC m=+820.885838813" watchObservedRunningTime="2026-09-04 22:07:04.114770753 +0000 UTC m=+820.886783762"
Sep 04 22:07:04.456397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:04.456313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:04.461546 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:04.461518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:05.098602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:05.098568    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:05.099740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:05.099721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:05.493829 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:05.493742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:05.591471 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:05.591430    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:06.775340 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:06.775300    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:06.875533 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:06.875494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:07.046796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.046714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:07.266345 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.266315    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:07.370270 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.370179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:07.639384 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.639356    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:07:07.661187 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661159    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-credential-socket\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661231    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-socket\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661257    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bblm7\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-kube-api-access-bblm7\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-data\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-certs\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661446    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-podinfo\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661485    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-token\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661519    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istiod-ca-cert\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661530    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:07.661877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-envoy\") pod \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\" (UID: \"b16ca4f9-0043-47c5-95b4-a77630c2f94e\") "
Sep 04 22:07:07.662986 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661936    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.662986 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.661983    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:07.662986 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.662089    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:07.662986 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.662446    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:07.662986 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.662849    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:07:07.665920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.665700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:07.665920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.665729    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:07:07.666297 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.666144    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-kube-api-access-bblm7" (OuterVolumeSpecName: "kube-api-access-bblm7") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "kube-api-access-bblm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:07:07.668169 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.668135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b16ca4f9-0043-47c5-95b4-a77630c2f94e" (UID: "b16ca4f9-0043-47c5-95b4-a77630c2f94e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:07:07.763218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763181    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763212    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763223    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763230    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763238    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763246    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763255    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bblm7\" (UniqueName: \"kubernetes.io/projected/b16ca4f9-0043-47c5-95b4-a77630c2f94e-kube-api-access-bblm7\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:07.763452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:07.763263    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16ca4f9-0043-47c5-95b4-a77630c2f94e-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:08.120877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.120844    2577 generic.go:356] "Generic (PLEG): container finished" podID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerID="de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c" exitCode=0
Sep 04 22:07:08.121251 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.120893    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"
Sep 04 22:07:08.121251 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.120897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" event={"ID":"b16ca4f9-0043-47c5-95b4-a77630c2f94e","Type":"ContainerDied","Data":"de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c"}
Sep 04 22:07:08.121251 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.120948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" event={"ID":"b16ca4f9-0043-47c5-95b4-a77630c2f94e","Type":"ContainerDied","Data":"b52c68ab273c9ef343d3169988c86b9c124b34fc997a0cf2f22c62c14b064f70"}
Sep 04 22:07:08.121251 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.120972    2577 scope.go:117] "RemoveContainer" containerID="de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c"
Sep 04 22:07:08.130514 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.130488    2577 scope.go:117] "RemoveContainer" containerID="c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"
Sep 04 22:07:08.138519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.138497    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"]
Sep 04 22:07:08.139386 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.139361    2577 scope.go:117] "RemoveContainer" containerID="de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c"
Sep 04 22:07:08.139724 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:07:08.139699    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c\": container with ID starting with de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c not found: ID does not exist" containerID="de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c"
Sep 04 22:07:08.139809 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.139730    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c"} err="failed to get container status \"de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c\": rpc error: code = NotFound desc = could not find container \"de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c\": container with ID starting with de5c2e3ac9aa1071fabfe8cecc633477720dde850b17b411cd5469e788552e7c not found: ID does not exist"
Sep 04 22:07:08.139809 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.139750    2577 scope.go:117] "RemoveContainer" containerID="c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"
Sep 04 22:07:08.140025 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:07:08.140009    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a\": container with ID starting with c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a not found: ID does not exist" containerID="c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"
Sep 04 22:07:08.140067 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.140031    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a"} err="failed to get container status \"c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a\": rpc error: code = NotFound desc = could not find container \"c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a\": container with ID starting with c9704be86506cbb54099b0db71b8493ac1e0d7636477aa66aaa0a43ad917af9a not found: ID does not exist"
Sep 04 22:07:08.141333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.141316    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs"]
Sep 04 22:07:08.630503 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.630466    2577 patch_prober.go:28] interesting pod/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:07:08.630709 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:08.630546    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:07:09.852553 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:09.852520    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" path="/var/lib/kubelet/pods/b16ca4f9-0043-47c5-95b4-a77630c2f94e/volumes"
Sep 04 22:07:20.100652 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.100610    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:07:20.101289 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.100701    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 04 22:07:20.192399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.192319    2577 generic.go:356] "Generic (PLEG): container finished" podID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerID="f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3" exitCode=0
Sep 04 22:07:20.192399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.192359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" event={"ID":"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f","Type":"ContainerDied","Data":"f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"}
Sep 04 22:07:20.192749 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.192735    2577 scope.go:117] "RemoveContainer" containerID="f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"
Sep 04 22:07:20.193764 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.193735    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:20.193828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.193805    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:20.193870 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:20.193836    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:21.203298 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:21.203255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" event={"ID":"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f","Type":"ContainerStarted","Data":"292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1"}
Sep 04 22:07:21.457275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:21.457188    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:21.457438 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:21.457420    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:07:21.457482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:21.457465    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 04 22:07:22.456402 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:22.456366    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:07:22.456828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:22.456422    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 04 22:07:23.456958 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:23.456920    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:07:23.457447 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:23.456985    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 04 22:07:24.079457 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:24.079421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:24.456803 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:24.456708    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:07:24.456803 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:24.456782    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 04 22:07:25.457133 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:25.457094    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:07:25.457553 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:25.457161    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 04 22:07:26.461713 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:26.461676    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:26.462086 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:26.461942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:26.462818 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:26.462802    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:31.313959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.313926    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"]
Sep 04 22:07:31.314345 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.314331    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy"
Sep 04 22:07:31.314345 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.314343    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy"
Sep 04 22:07:31.314416 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.314355    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy"
Sep 04 22:07:31.314416 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.314361    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy"
Sep 04 22:07:31.314482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.314423    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy"
Sep 04 22:07:31.314482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.314433    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16ca4f9-0043-47c5-95b4-a77630c2f94e" containerName="istio-proxy"
Sep 04 22:07:31.322397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.322366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:31.324939 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.324917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:07:31.325073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.324942    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:07:31.325977 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.325941    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"]
Sep 04 22:07:31.382821 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.382789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg\" (UID: \"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:31.483383 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.483348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg\" (UID: \"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:31.484000 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.483978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg\" (UID: \"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:31.636146 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.636065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:31.910121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:31.910091    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"]
Sep 04 22:07:31.910837 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:07:31.910814    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77eb8e8c_ce90_4a2d_921d_6bdfa8872c48.slice/crio-f19774a7daf80ad548d7d44d28a622c2057d4eb2a5d60c0b58c6134ab62a9da5 WatchSource:0}: Error finding container f19774a7daf80ad548d7d44d28a622c2057d4eb2a5d60c0b58c6134ab62a9da5: Status 404 returned error can't find the container with id f19774a7daf80ad548d7d44d28a622c2057d4eb2a5d60c0b58c6134ab62a9da5
Sep 04 22:07:32.269913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:32.269882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg" event={"ID":"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48","Type":"ContainerStarted","Data":"3c0ed5b075da99df5ac280ec30025d2c01913ac9119d85375fd70632ee42d037"}
Sep 04 22:07:32.270119 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:32.269932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg" event={"ID":"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48","Type":"ContainerStarted","Data":"f19774a7daf80ad548d7d44d28a622c2057d4eb2a5d60c0b58c6134ab62a9da5"}
Sep 04 22:07:32.286607 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:32.286558    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg" podStartSLOduration=1.286542471 podStartE2EDuration="1.286542471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:07:32.285533087 +0000 UTC m=+849.057546098" watchObservedRunningTime="2026-09-04 22:07:32.286542471 +0000 UTC m=+849.058555511"
Sep 04 22:07:33.276573 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:33.276542    2577 generic.go:356] "Generic (PLEG): container finished" podID="77eb8e8c-ce90-4a2d-921d-6bdfa8872c48" containerID="3c0ed5b075da99df5ac280ec30025d2c01913ac9119d85375fd70632ee42d037" exitCode=0
Sep 04 22:07:33.276961 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:33.276597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg" event={"ID":"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48","Type":"ContainerDied","Data":"3c0ed5b075da99df5ac280ec30025d2c01913ac9119d85375fd70632ee42d037"}
Sep 04 22:07:34.421463 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:34.421438    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:34.512500 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:34.512464    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48-maas-api-service-ca\") pod \"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48\" (UID: \"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48\") "
Sep 04 22:07:34.512835 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:34.512814    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77eb8e8c-ce90-4a2d-921d-6bdfa8872c48" (UID: "77eb8e8c-ce90-4a2d-921d-6bdfa8872c48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:07:34.512973 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:34.512954    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:35.289029 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:35.289000    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"
Sep 04 22:07:35.289201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:35.288999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg" event={"ID":"77eb8e8c-ce90-4a2d-921d-6bdfa8872c48","Type":"ContainerDied","Data":"f19774a7daf80ad548d7d44d28a622c2057d4eb2a5d60c0b58c6134ab62a9da5"}
Sep 04 22:07:35.289201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:35.289150    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f19774a7daf80ad548d7d44d28a622c2057d4eb2a5d60c0b58c6134ab62a9da5"
Sep 04 22:07:37.208943 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.208906    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:37.307527 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.307492    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:37.409646 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.409611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:37.460513 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.460432    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"]
Sep 04 22:07:37.467628 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.467600    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a43b7e35-mcckg"]
Sep 04 22:07:37.493247 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.493207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:37.851486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:37.851452    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77eb8e8c-ce90-4a2d-921d-6bdfa8872c48" path="/var/lib/kubelet/pods/77eb8e8c-ce90-4a2d-921d-6bdfa8872c48/volumes"
Sep 04 22:07:38.646366 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:38.646321    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"]
Sep 04 22:07:38.646876 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:38.646553    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" containerID="cri-o://292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1" gracePeriod=30
Sep 04 22:07:38.679940 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:38.679908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:39.183145 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.183115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:39.469352 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.469272    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"]
Sep 04 22:07:39.469725 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.469712    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77eb8e8c-ce90-4a2d-921d-6bdfa8872c48" containerName="revoke-keys"
Sep 04 22:07:39.469775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.469728    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77eb8e8c-ce90-4a2d-921d-6bdfa8872c48" containerName="revoke-keys"
Sep 04 22:07:39.469815 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.469810    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77eb8e8c-ce90-4a2d-921d-6bdfa8872c48" containerName="revoke-keys"
Sep 04 22:07:39.473437 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.473412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.477263 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.477237    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5d398f01-openshift-default-dockercfg-p7c2m\""
Sep 04 22:07:39.496100 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.496078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"]
Sep 04 22:07:39.516695 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.516661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:39.559217 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-envoy\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-certs\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-socket\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-token\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8f7798c-a9f3-420f-9aca-a37c13892efa-istiod-ca-cert\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-podinfo\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-data\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-credential-socket\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.559731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.559576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g64ds\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-kube-api-access-g64ds\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.660622 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-envoy\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-certs\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-socket\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-token\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8f7798c-a9f3-420f-9aca-a37c13892efa-istiod-ca-cert\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-podinfo\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-data\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-credential-socket\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.660834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g64ds\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-kube-api-access-g64ds\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661530 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.661095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-certs\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661530 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.661360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-data\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661530 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.661373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-socket\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661530 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.661500    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-credential-socket\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.661530 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.661521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8f7798c-a9f3-420f-9aca-a37c13892efa-istiod-ca-cert\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.663387 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.663365    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-envoy\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.663713 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.663691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-podinfo\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.669662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.669625    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-token\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.670104 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.670082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g64ds\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-kube-api-access-g64ds\") pod \"e2e-derive-5d398f01-openshift-default-899bff88-6pvt5\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") " pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:39.784172 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:39.784136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:40.070159 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.070132    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"]
Sep 04 22:07:40.072532 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:07:40.072502    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f7798c_a9f3_420f_9aca_a37c13892efa.slice/crio-e512f205b387769ef71a4606a21582814faf218bba156e9a49d8dab03034a166 WatchSource:0}: Error finding container e512f205b387769ef71a4606a21582814faf218bba156e9a49d8dab03034a166: Status 404 returned error can't find the container with id e512f205b387769ef71a4606a21582814faf218bba156e9a49d8dab03034a166
Sep 04 22:07:40.074819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.074788    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:40.074896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.074852    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:40.074896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.074880    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:40.285009 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.284970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:40.319796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.319692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" event={"ID":"a8f7798c-a9f3-420f-9aca-a37c13892efa","Type":"ContainerStarted","Data":"39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"}
Sep 04 22:07:40.319796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.319793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" event={"ID":"a8f7798c-a9f3-420f-9aca-a37c13892efa","Type":"ContainerStarted","Data":"e512f205b387769ef71a4606a21582814faf218bba156e9a49d8dab03034a166"}
Sep 04 22:07:40.351749 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.351702    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podStartSLOduration=1.351683177 podStartE2EDuration="1.351683177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:07:40.348044129 +0000 UTC m=+857.120057165" watchObservedRunningTime="2026-09-04 22:07:40.351683177 +0000 UTC m=+857.123696188"
Sep 04 22:07:40.785022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:40.784988    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:41.464850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:41.464809    2577 patch_prober.go:28] interesting pod/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:07:41.464995 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:41.464880    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:07:41.783190 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:41.783153    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:41.790256 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:41.790231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:41.881402 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:41.881367    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:42.331565 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:42.331534    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:42.332568 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:42.332543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:43.100142 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:43.100106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:43.195435 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:43.195400    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:43.299468 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:43.299436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:43.649177 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:43.649134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:43.741990 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:43.741955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:43.928743 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:43.928719    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:44.005489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-token\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005503    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-data\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istiod-ca-cert\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005618    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-podinfo\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005671    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-certs\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005904 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005695    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhbb7\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-kube-api-access-vhbb7\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005904 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005764    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-credential-socket\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005904 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005814    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-envoy\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.005904 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005849    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-socket\") pod \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\" (UID: \"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f\") "
Sep 04 22:07:44.006117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.005924    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:44.006117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006081    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:07:44.006117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006069    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:44.006272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006132    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:44.006331 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006289    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:44.006331 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006304    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.006331 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006324    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.006491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006342    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.006491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.006357    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.007937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.007915    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:07:44.008105 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.008087    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:07:44.008333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.008308    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:07:44.008333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.008323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-kube-api-access-vhbb7" (OuterVolumeSpecName: "kube-api-access-vhbb7") pod "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" (UID: "6dcbd1c8-93fb-462c-a9d4-1fcf9259644f"). InnerVolumeSpecName "kube-api-access-vhbb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:07:44.107063 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.107024    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.107063 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.107057    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhbb7\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-kube-api-access-vhbb7\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.107449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.107072    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.107449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.107084    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.107449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.107094    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:07:44.342695 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.342663    2577 generic.go:356] "Generic (PLEG): container finished" podID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerID="292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1" exitCode=0
Sep 04 22:07:44.342695 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.342695    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"
Sep 04 22:07:44.342912 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.342745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" event={"ID":"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f","Type":"ContainerDied","Data":"292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1"}
Sep 04 22:07:44.342912 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.342793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj" event={"ID":"6dcbd1c8-93fb-462c-a9d4-1fcf9259644f","Type":"ContainerDied","Data":"f83d79500f2ee7f57b5574ca22ae48e78f2dc1b074a6fb82297f9507f92687e3"}
Sep 04 22:07:44.342912 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.342815    2577 scope.go:117] "RemoveContainer" containerID="292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1"
Sep 04 22:07:44.352949 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.352933    2577 scope.go:117] "RemoveContainer" containerID="f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"
Sep 04 22:07:44.366747 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.366725    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"]
Sep 04 22:07:44.366823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.366760    2577 scope.go:117] "RemoveContainer" containerID="292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1"
Sep 04 22:07:44.367062 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:07:44.367043    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1\": container with ID starting with 292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1 not found: ID does not exist" containerID="292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1"
Sep 04 22:07:44.367106 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.367070    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1"} err="failed to get container status \"292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1\": rpc error: code = NotFound desc = could not find container \"292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1\": container with ID starting with 292416c5e70dee700ba1c076cace6ad2edeb9552f2429cea8c524bf81f3da3c1 not found: ID does not exist"
Sep 04 22:07:44.367106 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.367089    2577 scope.go:117] "RemoveContainer" containerID="f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"
Sep 04 22:07:44.367330 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:07:44.367312    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3\": container with ID starting with f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3 not found: ID does not exist" containerID="f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"
Sep 04 22:07:44.367374 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.367336    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3"} err="failed to get container status \"f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3\": rpc error: code = NotFound desc = could not find container \"f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3\": container with ID starting with f3b5563eefba0e66e120f09ef8f6774386d58a6eaf2d1d7dfc2aa9c754cbf3c3 not found: ID does not exist"
Sep 04 22:07:44.373265 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:44.373243    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj"]
Sep 04 22:07:45.852000 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:45.851970    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" path="/var/lib/kubelet/pods/6dcbd1c8-93fb-462c-a9d4-1fcf9259644f/volumes"
Sep 04 22:07:53.797343 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:53.797282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:07:56.408790 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:56.408712    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerID="39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a" exitCode=0
Sep 04 22:07:56.409180 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:56.408788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" event={"ID":"a8f7798c-a9f3-420f-9aca-a37c13892efa","Type":"ContainerDied","Data":"39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"}
Sep 04 22:07:56.409221 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:56.409201    2577 scope.go:117] "RemoveContainer" containerID="39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"
Sep 04 22:07:56.410280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:56.410254    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:56.410335 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:56.410322    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:56.410374 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:56.410356    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:07:57.331829 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:57.331785    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:57.418470 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:57.418430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" event={"ID":"a8f7798c-a9f3-420f-9aca-a37c13892efa","Type":"ContainerStarted","Data":"d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4"}
Sep 04 22:07:57.785118 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:57.785084    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:07:57.786373 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:57.786349    2577 patch_prober.go:28] interesting pod/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:07:57.786489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:57.786394    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 04 22:07:58.785407 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:58.785369    2577 patch_prober.go:28] interesting pod/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:07:58.785816 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:58.785428    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 04 22:07:59.785077 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:59.785039    2577 patch_prober.go:28] interesting pod/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:07:59.785254 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:07:59.785101    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 04 22:08:00.785003 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:00.784970    2577 patch_prober.go:28] interesting pod/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:08:00.785374 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:00.785021    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 04 22:08:01.784978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:01.784941    2577 patch_prober.go:28] interesting pod/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:08:01.785178 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:01.784998    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 04 22:08:02.789457 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:02.789426    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:08:02.789913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:02.789880    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:08:02.790563 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:02.790546    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:08:04.944450 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:04.944412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:06.586750 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.586720    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"]
Sep 04 22:08:06.587128 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.587116    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy"
Sep 04 22:08:06.587172 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.587130    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy"
Sep 04 22:08:06.587172 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.587148    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy"
Sep 04 22:08:06.587172 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.587153    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy"
Sep 04 22:08:06.587311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.587216    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy"
Sep 04 22:08:06.587311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.587228    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dcbd1c8-93fb-462c-a9d4-1fcf9259644f" containerName="istio-proxy"
Sep 04 22:08:06.589509 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.589490    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:06.592078 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.592056    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:08:06.592399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.592382    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:08:06.601532 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.601510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"]
Sep 04 22:08:06.627875 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.627842    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54f5866-297c-49cf-8e79-c8bf824629b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q\" (UID: \"f54f5866-297c-49cf-8e79-c8bf824629b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:06.729142 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.729109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54f5866-297c-49cf-8e79-c8bf824629b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q\" (UID: \"f54f5866-297c-49cf-8e79-c8bf824629b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:06.729710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.729691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54f5866-297c-49cf-8e79-c8bf824629b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q\" (UID: \"f54f5866-297c-49cf-8e79-c8bf824629b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:06.900359 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:06.900277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:07.173206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:07.173177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"]
Sep 04 22:08:07.174774 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:08:07.174750    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54f5866_297c_49cf_8e79_c8bf824629b4.slice/crio-861437cc7f73caa4f5c06141dc5d755dbd7706122d33524c995f46bedf7e436e WatchSource:0}: Error finding container 861437cc7f73caa4f5c06141dc5d755dbd7706122d33524c995f46bedf7e436e: Status 404 returned error can't find the container with id 861437cc7f73caa4f5c06141dc5d755dbd7706122d33524c995f46bedf7e436e
Sep 04 22:08:07.473331 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:07.473239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q" event={"ID":"f54f5866-297c-49cf-8e79-c8bf824629b4","Type":"ContainerStarted","Data":"861437cc7f73caa4f5c06141dc5d755dbd7706122d33524c995f46bedf7e436e"}
Sep 04 22:08:08.479695 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:08.479662    2577 generic.go:356] "Generic (PLEG): container finished" podID="f54f5866-297c-49cf-8e79-c8bf824629b4" containerID="bdea1e2505229abef7251c119a85185308a8426e40e3f896a009714a8d361542" exitCode=0
Sep 04 22:08:08.480087 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:08.479711    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q" event={"ID":"f54f5866-297c-49cf-8e79-c8bf824629b4","Type":"ContainerDied","Data":"bdea1e2505229abef7251c119a85185308a8426e40e3f896a009714a8d361542"}
Sep 04 22:08:09.623790 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:09.623762    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:09.659757 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:09.659730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54f5866-297c-49cf-8e79-c8bf824629b4-maas-api-service-ca\") pod \"f54f5866-297c-49cf-8e79-c8bf824629b4\" (UID: \"f54f5866-297c-49cf-8e79-c8bf824629b4\") "
Sep 04 22:08:09.660090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:09.660063    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54f5866-297c-49cf-8e79-c8bf824629b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f54f5866-297c-49cf-8e79-c8bf824629b4" (UID: "f54f5866-297c-49cf-8e79-c8bf824629b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:08:09.760411 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:09.760378    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54f5866-297c-49cf-8e79-c8bf824629b4-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:10.492177 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:10.492153    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"
Sep 04 22:08:10.492332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:10.492193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q" event={"ID":"f54f5866-297c-49cf-8e79-c8bf824629b4","Type":"ContainerDied","Data":"861437cc7f73caa4f5c06141dc5d755dbd7706122d33524c995f46bedf7e436e"}
Sep 04 22:08:10.492332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:10.492237    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="861437cc7f73caa4f5c06141dc5d755dbd7706122d33524c995f46bedf7e436e"
Sep 04 22:08:13.653553 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:13.653520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:13.923556 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:13.923460    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"]
Sep 04 22:08:13.924457 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:13.924432    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5d398f01-zrd7q"]
Sep 04 22:08:14.064868 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:14.064829    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"]
Sep 04 22:08:14.065178 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:14.065147    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" containerID="cri-o://d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4" gracePeriod=30
Sep 04 22:08:15.372972 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:15.372933    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:15.850991 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:15.850954    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f54f5866-297c-49cf-8e79-c8bf824629b4" path="/var/lib/kubelet/pods/f54f5866-297c-49cf-8e79-c8bf824629b4/volumes"
Sep 04 22:08:16.455813 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:16.455781    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:17.792402 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:17.792362    2577 patch_prober.go:28] interesting pod/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 04 22:08:17.792780 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:17.792449    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:08:19.317854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.317830    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:08:19.450206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450116    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-podinfo\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450176    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-socket\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-token\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450228    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-credential-socket\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450252    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-envoy\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450269    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8f7798c-a9f3-420f-9aca-a37c13892efa-istiod-ca-cert\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450304    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-data\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-certs\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450402    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g64ds\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-kube-api-access-g64ds\") pod \"a8f7798c-a9f3-420f-9aca-a37c13892efa\" (UID: \"a8f7798c-a9f3-420f-9aca-a37c13892efa\") "
Sep 04 22:08:19.450841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450552    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:08:19.450841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450566    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:08:19.450841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450788    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:08:19.450841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450809    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.450841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450821    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:08:19.451089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.450831    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.451089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.451007    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f7798c-a9f3-420f-9aca-a37c13892efa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:08:19.452477 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.452454    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:08:19.452575 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.452485    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:08:19.452796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.452781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:08:19.452882 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.452867    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-kube-api-access-g64ds" (OuterVolumeSpecName: "kube-api-access-g64ds") pod "a8f7798c-a9f3-420f-9aca-a37c13892efa" (UID: "a8f7798c-a9f3-420f-9aca-a37c13892efa"). InnerVolumeSpecName "kube-api-access-g64ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:08:19.544517 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.544479    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerID="d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4" exitCode=0
Sep 04 22:08:19.544517 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.544521    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"
Sep 04 22:08:19.544756 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.544563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" event={"ID":"a8f7798c-a9f3-420f-9aca-a37c13892efa","Type":"ContainerDied","Data":"d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4"}
Sep 04 22:08:19.544756 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.544620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5" event={"ID":"a8f7798c-a9f3-420f-9aca-a37c13892efa","Type":"ContainerDied","Data":"e512f205b387769ef71a4606a21582814faf218bba156e9a49d8dab03034a166"}
Sep 04 22:08:19.544756 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.544659    2577 scope.go:117] "RemoveContainer" containerID="d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4"
Sep 04 22:08:19.551303 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551282    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.551303 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551303    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.551454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551312    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.551454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551320    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8f7798c-a9f3-420f-9aca-a37c13892efa-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.551454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551330    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.551454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551338    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8f7798c-a9f3-420f-9aca-a37c13892efa-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.551454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.551345    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g64ds\" (UniqueName: \"kubernetes.io/projected/a8f7798c-a9f3-420f-9aca-a37c13892efa-kube-api-access-g64ds\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:19.554400 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.554381    2577 scope.go:117] "RemoveContainer" containerID="39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"
Sep 04 22:08:19.562699 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.562676    2577 scope.go:117] "RemoveContainer" containerID="d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4"
Sep 04 22:08:19.562987 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:08:19.562967    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4\": container with ID starting with d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4 not found: ID does not exist" containerID="d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4"
Sep 04 22:08:19.563037 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.562995    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4"} err="failed to get container status \"d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4\": rpc error: code = NotFound desc = could not find container \"d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4\": container with ID starting with d438d8f540b191668bfb4f764311cc6b6c080b7689cc687b937c3ae96b7f10b4 not found: ID does not exist"
Sep 04 22:08:19.563037 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.563012    2577 scope.go:117] "RemoveContainer" containerID="39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"
Sep 04 22:08:19.563315 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:08:19.563290    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a\": container with ID starting with 39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a not found: ID does not exist" containerID="39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"
Sep 04 22:08:19.563403 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.563323    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a"} err="failed to get container status \"39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a\": rpc error: code = NotFound desc = could not find container \"39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a\": container with ID starting with 39dc65002ec87529a9b0aab997c089c3dc3c37ee408023fe5bb9b26aee26594a not found: ID does not exist"
Sep 04 22:08:19.566054 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.566034    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"]
Sep 04 22:08:19.569310 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.569287    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5"]
Sep 04 22:08:19.859199 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:19.859165    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" path="/var/lib/kubelet/pods/a8f7798c-a9f3-420f-9aca-a37c13892efa/volumes"
Sep 04 22:08:22.460447 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:22.460403    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:22.561329 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:22.561294    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:22.713077 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:22.712983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:22.810098 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:22.810053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:23.253078 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:23.253046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:23.700471 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:23.700390    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:08:23.703271 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:23.703249    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:08:49.207056 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:49.207020    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:52.120827 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:52.120791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:53.043198 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.043157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:53.114167 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114132    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"]
Sep 04 22:08:53.114546 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114533    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy"
Sep 04 22:08:53.114595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114548    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy"
Sep 04 22:08:53.114595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114555    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy"
Sep 04 22:08:53.114595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114561    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy"
Sep 04 22:08:53.114595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114572    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54f5866-297c-49cf-8e79-c8bf824629b4" containerName="revoke-keys"
Sep 04 22:08:53.114595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114578    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54f5866-297c-49cf-8e79-c8bf824629b4" containerName="revoke-keys"
Sep 04 22:08:53.114793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114659    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy"
Sep 04 22:08:53.114793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.114668    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54f5866-297c-49cf-8e79-c8bf824629b4" containerName="revoke-keys"
Sep 04 22:08:53.118020 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.117985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:53.120552 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.120427    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:08:53.120552 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.120450    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:08:53.125176 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.125109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"]
Sep 04 22:08:53.160263 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.160227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8\" (UID: \"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:53.206510 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.206471    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:53.261069 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.261031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8\" (UID: \"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:53.261671 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.261633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8\" (UID: \"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:53.432336 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.432253    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:53.704542 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.704514    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"]
Sep 04 22:08:53.707740 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:08:53.707699    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ba6cb1_d7d6_4918_8037_b0ae1ad0b05a.slice/crio-a5eea619c52294bd19e921eba43cfe93a34345212d1e53daca178cdcf7887960 WatchSource:0}: Error finding container a5eea619c52294bd19e921eba43cfe93a34345212d1e53daca178cdcf7887960: Status 404 returned error can't find the container with id a5eea619c52294bd19e921eba43cfe93a34345212d1e53daca178cdcf7887960
Sep 04 22:08:53.727852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:53.727819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8" event={"ID":"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a","Type":"ContainerStarted","Data":"a5eea619c52294bd19e921eba43cfe93a34345212d1e53daca178cdcf7887960"}
Sep 04 22:08:54.735153 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:54.735065    2577 generic.go:356] "Generic (PLEG): container finished" podID="40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a" containerID="aabdec4b1b61e448c3a894e050c2a3c26f34d4ab831e77633ad42e1ec388b1f3" exitCode=0
Sep 04 22:08:54.735614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:54.735156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8" event={"ID":"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a","Type":"ContainerDied","Data":"aabdec4b1b61e448c3a894e050c2a3c26f34d4ab831e77633ad42e1ec388b1f3"}
Sep 04 22:08:55.563143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.563111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:55.630537 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.630495    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:55.719259 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.719221    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:55.828190 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.828095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:08:55.884394 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.884364    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:55.985658 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.985609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a-maas-api-service-ca\") pod \"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a\" (UID: \"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a\") "
Sep 04 22:08:55.985979 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.985957    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a" (UID: "40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:08:55.986088 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:55.986076    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:08:56.747057 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:56.747025    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"
Sep 04 22:08:56.747057 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:56.747034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8" event={"ID":"40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a","Type":"ContainerDied","Data":"a5eea619c52294bd19e921eba43cfe93a34345212d1e53daca178cdcf7887960"}
Sep 04 22:08:56.747272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:08:56.747080    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5eea619c52294bd19e921eba43cfe93a34345212d1e53daca178cdcf7887960"
Sep 04 22:09:03.611173 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.611127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:03.689287 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.689247    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:03.785727 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.785688    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:03.807103 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.807073    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"]
Sep 04 22:09:03.813230 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.813204    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a5e1c2-85ws8"]
Sep 04 22:09:03.851489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.851458    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a" path="/var/lib/kubelet/pods/40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a/volumes"
Sep 04 22:09:03.856126 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:03.856101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:04.202616 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:04.202581    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:10.330014 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.329975    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:10.395240 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.395163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:10.564677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.564647    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"]
Sep 04 22:09:10.564885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.564855    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy" containerID="cri-o://feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f" gracePeriod=30
Sep 04 22:09:10.586175 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.586111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:10.936780 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.936699    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"]
Sep 04 22:09:10.937100 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.937088    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a" containerName="revoke-keys"
Sep 04 22:09:10.937148 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.937103    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a" containerName="revoke-keys"
Sep 04 22:09:10.937191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.937168    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ba6cb1-d7d6-4918-8037-b0ae1ad0b05a" containerName="revoke-keys"
Sep 04 22:09:10.937191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.937178    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f7798c-a9f3-420f-9aca-a37c13892efa" containerName="istio-proxy"
Sep 04 22:09:10.940472 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.940454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:10.942682 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.942663    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:09:10.942789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.942683    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:09:10.948655 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:10.948612    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"]
Sep 04 22:09:11.031971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.031932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60112fb4-0c5f-43b7-926b-cb1992d78b6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9\" (UID: \"60112fb4-0c5f-43b7-926b-cb1992d78b6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:11.040543 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.040500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:11.132878 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.132846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60112fb4-0c5f-43b7-926b-cb1992d78b6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9\" (UID: \"60112fb4-0c5f-43b7-926b-cb1992d78b6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:11.133448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.133430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60112fb4-0c5f-43b7-926b-cb1992d78b6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9\" (UID: \"60112fb4-0c5f-43b7-926b-cb1992d78b6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:11.252079 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.251996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:11.532200 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.532146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"]
Sep 04 22:09:11.534740 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:09:11.534713    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60112fb4_0c5f_43b7_926b_cb1992d78b6f.slice/crio-7e954419cc9a9d56bc54c72daf94539f1841fff3ed1b6e69bffa973acfd48d41 WatchSource:0}: Error finding container 7e954419cc9a9d56bc54c72daf94539f1841fff3ed1b6e69bffa973acfd48d41: Status 404 returned error can't find the container with id 7e954419cc9a9d56bc54c72daf94539f1841fff3ed1b6e69bffa973acfd48d41
Sep 04 22:09:11.697402 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.697363    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:11.833204 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.833175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9" event={"ID":"60112fb4-0c5f-43b7-926b-cb1992d78b6f","Type":"ContainerStarted","Data":"b1696e624d39d50a43c5506984e5cc275929c10572751bf2a89f750144ad48f5"}
Sep 04 22:09:11.833340 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.833228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9" event={"ID":"60112fb4-0c5f-43b7-926b-cb1992d78b6f","Type":"ContainerStarted","Data":"7e954419cc9a9d56bc54c72daf94539f1841fff3ed1b6e69bffa973acfd48d41"}
Sep 04 22:09:11.852987 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:11.852943    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9" podStartSLOduration=1.852925395 podStartE2EDuration="1.852925395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:11.852701005 +0000 UTC m=+948.624714016" watchObservedRunningTime="2026-09-04 22:09:11.852925395 +0000 UTC m=+948.624938406"
Sep 04 22:09:12.839583 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:12.839546    2577 generic.go:356] "Generic (PLEG): container finished" podID="60112fb4-0c5f-43b7-926b-cb1992d78b6f" containerID="b1696e624d39d50a43c5506984e5cc275929c10572751bf2a89f750144ad48f5" exitCode=0
Sep 04 22:09:12.839996 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:12.839600    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9" event={"ID":"60112fb4-0c5f-43b7-926b-cb1992d78b6f","Type":"ContainerDied","Data":"b1696e624d39d50a43c5506984e5cc275929c10572751bf2a89f750144ad48f5"}
Sep 04 22:09:13.989389 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:13.989363    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:14.160832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:14.160745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60112fb4-0c5f-43b7-926b-cb1992d78b6f-maas-api-service-ca\") pod \"60112fb4-0c5f-43b7-926b-cb1992d78b6f\" (UID: \"60112fb4-0c5f-43b7-926b-cb1992d78b6f\") "
Sep 04 22:09:14.161071 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:14.161049    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60112fb4-0c5f-43b7-926b-cb1992d78b6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60112fb4-0c5f-43b7-926b-cb1992d78b6f" (UID: "60112fb4-0c5f-43b7-926b-cb1992d78b6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:09:14.262227 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:14.262201    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60112fb4-0c5f-43b7-926b-cb1992d78b6f-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:14.860324 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:14.860290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9" event={"ID":"60112fb4-0c5f-43b7-926b-cb1992d78b6f","Type":"ContainerDied","Data":"7e954419cc9a9d56bc54c72daf94539f1841fff3ed1b6e69bffa973acfd48d41"}
Sep 04 22:09:14.860561 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:14.860339    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e954419cc9a9d56bc54c72daf94539f1841fff3ed1b6e69bffa973acfd48d41"
Sep 04 22:09:14.860561 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:14.860298    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"
Sep 04 22:09:15.819548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.819525    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:09:15.867625 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.867546    2577 generic.go:356] "Generic (PLEG): container finished" podID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerID="feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f" exitCode=0
Sep 04 22:09:15.867625 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.867592    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"
Sep 04 22:09:15.867819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.867616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" event={"ID":"47953eae-eeab-4bb3-9f16-59921ad3c77d","Type":"ContainerDied","Data":"feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f"}
Sep 04 22:09:15.867819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.867684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb" event={"ID":"47953eae-eeab-4bb3-9f16-59921ad3c77d","Type":"ContainerDied","Data":"1039377d966aa7e1e4ed05e32640040d4fc017b43a0adad63604a197ea9c50da"}
Sep 04 22:09:15.867819 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.867714    2577 scope.go:117] "RemoveContainer" containerID="feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f"
Sep 04 22:09:15.876681 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.876653    2577 scope.go:117] "RemoveContainer" containerID="34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"
Sep 04 22:09:15.884677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.884660    2577 scope.go:117] "RemoveContainer" containerID="feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f"
Sep 04 22:09:15.884932 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:09:15.884911    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f\": container with ID starting with feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f not found: ID does not exist" containerID="feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f"
Sep 04 22:09:15.884990 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.884940    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f"} err="failed to get container status \"feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f\": rpc error: code = NotFound desc = could not find container \"feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f\": container with ID starting with feb382add06e460f05a5fe7c1d94afc2f9846d572d1e558fbb9fc349525ddd1f not found: ID does not exist"
Sep 04 22:09:15.884990 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.884957    2577 scope.go:117] "RemoveContainer" containerID="34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"
Sep 04 22:09:15.885189 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:09:15.885173    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8\": container with ID starting with 34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8 not found: ID does not exist" containerID="34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"
Sep 04 22:09:15.885233 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.885194    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8"} err="failed to get container status \"34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8\": rpc error: code = NotFound desc = could not find container \"34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8\": container with ID starting with 34032676c0b37d5fa3669765b875b75b509254b9d5c4793a9fa597a9ac11c9b8 not found: ID does not exist"
Sep 04 22:09:15.979467 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979433    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-credential-socket\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979467 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979471    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-data\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979707 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47953eae-eeab-4bb3-9f16-59921ad3c77d-istiod-ca-cert\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979707 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979568    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-socket\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979707 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979606    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-token\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979707 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-podinfo\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979703    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:15.979921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979728    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-certs\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979777    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-data" (OuterVolumeSpecName: "istio-data") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:15.979921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979793    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-envoy\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.979921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979827    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq4ks\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-kube-api-access-gq4ks\") pod \"47953eae-eeab-4bb3-9f16-59921ad3c77d\" (UID: \"47953eae-eeab-4bb3-9f16-59921ad3c77d\") "
Sep 04 22:09:15.980185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979957    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:15.980185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.979974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:15.980185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.980127    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:15.980185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.980148    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:15.980185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.980162    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:15.980185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.980174    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:15.980482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.980356    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47953eae-eeab-4bb3-9f16-59921ad3c77d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:09:15.982047 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.982011    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-token" (OuterVolumeSpecName: "istio-token") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:09:15.982047 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.982026    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-kube-api-access-gq4ks" (OuterVolumeSpecName: "kube-api-access-gq4ks") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "kube-api-access-gq4ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:09:15.982227 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.982062    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:09:15.982285 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:15.982243    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47953eae-eeab-4bb3-9f16-59921ad3c77d" (UID: "47953eae-eeab-4bb3-9f16-59921ad3c77d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:16.080771 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.080739    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq4ks\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-kube-api-access-gq4ks\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:16.080771 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.080765    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47953eae-eeab-4bb3-9f16-59921ad3c77d-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:16.080771 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.080778    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:16.080985 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.080785    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:16.080985 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.080793    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47953eae-eeab-4bb3-9f16-59921ad3c77d-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:16.189848 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.189817    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"]
Sep 04 22:09:16.193556 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:16.193532    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb"]
Sep 04 22:09:17.381009 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:17.380979    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:17.442115 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:17.442079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:17.524444 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:17.524408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:17.622690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:17.622655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:17.851521 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:17.851489    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" path="/var/lib/kubelet/pods/47953eae-eeab-4bb3-9f16-59921ad3c77d/volumes"
Sep 04 22:09:21.434191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.434137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:21.509419 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.509383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:21.585379 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.585344    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:21.650134 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.650101    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"]
Sep 04 22:09:21.651945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.651920    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d4ad2d-sq5q9"]
Sep 04 22:09:21.665965 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.665940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:21.851213 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:21.851183    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60112fb4-0c5f-43b7-926b-cb1992d78b6f" path="/var/lib/kubelet/pods/60112fb4-0c5f-43b7-926b-cb1992d78b6f/volumes"
Sep 04 22:09:22.025294 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:22.025263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:27.907435 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:27.907396    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:27.973504 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:27.973474    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:28.097189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:28.097149    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:28.178906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:28.178826    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"]
Sep 04 22:09:28.179061 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:28.179041    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" containerID="cri-o://9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6" gracePeriod=30
Sep 04 22:09:28.234875 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:28.234841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:28.776130 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:28.776097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:28.922067 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:28.922026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:29.046214 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046123    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"]
Sep 04 22:09:29.046552 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046538    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy"
Sep 04 22:09:29.046620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046554    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy"
Sep 04 22:09:29.046620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046571    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy"
Sep 04 22:09:29.046620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046578    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy"
Sep 04 22:09:29.046620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046592    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60112fb4-0c5f-43b7-926b-cb1992d78b6f" containerName="revoke-keys"
Sep 04 22:09:29.046620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046598    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="60112fb4-0c5f-43b7-926b-cb1992d78b6f" containerName="revoke-keys"
Sep 04 22:09:29.046932 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046678    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="60112fb4-0c5f-43b7-926b-cb1992d78b6f" containerName="revoke-keys"
Sep 04 22:09:29.046932 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046691    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy"
Sep 04 22:09:29.046932 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.046697    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="47953eae-eeab-4bb3-9f16-59921ad3c77d" containerName="istio-proxy"
Sep 04 22:09:29.051481 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.051460    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.054048 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.054027    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-6680c7-openshift-default-dockercfg-5xm5x\""
Sep 04 22:09:29.061583 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.061561    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"]
Sep 04 22:09:29.074697 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.074655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:29.092443 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5hzx\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-kube-api-access-h5hzx\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092564 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-envoy\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092654 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-socket\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092654 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-certs\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092654 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-podinfo\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-token\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-data\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e25510-ff75-47b0-bd9e-f39bf9310822-istiod-ca-cert\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.092888 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.092808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-credential-socket\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-credential-socket\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5hzx\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-kube-api-access-h5hzx\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-envoy\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-socket\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-certs\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-podinfo\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-token\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-data\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193816    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e25510-ff75-47b0-bd9e-f39bf9310822-istiod-ca-cert\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.193920 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.193867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-credential-socket\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.194179 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.194021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-socket\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.194293 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.194268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-data\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.194464 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.194441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-certs\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.194552 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.194487    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e25510-ff75-47b0-bd9e-f39bf9310822-istiod-ca-cert\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.196154 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.196126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-envoy\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.196358 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.196335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-podinfo\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.201806 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.201776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-token\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.202515 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.202491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5hzx\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-kube-api-access-h5hzx\") pod \"e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") " pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.350852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.350772    2577 patch_prober.go:28] interesting pod/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:09:29.350852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.350843    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:09:29.363060 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.363035    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:29.481477 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.481441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:29.643224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.643196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"]
Sep 04 22:09:29.645381 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:09:29.645350    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e25510_ff75_47b0_bd9e_f39bf9310822.slice/crio-bf24a399387686690ed6d41e7c12d91d7e0878d7c6152759e982042d74d45850 WatchSource:0}: Error finding container bf24a399387686690ed6d41e7c12d91d7e0878d7c6152759e982042d74d45850: Status 404 returned error can't find the container with id bf24a399387686690ed6d41e7c12d91d7e0878d7c6152759e982042d74d45850
Sep 04 22:09:29.647621 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.647588    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:29.647723 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.647667    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:29.647723 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.647697    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:29.943803 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.943694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" event={"ID":"60e25510-ff75-47b0-bd9e-f39bf9310822","Type":"ContainerStarted","Data":"6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"}
Sep 04 22:09:29.943803 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.943768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" event={"ID":"60e25510-ff75-47b0-bd9e-f39bf9310822","Type":"ContainerStarted","Data":"bf24a399387686690ed6d41e7c12d91d7e0878d7c6152759e982042d74d45850"}
Sep 04 22:09:29.963013 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:29.962959    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podStartSLOduration=0.962944675 podStartE2EDuration="962.944675ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:29.962123512 +0000 UTC m=+966.734136525" watchObservedRunningTime="2026-09-04 22:09:29.962944675 +0000 UTC m=+966.734957685"
Sep 04 22:09:30.363794 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:30.363758    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:30.368686 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:30.368657    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:30.948800 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:30.948772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:30.949677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:30.949629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:31.875913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:31.875881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:31.968139 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:31.968110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:33.044474 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.044439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:33.142480 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.142444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:33.242508 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.242468    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:33.446909 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.446887    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:09:33.520985 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.520951    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:33.531396 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531366    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-podinfo\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531396 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-envoy\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zgmp\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-kube-api-access-9zgmp\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-socket\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531526    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istiod-ca-cert\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531582    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-data\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531649 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531621    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-certs\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531693    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-token\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.531908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.531717    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-credential-socket\") pod \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\" (UID: \"a9b7a54b-68a8-4483-ae2c-cc4f90412133\") "
Sep 04 22:09:33.532213 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.532021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:33.532213 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.532134    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:33.532401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.532215    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:33.532401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.532271    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:33.532599 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.532559    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:09:33.534486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.534462    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-kube-api-access-9zgmp" (OuterVolumeSpecName: "kube-api-access-9zgmp") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "kube-api-access-9zgmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:09:33.534607 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.534511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:09:33.534898 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.534870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:09:33.534972 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.534956    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9b7a54b-68a8-4483-ae2c-cc4f90412133" (UID: "a9b7a54b-68a8-4483-ae2c-cc4f90412133"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:09:33.585826 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.585742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:33.632655 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632607    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632655 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632631    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632663    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632671    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632681    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632690    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632697    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zgmp\" (UniqueName: \"kubernetes.io/projected/a9b7a54b-68a8-4483-ae2c-cc4f90412133-kube-api-access-9zgmp\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632711    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b7a54b-68a8-4483-ae2c-cc4f90412133-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.632833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.632724    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b7a54b-68a8-4483-ae2c-cc4f90412133-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:09:33.964831 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.964795    2577 generic.go:356] "Generic (PLEG): container finished" podID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerID="9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6" exitCode=0
Sep 04 22:09:33.965007 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.964851    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"
Sep 04 22:09:33.965007 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.964881    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" event={"ID":"a9b7a54b-68a8-4483-ae2c-cc4f90412133","Type":"ContainerDied","Data":"9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6"}
Sep 04 22:09:33.965007 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.964954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz" event={"ID":"a9b7a54b-68a8-4483-ae2c-cc4f90412133","Type":"ContainerDied","Data":"194ba1255e7f946a924435b6efadf033852ea28c43bafe41f2bc4808b6e38e0b"}
Sep 04 22:09:33.965007 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.964977    2577 scope.go:117] "RemoveContainer" containerID="9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6"
Sep 04 22:09:33.974245 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.974231    2577 scope.go:117] "RemoveContainer" containerID="f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"
Sep 04 22:09:33.982725 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.982705    2577 scope.go:117] "RemoveContainer" containerID="9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6"
Sep 04 22:09:33.983012 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:09:33.982993    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6\": container with ID starting with 9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6 not found: ID does not exist" containerID="9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6"
Sep 04 22:09:33.983058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.983019    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6"} err="failed to get container status \"9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6\": rpc error: code = NotFound desc = could not find container \"9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6\": container with ID starting with 9c2e935b9ffeb8984eb8702762ecd090c43d61acb50e962078b59c35ad1fa1a6 not found: ID does not exist"
Sep 04 22:09:33.983058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.983035    2577 scope.go:117] "RemoveContainer" containerID="f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"
Sep 04 22:09:33.983156 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.983053    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"]
Sep 04 22:09:33.983274 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:09:33.983260    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183\": container with ID starting with f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183 not found: ID does not exist" containerID="f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"
Sep 04 22:09:33.983315 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.983290    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183"} err="failed to get container status \"f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183\": rpc error: code = NotFound desc = could not find container \"f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183\": container with ID starting with f311bd42eb621d31105f5661ee5531f382d7bb84432215360b937d18b3d3f183 not found: ID does not exist"
Sep 04 22:09:33.987595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:33.987574    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz"]
Sep 04 22:09:35.298433 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:35.298376    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:35.364482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:35.364444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:35.449841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:35.449805    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:35.547615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:35.547580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:35.648230 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:35.648114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:35.852117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:35.852087    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" path="/var/lib/kubelet/pods/a9b7a54b-68a8-4483-ae2c-cc4f90412133/volumes"
Sep 04 22:09:36.258165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:36.258135    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:36.343959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:36.343920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:36.443856 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:36.443816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:37.950485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:37.950451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:44.038663 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:44.038601    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:44.149044 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:44.148993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:44.737041 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:44.737009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:45.950472 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:45.950359    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:45.950472 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:45.950409    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:46.042519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:46.042479    2577 generic.go:356] "Generic (PLEG): container finished" podID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerID="6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0" exitCode=0
Sep 04 22:09:46.042704 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:46.042555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" event={"ID":"60e25510-ff75-47b0-bd9e-f39bf9310822","Type":"ContainerDied","Data":"6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"}
Sep 04 22:09:46.042952 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:46.042937    2577 scope.go:117] "RemoveContainer" containerID="6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"
Sep 04 22:09:46.043958 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:46.043927    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:46.044062 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:46.044032    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:46.044126 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:46.044079    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:47.049370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:47.049335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" event={"ID":"60e25510-ff75-47b0-bd9e-f39bf9310822","Type":"ContainerStarted","Data":"6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5"}
Sep 04 22:09:47.364281 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:47.364196    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:47.364463 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:47.364438    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:47.364538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:47.364498    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:48.363592 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:48.363554    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:48.364022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:48.363610    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:49.363750 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:49.363714    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:49.364133 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:49.363771    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:50.364071 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.364036    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:50.364568 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.364103    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:50.365499 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.365473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:50.467824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.467785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:50.678058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.677963    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:50.929543 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.929449    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"]
Sep 04 22:09:50.929939 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.929917    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy"
Sep 04 22:09:50.929939 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.929936    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy"
Sep 04 22:09:50.930137 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.929948    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy"
Sep 04 22:09:50.930137 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.929953    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy"
Sep 04 22:09:50.930137 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.930042    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy"
Sep 04 22:09:50.933232 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.933197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:50.935877 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.935853    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-806943a9-openshift-default-dockercfg-lcmm5\""
Sep 04 22:09:50.949822 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.949796    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"]
Sep 04 22:09:50.960220 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:50.960186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:51.007397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-token\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-data\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sfj5\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-kube-api-access-2sfj5\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-podinfo\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-certs\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istiod-ca-cert\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-credential-socket\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-envoy\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.007947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.007493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-socket\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-certs\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istiod-ca-cert\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-credential-socket\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-envoy\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-socket\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-token\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-data\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sfj5\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-kube-api-access-2sfj5\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.108615 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.108433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-podinfo\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.111667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.109802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istiod-ca-cert\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.111667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.110044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-certs\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.111667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.110274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-credential-socket\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.111667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.110791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-socket\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.111667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.111000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-data\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.117661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.117569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-podinfo\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.120339 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.120195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-envoy\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.122853 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.122833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-token\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.123014 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.122982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sfj5\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-kube-api-access-2sfj5\") pod \"e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") " pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.247757 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.247672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:51.363486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.363420    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:51.363671 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.363482    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:51.559376 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.559347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"]
Sep 04 22:09:51.562192 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:09:51.562160    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fd563b_2495_4441_ac83_72c2b2fb66cb.slice/crio-a923e3a92302ac63ff2e316d755b7771cf492b6c8c3e881a66e41c62d6b87c7f WatchSource:0}: Error finding container a923e3a92302ac63ff2e316d755b7771cf492b6c8c3e881a66e41c62d6b87c7f: Status 404 returned error can't find the container with id a923e3a92302ac63ff2e316d755b7771cf492b6c8c3e881a66e41c62d6b87c7f
Sep 04 22:09:51.564460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.564427    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:51.564563 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.564506    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:51.564563 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.564550    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:51.968941 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:51.968861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:52.079308 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.079270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" event={"ID":"f0fd563b-2495-4441-ac83-72c2b2fb66cb","Type":"ContainerStarted","Data":"b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"}
Sep 04 22:09:52.079477 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.079335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" event={"ID":"f0fd563b-2495-4441-ac83-72c2b2fb66cb","Type":"ContainerStarted","Data":"a923e3a92302ac63ff2e316d755b7771cf492b6c8c3e881a66e41c62d6b87c7f"}
Sep 04 22:09:52.104189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.104123    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podStartSLOduration=2.104100913 podStartE2EDuration="2.104100913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:52.100694653 +0000 UTC m=+988.872707665" watchObservedRunningTime="2026-09-04 22:09:52.104100913 +0000 UTC m=+988.876113921"
Sep 04 22:09:52.248060 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.247981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:52.252979 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.252954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:52.363761 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.363726    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:09:52.363921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:52.363781    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 04 22:09:53.084574 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:53.084549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:53.085519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:53.085497    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:09:53.367672 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:53.367584    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:53.367852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:53.367831    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:53.368559 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:53.368543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:09:54.036169 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:54.036128    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:54.132937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:54.132899    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:55.543486 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:55.543447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:55.647854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:55.647806    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:55.767939 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:55.767905    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:56.042961 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:56.042919    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:56.138111 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:56.138077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:56.858582 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:56.858550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:57.198123 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.198021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:57.483132 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.483040    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"]
Sep 04 22:09:57.483820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.483799    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9b7a54b-68a8-4483-ae2c-cc4f90412133" containerName="istio-proxy"
Sep 04 22:09:57.487597 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.487577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.489718 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.489699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7a26c9-openshift-default-dockercfg-2zvjd\""
Sep 04 22:09:57.499080 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.499056    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"]
Sep 04 22:09:57.512923 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.512883    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:57.676483 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.676442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:09:57.679263 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-envoy\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph2jp\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-kube-api-access-ph2jp\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istiod-ca-cert\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-data\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-credential-socket\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-certs\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-token\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-socket\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.679665 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.679501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-podinfo\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780415 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-data\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-credential-socket\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-certs\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-token\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-socket\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-podinfo\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-envoy\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780977 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph2jp\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-kube-api-access-ph2jp\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780977 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istiod-ca-cert\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.780977 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.780900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-data\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.781125 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.781023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-credential-socket\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.781125 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.781073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-certs\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.781222 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.781140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-socket\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.781389 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.781372    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istiod-ca-cert\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.782995 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.782968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-envoy\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.783197 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.783176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-podinfo\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.788689 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.788629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-token\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.788778 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.788738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph2jp\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-kube-api-access-ph2jp\") pod \"e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") " pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:57.801590 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:57.801571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:58.084112 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:58.084078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"]
Sep 04 22:09:58.085625 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:09:58.085601    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb78f12_9fa2_40b2_9feb_f454cbd33988.slice/crio-5f9f8f9aacfd5ba99982e03c0485073b8534a19e89321782e6ec52b1f51294d1 WatchSource:0}: Error finding container 5f9f8f9aacfd5ba99982e03c0485073b8534a19e89321782e6ec52b1f51294d1: Status 404 returned error can't find the container with id 5f9f8f9aacfd5ba99982e03c0485073b8534a19e89321782e6ec52b1f51294d1
Sep 04 22:09:58.087915 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:58.087875    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:58.088016 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:58.087962    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:58.088016 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:58.088004    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:09:58.115391 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:58.115365    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" event={"ID":"0bb78f12-9fa2-40b2-9feb-f454cbd33988","Type":"ContainerStarted","Data":"5f9f8f9aacfd5ba99982e03c0485073b8534a19e89321782e6ec52b1f51294d1"}
Sep 04 22:09:59.122445 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:59.122407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" event={"ID":"0bb78f12-9fa2-40b2-9feb-f454cbd33988","Type":"ContainerStarted","Data":"e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"}
Sep 04 22:09:59.143500 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:59.143454    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podStartSLOduration=2.14343896 podStartE2EDuration="2.14343896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:59.140793815 +0000 UTC m=+995.912806825" watchObservedRunningTime="2026-09-04 22:09:59.14343896 +0000 UTC m=+995.915451969"
Sep 04 22:09:59.802339 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:59.802306    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:09:59.819681 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:09:59.819617    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:00.127692 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:00.127592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:00.128822 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:00.128798    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:01.119753 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:01.119722    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:01.218483 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:01.218448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:02.379465 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:02.379427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:02.483468 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:02.483435    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:02.648167 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:02.648078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:02.848934 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:02.848890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:02.947095 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:02.947011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:08.342798 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:08.342765    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": read tcp 10.132.0.2:40418->10.132.0.63:15021: read: connection reset by peer" start-of-body=
Sep 04 22:10:08.343177 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:08.342836    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": read tcp 10.132.0.2:40418->10.132.0.63:15021: read: connection reset by peer"
Sep 04 22:10:09.180608 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:09.180574    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerID="b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366" exitCode=0
Sep 04 22:10:09.180810 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:09.180616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" event={"ID":"f0fd563b-2495-4441-ac83-72c2b2fb66cb","Type":"ContainerDied","Data":"b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"}
Sep 04 22:10:09.181047 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:09.181032    2577 scope.go:117] "RemoveContainer" containerID="b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"
Sep 04 22:10:09.182122 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:09.182088    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:09.182221 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:09.182175    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:09.182282 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:09.182224    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:10.188131 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:10.188092    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" event={"ID":"f0fd563b-2495-4441-ac83-72c2b2fb66cb","Type":"ContainerStarted","Data":"60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc"}
Sep 04 22:10:10.248801 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:10.248768    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:10:10.249085 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:10.249047    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 04 22:10:10.249206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:10.249096    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 04 22:10:11.248417 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:11.248381    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 04 22:10:11.248839 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:11.248443    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 04 22:10:12.248181 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:12.248152    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 04 22:10:12.248410 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:12.248390    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 04 22:10:13.248435 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:13.248402    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 04 22:10:13.248828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:13.248456    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 04 22:10:14.248406 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:14.248361    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 04 22:10:14.248694 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:14.248428    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 04 22:10:15.251962 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:15.251933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:10:15.252361 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:15.252265    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:10:15.253125 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:15.253109    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:10:16.168790 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:16.168753    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:10:16.168962 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:16.168819    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:10:17.241919 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.241879    2577 generic.go:356] "Generic (PLEG): container finished" podID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerID="e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473" exitCode=0
Sep 04 22:10:17.242346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.241950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" event={"ID":"0bb78f12-9fa2-40b2-9feb-f454cbd33988","Type":"ContainerDied","Data":"e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"}
Sep 04 22:10:17.242484 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.242469    2577 scope.go:117] "RemoveContainer" containerID="e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"
Sep 04 22:10:17.243427 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.243402    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:17.243475 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.243463    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:17.243510 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.243493    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:17.348272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:17.348237    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:18.249756 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:18.249722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" event={"ID":"0bb78f12-9fa2-40b2-9feb-f454cbd33988","Type":"ContainerStarted","Data":"14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73"}
Sep 04 22:10:18.802532 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:18.802497    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:18.802892 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:18.802868    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 04 22:10:18.803051 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:18.803028    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 04 22:10:19.067763 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:19.067671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:19.756037 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:19.755999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:19.802281 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:19.802237    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 04 22:10:19.802447 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:19.802307    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 04 22:10:19.852118 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:19.852087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:20.145835 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:20.145744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:20.802412 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:20.802370    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 04 22:10:20.802937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:20.802438    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 04 22:10:21.802314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:21.802279    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 04 22:10:21.802604 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:21.802576    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 04 22:10:22.803066 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:22.803021    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 04 22:10:22.803677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:22.803621    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 04 22:10:23.806585 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:23.806562    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:23.806964 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:23.806872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:23.807508 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:23.807493    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:10:24.266947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:24.266912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:25.727290 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:25.727256    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:25.827145 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:25.827115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:26.011396 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.011364    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:26.076257 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.076226    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:26.138342 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.138315    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:26.390994 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.390915    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"]
Sep 04 22:10:26.394406 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.394390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:26.396697 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.396676    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:10:26.396820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.396681    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:10:26.402776 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.402751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"]
Sep 04 22:10:26.461729 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.461697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd7827c9-f966-47c1-9438-de9b69aaafbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-806943a9-zhmhs\" (UID: \"bd7827c9-f966-47c1-9438-de9b69aaafbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:26.495972 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.495942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:26.562459 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.562430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd7827c9-f966-47c1-9438-de9b69aaafbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-806943a9-zhmhs\" (UID: \"bd7827c9-f966-47c1-9438-de9b69aaafbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:26.563117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.563098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd7827c9-f966-47c1-9438-de9b69aaafbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-806943a9-zhmhs\" (UID: \"bd7827c9-f966-47c1-9438-de9b69aaafbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:26.706661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.706567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:26.994527 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:26.988255    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"]
Sep 04 22:10:26.994527 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:10:26.990923    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7827c9_f966_47c1_9438_de9b69aaafbf.slice/crio-cafb9fcd87e5e97115a36dea734de309a95ce823eb44cd71689368a215dc094a WatchSource:0}: Error finding container cafb9fcd87e5e97115a36dea734de309a95ce823eb44cd71689368a215dc094a: Status 404 returned error can't find the container with id cafb9fcd87e5e97115a36dea734de309a95ce823eb44cd71689368a215dc094a
Sep 04 22:10:27.301763 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:27.301735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs" event={"ID":"bd7827c9-f966-47c1-9438-de9b69aaafbf","Type":"ContainerStarted","Data":"cafb9fcd87e5e97115a36dea734de309a95ce823eb44cd71689368a215dc094a"}
Sep 04 22:10:28.308873 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:28.308838    2577 generic.go:356] "Generic (PLEG): container finished" podID="bd7827c9-f966-47c1-9438-de9b69aaafbf" containerID="d7664a2208daa02b3c1b37aa82597c2f76eb7a9d4d881bd03560356580ad290f" exitCode=0
Sep 04 22:10:28.309270 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:28.308926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs" event={"ID":"bd7827c9-f966-47c1-9438-de9b69aaafbf","Type":"ContainerDied","Data":"d7664a2208daa02b3c1b37aa82597c2f76eb7a9d4d881bd03560356580ad290f"}
Sep 04 22:10:29.444548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:29.444525    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:29.588519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:29.588433    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd7827c9-f966-47c1-9438-de9b69aaafbf-maas-api-service-ca\") pod \"bd7827c9-f966-47c1-9438-de9b69aaafbf\" (UID: \"bd7827c9-f966-47c1-9438-de9b69aaafbf\") "
Sep 04 22:10:29.588823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:29.588801    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd7827c9-f966-47c1-9438-de9b69aaafbf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd7827c9-f966-47c1-9438-de9b69aaafbf" (UID: "bd7827c9-f966-47c1-9438-de9b69aaafbf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:10:29.689924 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:29.689885    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd7827c9-f966-47c1-9438-de9b69aaafbf-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:30.320374 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:30.320346    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"
Sep 04 22:10:30.320543 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:30.320392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs" event={"ID":"bd7827c9-f966-47c1-9438-de9b69aaafbf","Type":"ContainerDied","Data":"cafb9fcd87e5e97115a36dea734de309a95ce823eb44cd71689368a215dc094a"}
Sep 04 22:10:30.320543 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:30.320439    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cafb9fcd87e5e97115a36dea734de309a95ce823eb44cd71689368a215dc094a"
Sep 04 22:10:31.940087 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:31.940056    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:37.020234 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.020201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:37.094482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.094443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:37.164375 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.164343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:37.222313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.222279    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"]
Sep 04 22:10:37.225812 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.225788    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-806943a9-zhmhs"]
Sep 04 22:10:37.243366 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.243333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:37.615982 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.615948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:37.851978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:37.851946    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd7827c9-f966-47c1-9438-de9b69aaafbf" path="/var/lib/kubelet/pods/bd7827c9-f966-47c1-9438-de9b69aaafbf/volumes"
Sep 04 22:10:43.670997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:43.670960    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:43.776026 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:43.775991    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:43.933614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:43.933538    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"]
Sep 04 22:10:43.933785 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:43.933755    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" containerID="cri-o://60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc" gracePeriod=30
Sep 04 22:10:43.977548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:43.977515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:44.275878 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:44.275839    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:44.378654 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:44.378607    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:44.497875 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:44.497841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:45.254179 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:45.254148    2577 patch_prober.go:28] interesting pod/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:10:45.254620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:45.254208    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:10:49.187287 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.187263    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:10:49.267224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267196    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-socket\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267238    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-certs\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267275    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-credential-socket\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267306    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sfj5\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-kube-api-access-2sfj5\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267325    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-envoy\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-token\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267664 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267383    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-data\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267664 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267471    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:10:49.267664 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267521    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istiod-ca-cert\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267664 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267596    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-podinfo\") pod \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\" (UID: \"f0fd563b-2495-4441-ac83-72c2b2fb66cb\") "
Sep 04 22:10:49.267850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:10:49.267850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267679    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:10:49.267850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267777    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:10:49.267964 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267919    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:10:49.268011 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.267998    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.268073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.268016    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.268073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.268030    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.268073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.268043    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.268073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.268053    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.269612 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.269576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:10:49.269612 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.269583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:10:49.270077 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.270054    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:10:49.270156 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.270118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-kube-api-access-2sfj5" (OuterVolumeSpecName: "kube-api-access-2sfj5") pod "f0fd563b-2495-4441-ac83-72c2b2fb66cb" (UID: "f0fd563b-2495-4441-ac83-72c2b2fb66cb"). InnerVolumeSpecName "kube-api-access-2sfj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:10:49.368571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.368535    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sfj5\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-kube-api-access-2sfj5\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.368571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.368566    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.368571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.368578    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.368827 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.368590    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fd563b-2495-4441-ac83-72c2b2fb66cb-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:10:49.429439 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.429409    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerID="60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc" exitCode=0
Sep 04 22:10:49.429690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.429455    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"
Sep 04 22:10:49.429690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.429459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" event={"ID":"f0fd563b-2495-4441-ac83-72c2b2fb66cb","Type":"ContainerDied","Data":"60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc"}
Sep 04 22:10:49.429690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.429506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j" event={"ID":"f0fd563b-2495-4441-ac83-72c2b2fb66cb","Type":"ContainerDied","Data":"a923e3a92302ac63ff2e316d755b7771cf492b6c8c3e881a66e41c62d6b87c7f"}
Sep 04 22:10:49.429690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.429528    2577 scope.go:117] "RemoveContainer" containerID="60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc"
Sep 04 22:10:49.439524 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.439503    2577 scope.go:117] "RemoveContainer" containerID="b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"
Sep 04 22:10:49.448002 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.447986    2577 scope.go:117] "RemoveContainer" containerID="60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc"
Sep 04 22:10:49.448247 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:10:49.448229    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc\": container with ID starting with 60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc not found: ID does not exist" containerID="60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc"
Sep 04 22:10:49.448318 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.448258    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc"} err="failed to get container status \"60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc\": rpc error: code = NotFound desc = could not find container \"60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc\": container with ID starting with 60f06a4e74676d7ada4533791063926caef3a042f7df374add42f4e0f807bfbc not found: ID does not exist"
Sep 04 22:10:49.448318 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.448283    2577 scope.go:117] "RemoveContainer" containerID="b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"
Sep 04 22:10:49.448588 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:10:49.448567    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366\": container with ID starting with b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366 not found: ID does not exist" containerID="b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"
Sep 04 22:10:49.448629 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.448593    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366"} err="failed to get container status \"b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366\": rpc error: code = NotFound desc = could not find container \"b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366\": container with ID starting with b9ab8a565544e1b521d1de2f4ca3eb6e8cb57f156c47e528b9df6e8db7da4366 not found: ID does not exist"
Sep 04 22:10:49.451793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.451772    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"]
Sep 04 22:10:49.455248 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.455218    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j"]
Sep 04 22:10:49.851272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:49.851241    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" path="/var/lib/kubelet/pods/f0fd563b-2495-4441-ac83-72c2b2fb66cb/volumes"
Sep 04 22:10:50.313594 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:50.313560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:50.422109 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:50.422072    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:50.531202 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:50.531170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:50.671594 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:50.671506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:56.549870 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:56.549833    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:56.650685 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:56.650621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:57.487027 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.486984    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:57.827397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.827362    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"]
Sep 04 22:10:57.828033 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828015    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd7827c9-f966-47c1-9438-de9b69aaafbf" containerName="revoke-keys"
Sep 04 22:10:57.828086 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828036    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd7827c9-f966-47c1-9438-de9b69aaafbf" containerName="revoke-keys"
Sep 04 22:10:57.828086 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828052    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy"
Sep 04 22:10:57.828086 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828061    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy"
Sep 04 22:10:57.828086 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828080    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy"
Sep 04 22:10:57.828224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828089    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy"
Sep 04 22:10:57.828224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828189    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy"
Sep 04 22:10:57.828224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828199    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd7827c9-f966-47c1-9438-de9b69aaafbf" containerName="revoke-keys"
Sep 04 22:10:57.828224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.828214    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0fd563b-2495-4441-ac83-72c2b2fb66cb" containerName="istio-proxy"
Sep 04 22:10:57.831379 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.831355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.833547 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.833524    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-fc3156-openshift-default-dockercfg-crtql\""
Sep 04 22:10:57.852479 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.852455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"]
Sep 04 22:10:57.861171 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.861145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:57.972315 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-data\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972494 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-socket\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972494 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-podinfo\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972584 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istiod-ca-cert\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-certs\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972688 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-credential-socket\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972723 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-token\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972723 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jph8p\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-kube-api-access-jph8p\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:57.972787 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:57.972737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-envoy\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073518 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-data\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073714 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-socket\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073714 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-podinfo\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073714 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istiod-ca-cert\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073874 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-certs\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073874 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-credential-socket\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-token\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jph8p\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-kube-api-access-jph8p\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.073999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-envoy\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.074159 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.074023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-socket\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.074159 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.073945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-data\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.074271 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.074187    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-certs\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.074326 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.074280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istiod-ca-cert\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.074487 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.074466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-credential-socket\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.076154 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.076126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-envoy\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.076484 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.076466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-podinfo\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.081631 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.081574    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-token\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.081817 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.081794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jph8p\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-kube-api-access-jph8p\") pod \"e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") " pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.141710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.141672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:10:58.253121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.253090    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:10:58.420959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.420933    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"]
Sep 04 22:10:58.422812 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:10:58.422774    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440ce58b_cfdc_47ac_a5ce_3426d0212b2c.slice/crio-1495428395f9a06f502da68653064c744316048680924c649010f7c23f68d144 WatchSource:0}: Error finding container 1495428395f9a06f502da68653064c744316048680924c649010f7c23f68d144: Status 404 returned error can't find the container with id 1495428395f9a06f502da68653064c744316048680924c649010f7c23f68d144
Sep 04 22:10:58.425121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.425089    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:58.425200 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.425153    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:58.425200 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.425183    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:10:58.483673 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:58.483647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" event={"ID":"440ce58b-cfdc-47ac-a5ce-3426d0212b2c","Type":"ContainerStarted","Data":"1495428395f9a06f502da68653064c744316048680924c649010f7c23f68d144"}
Sep 04 22:10:59.491785 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:59.491751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" event={"ID":"440ce58b-cfdc-47ac-a5ce-3426d0212b2c","Type":"ContainerStarted","Data":"256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"}
Sep 04 22:10:59.514373 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:10:59.514320    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podStartSLOduration=2.514303366 podStartE2EDuration="2.514303366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:59.512098963 +0000 UTC m=+1056.284111974" watchObservedRunningTime="2026-09-04 22:10:59.514303366 +0000 UTC m=+1056.286316375"
Sep 04 22:11:00.142424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:00.142384    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:00.147942 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:00.147916    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:00.498342 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:00.498250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:00.499285 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:00.499258    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:01.434165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:01.434132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:01.526011 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:01.525969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:02.582710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:02.582602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:02.684064 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:02.684029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:02.803941 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:02.803888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:03.173559 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:03.173526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:03.279766 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:03.279732    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:10.057837 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:10.057797    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:16.539846 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:16.539758    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:11:16.539846 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:16.539823    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:11:17.601052 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:17.601021    2577 generic.go:356] "Generic (PLEG): container finished" podID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerID="256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61" exitCode=0
Sep 04 22:11:17.601573 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:17.601083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" event={"ID":"440ce58b-cfdc-47ac-a5ce-3426d0212b2c","Type":"ContainerDied","Data":"256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"}
Sep 04 22:11:17.601694 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:17.601568    2577 scope.go:117] "RemoveContainer" containerID="256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"
Sep 04 22:11:17.602723 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:17.602692    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:17.602841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:17.602775    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:17.602841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:17.602824    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:18.613016 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:18.612976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" event={"ID":"440ce58b-cfdc-47ac-a5ce-3426d0212b2c","Type":"ContainerStarted","Data":"e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd"}
Sep 04 22:11:19.142108 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:19.142063    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:19.142333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:19.142305    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 04 22:11:19.142424 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:19.142368    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 04 22:11:20.142854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:20.142817    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 04 22:11:20.143329 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:20.142882    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 04 22:11:21.142769 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:21.142733    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 04 22:11:21.142951 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:21.142791    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 04 22:11:22.142455 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:22.142420    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 04 22:11:22.142660 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:22.142477    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 04 22:11:23.142771 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:23.142733    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 04 22:11:23.143174 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:23.142818    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 04 22:11:24.145555 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:24.145478    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:24.145936 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:24.145809    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:24.146381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:24.146363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:11:26.425491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:26.425455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:26.769343 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:26.769309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:27.049449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.049365    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"]
Sep 04 22:11:27.054627 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.054600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.056882 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.056861    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-3abe72-openshift-default-dockercfg-mt262\""
Sep 04 22:11:27.063280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.063255    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"]
Sep 04 22:11:27.080047 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.080005    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:27.170519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-credential-socket\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-data\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-envoy\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgdm\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-kube-api-access-tlgdm\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-certs\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170966 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-socket\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170966 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istiod-ca-cert\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170966 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170853    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-podinfo\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.170966 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.170889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-token\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.269224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.269187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:27.271514 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-data\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271670 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-envoy\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271670 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgdm\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-kube-api-access-tlgdm\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271802 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-certs\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271802 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-socket\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271883 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istiod-ca-cert\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271932 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-podinfo\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271988 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-token\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.271988 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-credential-socket\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.272094 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.271990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-data\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.272153 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.272101    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-certs\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.272208 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.272155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-socket\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.272334 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.272310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-credential-socket\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.272531 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.272512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istiod-ca-cert\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.274171 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.274149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-envoy\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.274406 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.274390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-podinfo\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.279166 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.279147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-token\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.279544 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.279520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgdm\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-kube-api-access-tlgdm\") pod \"e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") " pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.366958 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.366874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:27.644896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.644867    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"]
Sep 04 22:11:27.646055 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:11:27.646026    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec40fa5_2b07_4f02_87f4_0c5549d7e5b8.slice/crio-ea1858239229e0d1cb0b1972da9a9394503b2adf1aaedd8b302991e1d896fe7b WatchSource:0}: Error finding container ea1858239229e0d1cb0b1972da9a9394503b2adf1aaedd8b302991e1d896fe7b: Status 404 returned error can't find the container with id ea1858239229e0d1cb0b1972da9a9394503b2adf1aaedd8b302991e1d896fe7b
Sep 04 22:11:27.648188 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.648153    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:27.648313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.648219    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:27.648313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.648265    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:27.673059 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.673033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" event={"ID":"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8","Type":"ContainerStarted","Data":"ea1858239229e0d1cb0b1972da9a9394503b2adf1aaedd8b302991e1d896fe7b"}
Sep 04 22:11:27.946993 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:27.946874    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:28.679579 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:28.679541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" event={"ID":"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8","Type":"ContainerStarted","Data":"76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"}
Sep 04 22:11:28.700617 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:28.700566    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podStartSLOduration=1.7005498000000001 podStartE2EDuration="1.7005498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:11:28.699614306 +0000 UTC m=+1085.471627316" watchObservedRunningTime="2026-09-04 22:11:28.7005498 +0000 UTC m=+1085.472562809"
Sep 04 22:11:29.367824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:29.367779    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:29.372693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:29.372671    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:29.686519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:29.686423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:29.687536 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:29.687515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:30.624548 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:30.624510    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:30.720423 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:30.720391    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:31.876238 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:31.876204    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:31.976883 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:31.976840    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:32.077512 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:32.077475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:32.378026 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:32.377992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:32.476631 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:32.476587    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:48.795885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:48.795851    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerID="76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3" exitCode=0
Sep 04 22:11:48.796313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:48.795921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" event={"ID":"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8","Type":"ContainerDied","Data":"76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"}
Sep 04 22:11:48.796421 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:48.796404    2577 scope.go:117] "RemoveContainer" containerID="76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"
Sep 04 22:11:48.797519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:48.797490    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:48.797577 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:48.797559    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:48.797613 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:48.797592    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:11:49.811801 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:49.811755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" event={"ID":"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8","Type":"ContainerStarted","Data":"390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d"}
Sep 04 22:11:50.367702 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:50.367668    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:50.367978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:50.367954    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 04 22:11:50.368080 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:50.368011    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 04 22:11:51.368163 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:51.368029    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 04 22:11:51.368163 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:51.368078    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 04 22:11:52.367586 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:52.367549    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 04 22:11:52.367781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:52.367603    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 04 22:11:53.368008 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:53.367972    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 04 22:11:53.368430 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:53.368029    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 04 22:11:54.367883 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:54.367846    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 04 22:11:54.368060 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:54.367918    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 04 22:11:55.371854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:55.371823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:55.372317 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:55.372233    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:55.372812 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:55.372795    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:11:55.621958 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:55.621855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:11:56.264476 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.264443    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:56.268157 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.268133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:56.270243 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.270217    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nhr85\""
Sep 04 22:11:56.274276 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.274252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:56.369364 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.369335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbdf8\" (UniqueName: \"kubernetes.io/projected/1fff007d-3be6-47f9-8c75-044443ae300d-kube-api-access-kbdf8\") pod \"test-curl-7818-139874914964224\" (UID: \"1fff007d-3be6-47f9-8c75-044443ae300d\") " pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:56.470551 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.470518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdf8\" (UniqueName: \"kubernetes.io/projected/1fff007d-3be6-47f9-8c75-044443ae300d-kube-api-access-kbdf8\") pod \"test-curl-7818-139874914964224\" (UID: \"1fff007d-3be6-47f9-8c75-044443ae300d\") " pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:56.478408 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.478380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbdf8\" (UniqueName: \"kubernetes.io/projected/1fff007d-3be6-47f9-8c75-044443ae300d-kube-api-access-kbdf8\") pod \"test-curl-7818-139874914964224\" (UID: \"1fff007d-3be6-47f9-8c75-044443ae300d\") " pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:56.577859 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.577774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:56.854734 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.854710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:56.857198 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:11:56.857160    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fff007d_3be6_47f9_8c75_044443ae300d.slice/crio-447a2cba1cf66c70cf3eb7ca127601d78b2a230549efbe7277e27fa3f0a127e7 WatchSource:0}: Error finding container 447a2cba1cf66c70cf3eb7ca127601d78b2a230549efbe7277e27fa3f0a127e7: Status 404 returned error can't find the container with id 447a2cba1cf66c70cf3eb7ca127601d78b2a230549efbe7277e27fa3f0a127e7
Sep 04 22:11:56.858913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:56.858893    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:11:57.867777 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:57.867685    2577 generic.go:356] "Generic (PLEG): container finished" podID="1fff007d-3be6-47f9-8c75-044443ae300d" containerID="2b84a3911bfffed1f1536b8b0fed3c228c01585ac6698499b5626dbe1dc700ac" exitCode=0
Sep 04 22:11:57.868152 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:57.867771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964224" event={"ID":"1fff007d-3be6-47f9-8c75-044443ae300d","Type":"ContainerDied","Data":"2b84a3911bfffed1f1536b8b0fed3c228c01585ac6698499b5626dbe1dc700ac"}
Sep 04 22:11:57.868152 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:57.867814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964224" event={"ID":"1fff007d-3be6-47f9-8c75-044443ae300d","Type":"ContainerStarted","Data":"447a2cba1cf66c70cf3eb7ca127601d78b2a230549efbe7277e27fa3f0a127e7"}
Sep 04 22:11:59.020999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.020977    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.039850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.039819    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7818-139874914964224_1fff007d-3be6-47f9-8c75-044443ae300d/test-curl-7818-139874914964224/0.log"
Sep 04 22:11:59.061393 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.061360    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:59.065265 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.065239    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:59.098221 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.098192    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbdf8\" (UniqueName: \"kubernetes.io/projected/1fff007d-3be6-47f9-8c75-044443ae300d-kube-api-access-kbdf8\") pod \"1fff007d-3be6-47f9-8c75-044443ae300d\" (UID: \"1fff007d-3be6-47f9-8c75-044443ae300d\") "
Sep 04 22:11:59.100419 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.100392    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fff007d-3be6-47f9-8c75-044443ae300d-kube-api-access-kbdf8" (OuterVolumeSpecName: "kube-api-access-kbdf8") pod "1fff007d-3be6-47f9-8c75-044443ae300d" (UID: "1fff007d-3be6-47f9-8c75-044443ae300d"). InnerVolumeSpecName "kube-api-access-kbdf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:11:59.182253 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.182173    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:59.182607 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.182594    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fff007d-3be6-47f9-8c75-044443ae300d" containerName="test-curl-7818-139874914964224"
Sep 04 22:11:59.182667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.182608    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fff007d-3be6-47f9-8c75-044443ae300d" containerName="test-curl-7818-139874914964224"
Sep 04 22:11:59.182729 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.182719    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fff007d-3be6-47f9-8c75-044443ae300d" containerName="test-curl-7818-139874914964224"
Sep 04 22:11:59.185889 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.185873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.192069 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.192044    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:59.206451 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.206402    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbdf8\" (UniqueName: \"kubernetes.io/projected/1fff007d-3be6-47f9-8c75-044443ae300d-kube-api-access-kbdf8\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:11:59.307851 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.307812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6x6\" (UniqueName: \"kubernetes.io/projected/ea08a9fd-7a53-42c7-8e92-727c5c197cf7-kube-api-access-rv6x6\") pod \"test-curl-7818-139874914964224\" (UID: \"ea08a9fd-7a53-42c7-8e92-727c5c197cf7\") " pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.408702 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.408664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6x6\" (UniqueName: \"kubernetes.io/projected/ea08a9fd-7a53-42c7-8e92-727c5c197cf7-kube-api-access-rv6x6\") pod \"test-curl-7818-139874914964224\" (UID: \"ea08a9fd-7a53-42c7-8e92-727c5c197cf7\") " pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.417259 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.417232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6x6\" (UniqueName: \"kubernetes.io/projected/ea08a9fd-7a53-42c7-8e92-727c5c197cf7-kube-api-access-rv6x6\") pod \"test-curl-7818-139874914964224\" (UID: \"ea08a9fd-7a53-42c7-8e92-727c5c197cf7\") " pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.497427 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.497347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.769471 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.769433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:11:59.772373 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:11:59.772348    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea08a9fd_7a53_42c7_8e92_727c5c197cf7.slice/crio-89b061f6a567fa40a8d5a7a2bdbf19459eb85d040b9a7706797830207f8ec01b WatchSource:0}: Error finding container 89b061f6a567fa40a8d5a7a2bdbf19459eb85d040b9a7706797830207f8ec01b: Status 404 returned error can't find the container with id 89b061f6a567fa40a8d5a7a2bdbf19459eb85d040b9a7706797830207f8ec01b
Sep 04 22:11:59.852496 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.852468    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fff007d-3be6-47f9-8c75-044443ae300d" path="/var/lib/kubelet/pods/1fff007d-3be6-47f9-8c75-044443ae300d/volumes"
Sep 04 22:11:59.880363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.880328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964224" event={"ID":"ea08a9fd-7a53-42c7-8e92-727c5c197cf7","Type":"ContainerStarted","Data":"89b061f6a567fa40a8d5a7a2bdbf19459eb85d040b9a7706797830207f8ec01b"}
Sep 04 22:11:59.881511 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.881495    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:11:59.881583 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:11:59.881543    2577 scope.go:117] "RemoveContainer" containerID="2b84a3911bfffed1f1536b8b0fed3c228c01585ac6698499b5626dbe1dc700ac"
Sep 04 22:12:00.889176 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:00.889144    2577 generic.go:356] "Generic (PLEG): container finished" podID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" containerID="84f101f6f58f071f7b4a4f98ed5163b99bbaab6aba9f84613f727d462e0aa97c" exitCode=0
Sep 04 22:12:00.889679 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:00.889232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964224" event={"ID":"ea08a9fd-7a53-42c7-8e92-727c5c197cf7","Type":"ContainerDied","Data":"84f101f6f58f071f7b4a4f98ed5163b99bbaab6aba9f84613f727d462e0aa97c"}
Sep 04 22:12:02.039067 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.039038    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:12:02.060129 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.060098    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7818-139874914964224_ea08a9fd-7a53-42c7-8e92-727c5c197cf7/test-curl-7818-139874914964224/0.log"
Sep 04 22:12:02.085335 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.085301    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:12:02.087796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.087769    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7818-139874914964224"]
Sep 04 22:12:02.133200 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.133171    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv6x6\" (UniqueName: \"kubernetes.io/projected/ea08a9fd-7a53-42c7-8e92-727c5c197cf7-kube-api-access-rv6x6\") pod \"ea08a9fd-7a53-42c7-8e92-727c5c197cf7\" (UID: \"ea08a9fd-7a53-42c7-8e92-727c5c197cf7\") "
Sep 04 22:12:02.135232 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.135208    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea08a9fd-7a53-42c7-8e92-727c5c197cf7-kube-api-access-rv6x6" (OuterVolumeSpecName: "kube-api-access-rv6x6") pod "ea08a9fd-7a53-42c7-8e92-727c5c197cf7" (UID: "ea08a9fd-7a53-42c7-8e92-727c5c197cf7"). InnerVolumeSpecName "kube-api-access-rv6x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:12:02.207011 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.206939    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:02.207509 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.207493    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" containerName="test-curl-7818-139874914964224"
Sep 04 22:12:02.207564 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.207512    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" containerName="test-curl-7818-139874914964224"
Sep 04 22:12:02.207674 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.207662    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" containerName="test-curl-7818-139874914964224"
Sep 04 22:12:02.210758 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.210737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:02.212582 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.212554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:02.234667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.234626    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv6x6\" (UniqueName: \"kubernetes.io/projected/ea08a9fd-7a53-42c7-8e92-727c5c197cf7-kube-api-access-rv6x6\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:12:02.336003 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.335977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdvf\" (UniqueName: \"kubernetes.io/projected/ff911b57-b891-44a2-b2e2-fbbd014b3c38-kube-api-access-7fdvf\") pod \"test-curl-7818-139874914964800\" (UID: \"ff911b57-b891-44a2-b2e2-fbbd014b3c38\") " pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:02.436832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.436797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdvf\" (UniqueName: \"kubernetes.io/projected/ff911b57-b891-44a2-b2e2-fbbd014b3c38-kube-api-access-7fdvf\") pod \"test-curl-7818-139874914964800\" (UID: \"ff911b57-b891-44a2-b2e2-fbbd014b3c38\") " pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:02.446873 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.446793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdvf\" (UniqueName: \"kubernetes.io/projected/ff911b57-b891-44a2-b2e2-fbbd014b3c38-kube-api-access-7fdvf\") pod \"test-curl-7818-139874914964800\" (UID: \"ff911b57-b891-44a2-b2e2-fbbd014b3c38\") " pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:02.520712 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.520675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:02.794363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.794336    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:02.795810 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:12:02.795775    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff911b57_b891_44a2_b2e2_fbbd014b3c38.slice/crio-e2c338a331b3f9a998a69a3f2ba2981ca6d05d441b8f61c8a51a18d354ea2a9b WatchSource:0}: Error finding container e2c338a331b3f9a998a69a3f2ba2981ca6d05d441b8f61c8a51a18d354ea2a9b: Status 404 returned error can't find the container with id e2c338a331b3f9a998a69a3f2ba2981ca6d05d441b8f61c8a51a18d354ea2a9b
Sep 04 22:12:02.904462 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.904430    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:12:02.904663 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.904440    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89b061f6a567fa40a8d5a7a2bdbf19459eb85d040b9a7706797830207f8ec01b"
Sep 04 22:12:02.905868 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:02.905846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964800" event={"ID":"ff911b57-b891-44a2-b2e2-fbbd014b3c38","Type":"ContainerStarted","Data":"e2c338a331b3f9a998a69a3f2ba2981ca6d05d441b8f61c8a51a18d354ea2a9b"}
Sep 04 22:12:02.914863 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:12:02.914838    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7818-139874914964224\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:12:03.849826 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:12:03.849785    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7818-139874914964224\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" pod="opendatahub/test-curl-7818-139874914964224"
Sep 04 22:12:03.852368 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:03.852338    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea08a9fd-7a53-42c7-8e92-727c5c197cf7" path="/var/lib/kubelet/pods/ea08a9fd-7a53-42c7-8e92-727c5c197cf7/volumes"
Sep 04 22:12:03.919379 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:03.919343    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff911b57-b891-44a2-b2e2-fbbd014b3c38" containerID="9fd67a361a725478fa19fa41fd7d5014c99bfcab3298079ca0067c3fad83d7a9" exitCode=0
Sep 04 22:12:03.919551 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:03.919428    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964800" event={"ID":"ff911b57-b891-44a2-b2e2-fbbd014b3c38","Type":"ContainerDied","Data":"9fd67a361a725478fa19fa41fd7d5014c99bfcab3298079ca0067c3fad83d7a9"}
Sep 04 22:12:05.065672 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.065649    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.084169 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.084148    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7818-139874914964800_ff911b57-b891-44a2-b2e2-fbbd014b3c38/test-curl-7818-139874914964800/0.log"
Sep 04 22:12:05.108601 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.108572    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:05.110646 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.110614    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:05.162534 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.162507    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fdvf\" (UniqueName: \"kubernetes.io/projected/ff911b57-b891-44a2-b2e2-fbbd014b3c38-kube-api-access-7fdvf\") pod \"ff911b57-b891-44a2-b2e2-fbbd014b3c38\" (UID: \"ff911b57-b891-44a2-b2e2-fbbd014b3c38\") "
Sep 04 22:12:05.164582 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.164558    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff911b57-b891-44a2-b2e2-fbbd014b3c38-kube-api-access-7fdvf" (OuterVolumeSpecName: "kube-api-access-7fdvf") pod "ff911b57-b891-44a2-b2e2-fbbd014b3c38" (UID: "ff911b57-b891-44a2-b2e2-fbbd014b3c38"). InnerVolumeSpecName "kube-api-access-7fdvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:12:05.230624 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.230554    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:05.231015 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.231001    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff911b57-b891-44a2-b2e2-fbbd014b3c38" containerName="test-curl-7818-139874914964800"
Sep 04 22:12:05.231058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.231016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff911b57-b891-44a2-b2e2-fbbd014b3c38" containerName="test-curl-7818-139874914964800"
Sep 04 22:12:05.231099 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.231090    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff911b57-b891-44a2-b2e2-fbbd014b3c38" containerName="test-curl-7818-139874914964800"
Sep 04 22:12:05.234118 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.234103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.240887 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.240860    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:05.263472 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.263447    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fdvf\" (UniqueName: \"kubernetes.io/projected/ff911b57-b891-44a2-b2e2-fbbd014b3c38-kube-api-access-7fdvf\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:12:05.364172 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.364141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drpn9\" (UniqueName: \"kubernetes.io/projected/330a670d-1608-4b3e-b0b2-128b29be9c1d-kube-api-access-drpn9\") pod \"test-curl-7818-139874914964800\" (UID: \"330a670d-1608-4b3e-b0b2-128b29be9c1d\") " pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.464788 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.464759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drpn9\" (UniqueName: \"kubernetes.io/projected/330a670d-1608-4b3e-b0b2-128b29be9c1d-kube-api-access-drpn9\") pod \"test-curl-7818-139874914964800\" (UID: \"330a670d-1608-4b3e-b0b2-128b29be9c1d\") " pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.472371 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.472349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drpn9\" (UniqueName: \"kubernetes.io/projected/330a670d-1608-4b3e-b0b2-128b29be9c1d-kube-api-access-drpn9\") pod \"test-curl-7818-139874914964800\" (UID: \"330a670d-1608-4b3e-b0b2-128b29be9c1d\") " pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.544052 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.544024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.815836 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.815810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:05.817932 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:12:05.817900    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod330a670d_1608_4b3e_b0b2_128b29be9c1d.slice/crio-3507562f3da66976c97db8aa27b53eaca4543cf5c7a05154e1b4712b9930355f WatchSource:0}: Error finding container 3507562f3da66976c97db8aa27b53eaca4543cf5c7a05154e1b4712b9930355f: Status 404 returned error can't find the container with id 3507562f3da66976c97db8aa27b53eaca4543cf5c7a05154e1b4712b9930355f
Sep 04 22:12:05.852193 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.852169    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff911b57-b891-44a2-b2e2-fbbd014b3c38" path="/var/lib/kubelet/pods/ff911b57-b891-44a2-b2e2-fbbd014b3c38/volumes"
Sep 04 22:12:05.932902 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.932873    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:05.932902 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.932892    2577 scope.go:117] "RemoveContainer" containerID="9fd67a361a725478fa19fa41fd7d5014c99bfcab3298079ca0067c3fad83d7a9"
Sep 04 22:12:05.934313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:05.934283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964800" event={"ID":"330a670d-1608-4b3e-b0b2-128b29be9c1d","Type":"ContainerStarted","Data":"3507562f3da66976c97db8aa27b53eaca4543cf5c7a05154e1b4712b9930355f"}
Sep 04 22:12:06.941676 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:06.941629    2577 generic.go:356] "Generic (PLEG): container finished" podID="330a670d-1608-4b3e-b0b2-128b29be9c1d" containerID="0b022d8f3e720ff34f81573a1e82dc7f8cf9a13572230ae195edda73422e3b16" exitCode=0
Sep 04 22:12:06.942147 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:06.941728    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7818-139874914964800" event={"ID":"330a670d-1608-4b3e-b0b2-128b29be9c1d","Type":"ContainerDied","Data":"0b022d8f3e720ff34f81573a1e82dc7f8cf9a13572230ae195edda73422e3b16"}
Sep 04 22:12:08.095389 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.095362    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:08.114513 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.114448    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7818-139874914964800_330a670d-1608-4b3e-b0b2-128b29be9c1d/test-curl-7818-139874914964800/0.log"
Sep 04 22:12:08.148934 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.148905    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:08.162045 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.162018    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7818-139874914964800"]
Sep 04 22:12:08.190280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.190257    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drpn9\" (UniqueName: \"kubernetes.io/projected/330a670d-1608-4b3e-b0b2-128b29be9c1d-kube-api-access-drpn9\") pod \"330a670d-1608-4b3e-b0b2-128b29be9c1d\" (UID: \"330a670d-1608-4b3e-b0b2-128b29be9c1d\") "
Sep 04 22:12:08.192357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.192329    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330a670d-1608-4b3e-b0b2-128b29be9c1d-kube-api-access-drpn9" (OuterVolumeSpecName: "kube-api-access-drpn9") pod "330a670d-1608-4b3e-b0b2-128b29be9c1d" (UID: "330a670d-1608-4b3e-b0b2-128b29be9c1d"). InnerVolumeSpecName "kube-api-access-drpn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:12:08.291738 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.291707    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drpn9\" (UniqueName: \"kubernetes.io/projected/330a670d-1608-4b3e-b0b2-128b29be9c1d-kube-api-access-drpn9\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:12:08.767282 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.767242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:08.955152 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.955122    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3507562f3da66976c97db8aa27b53eaca4543cf5c7a05154e1b4712b9930355f"
Sep 04 22:12:08.955152 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:08.955123    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:08.967025 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:12:08.966998    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7818-139874914964800\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="330a670d-1608-4b3e-b0b2-128b29be9c1d" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:09.065150 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.065063    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"]
Sep 04 22:12:09.065735 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.065705    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330a670d-1608-4b3e-b0b2-128b29be9c1d" containerName="test-curl-7818-139874914964800"
Sep 04 22:12:09.065735 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.065728    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="330a670d-1608-4b3e-b0b2-128b29be9c1d" containerName="test-curl-7818-139874914964800"
Sep 04 22:12:09.065933 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.065878    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="330a670d-1608-4b3e-b0b2-128b29be9c1d" containerName="test-curl-7818-139874914964800"
Sep 04 22:12:09.069025 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.069005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.071021 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:12:09.070989    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7818-139874914964800\" is forbidden: User \"system:node:ip-10-0-128-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-61.ec2.internal' and this object" podUID="330a670d-1608-4b3e-b0b2-128b29be9c1d" pod="opendatahub/test-curl-7818-139874914964800"
Sep 04 22:12:09.071235 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.071216    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bba28942-openshift-default-dockercfg-gqb8d\""
Sep 04 22:12:09.081333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.081307    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"]
Sep 04 22:12:09.100626 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.100593    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:09.199832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.199796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvpg6\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-kube-api-access-jvpg6\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.199844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-socket\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.199869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e867b71d-0302-43f4-9a67-53179c285389-istio-podinfo\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.199894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-data\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.199993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-istio-token\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200266 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.200058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-certs\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200266 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.200113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e867b71d-0302-43f4-9a67-53179c285389-istiod-ca-cert\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200266 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.200157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-credential-socket\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.200266 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.200190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-envoy\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-credential-socket\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-envoy\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvpg6\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-kube-api-access-jvpg6\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-socket\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e867b71d-0302-43f4-9a67-53179c285389-istio-podinfo\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-data\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.301969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.301961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-istio-token\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-certs\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-credential-socket\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e867b71d-0302-43f4-9a67-53179c285389-istiod-ca-cert\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-socket\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-data\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302475 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-certs\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.302883 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.302858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e867b71d-0302-43f4-9a67-53179c285389-istiod-ca-cert\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.304167 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.304140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-envoy\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.304393 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.304375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e867b71d-0302-43f4-9a67-53179c285389-istio-podinfo\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.313903 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.313869    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-istio-token\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.314395 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.314376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvpg6\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-kube-api-access-jvpg6\") pod \"e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") " pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.381265 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.381177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:09.647005 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.646919    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:09.666732 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.666701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"]
Sep 04 22:12:09.669125 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:12:09.669081    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode867b71d_0302_43f4_9a67_53179c285389.slice/crio-7f368339c86f85cfaf37f46c1fc46585eb1391b7c23aae18823ddaaecd9af5ca WatchSource:0}: Error finding container 7f368339c86f85cfaf37f46c1fc46585eb1391b7c23aae18823ddaaecd9af5ca: Status 404 returned error can't find the container with id 7f368339c86f85cfaf37f46c1fc46585eb1391b7c23aae18823ddaaecd9af5ca
Sep 04 22:12:09.672227 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.672191    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:12:09.672341 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.672268    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:12:09.672341 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.672315    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:12:09.853370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.853339    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330a670d-1608-4b3e-b0b2-128b29be9c1d" path="/var/lib/kubelet/pods/330a670d-1608-4b3e-b0b2-128b29be9c1d/volumes"
Sep 04 22:12:09.964139 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.964054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" event={"ID":"e867b71d-0302-43f4-9a67-53179c285389","Type":"ContainerStarted","Data":"2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"}
Sep 04 22:12:09.964139 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.964114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" event={"ID":"e867b71d-0302-43f4-9a67-53179c285389","Type":"ContainerStarted","Data":"7f368339c86f85cfaf37f46c1fc46585eb1391b7c23aae18823ddaaecd9af5ca"}
Sep 04 22:12:09.985224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:09.985172    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podStartSLOduration=0.985155811 podStartE2EDuration="985.155811ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:12:09.982578967 +0000 UTC m=+1126.754591976" watchObservedRunningTime="2026-09-04 22:12:09.985155811 +0000 UTC m=+1126.757168820"
Sep 04 22:12:10.381482 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:10.381451    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:10.386505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:10.386481    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:10.969793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:10.969761    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:10.970679 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:10.970656    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:11.898041 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:11.898004    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:11.994002 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:11.993965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:13.029916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.029884    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"]
Sep 04 22:12:13.034838 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.034817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.040100 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.040079    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bba28942-serving-cert\""
Sep 04 22:12:13.040215 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.040084    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2qzmr\""
Sep 04 22:12:13.040859 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.040840    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 04 22:12:13.041955 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.041936    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:12:13.042272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.042241    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 04 22:12:13.056176 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.056145    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"]
Sep 04 22:12:13.071060 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.071028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:13.138703 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.138660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bm7l\" (UniqueName: \"kubernetes.io/projected/7a30a4d6-4251-4c7f-8aae-08d6242197ed-kube-api-access-5bm7l\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.138906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.138805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-metrics-certs\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.138906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.138865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-maas-api-tls\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.138906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.138887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a30a4d6-4251-4c7f-8aae-08d6242197ed-openshift-service-ca\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.172817 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.172781    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:13.240022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.239986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bm7l\" (UniqueName: \"kubernetes.io/projected/7a30a4d6-4251-4c7f-8aae-08d6242197ed-kube-api-access-5bm7l\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.240226 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.240097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-metrics-certs\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.240226 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.240146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-maas-api-tls\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.240226 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.240168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a30a4d6-4251-4c7f-8aae-08d6242197ed-openshift-service-ca\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.240999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.240977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a30a4d6-4251-4c7f-8aae-08d6242197ed-openshift-service-ca\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.242616 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.242600    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-maas-api-tls\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.242703 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.242685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-metrics-certs\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.247906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.247885    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bm7l\" (UniqueName: \"kubernetes.io/projected/7a30a4d6-4251-4c7f-8aae-08d6242197ed-kube-api-access-5bm7l\") pod \"maas-api-e2e-mt-bba28942-7877b454b7-vpdgw\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.274010 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.273983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:13.346534 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.346466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:13.538191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.538163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:13.625777 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.625749    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"]
Sep 04 22:12:13.627333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.627305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:13.628260 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:12:13.628232    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a30a4d6_4251_4c7f_8aae_08d6242197ed.slice/crio-94188e09ca85cc2d34749dde184880b2ff47bf81719d767c76c9a89a74afef7b WatchSource:0}: Error finding container 94188e09ca85cc2d34749dde184880b2ff47bf81719d767c76c9a89a74afef7b: Status 404 returned error can't find the container with id 94188e09ca85cc2d34749dde184880b2ff47bf81719d767c76c9a89a74afef7b
Sep 04 22:12:13.989004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:13.988904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw" event={"ID":"7a30a4d6-4251-4c7f-8aae-08d6242197ed","Type":"ContainerStarted","Data":"94188e09ca85cc2d34749dde184880b2ff47bf81719d767c76c9a89a74afef7b"}
Sep 04 22:12:17.012710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:17.012669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw" event={"ID":"7a30a4d6-4251-4c7f-8aae-08d6242197ed","Type":"ContainerStarted","Data":"8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008"}
Sep 04 22:12:17.013177 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:17.012804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:17.031028 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:17.030973    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw" podStartSLOduration=1.687902758 podStartE2EDuration="4.030953378s" totalImagesPullingTime="2.34305062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:12:17.029391723 +0000 UTC m=+1133.801404734" watchObservedRunningTime="2026-09-04 22:12:17.030953378 +0000 UTC m=+1133.802966390"
Sep 04 22:12:19.585437 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:19.585386    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:23.025073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:23.025046    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:12:30.091605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:30.091570    2577 generic.go:356] "Generic (PLEG): container finished" podID="e867b71d-0302-43f4-9a67-53179c285389" containerID="2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d" exitCode=0
Sep 04 22:12:30.092021 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:30.091659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" event={"ID":"e867b71d-0302-43f4-9a67-53179c285389","Type":"ContainerDied","Data":"2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"}
Sep 04 22:12:30.092067 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:30.092032    2577 scope.go:117] "RemoveContainer" containerID="2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"
Sep 04 22:12:30.093131 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:30.093103    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:12:30.093197 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:30.093168    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:12:30.093233 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:30.093198    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:12:31.104022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:31.103970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" event={"ID":"e867b71d-0302-43f4-9a67-53179c285389","Type":"ContainerStarted","Data":"059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7"}
Sep 04 22:12:31.382006 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:31.381916    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:31.382165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:31.382102    2577 patch_prober.go:28] interesting pod/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 04 22:12:31.382165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:31.382148    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 04 22:12:32.382077 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:32.382042    2577 patch_prober.go:28] interesting pod/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 04 22:12:32.382469 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:32.382096    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 04 22:12:33.382376 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:33.382337    2577 patch_prober.go:28] interesting pod/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 04 22:12:33.382795 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:33.382393    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 04 22:12:34.381955 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:34.381917    2577 patch_prober.go:28] interesting pod/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 04 22:12:34.382126 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:34.381973    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 04 22:12:35.381917 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:35.381880    2577 patch_prober.go:28] interesting pod/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 04 22:12:35.382315 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:35.381937    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 04 22:12:36.385268 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:36.385241    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:36.385748 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:36.385730    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:36.386458 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:36.386441    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:12:36.898830 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:36.898792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:40.730828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:40.730796    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:12:54.662313 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:12:54.662192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:06.664867 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:06.664827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:07.562820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:07.562785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:11.354429 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:11.354392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:12.603027 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:12.602990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:20.650485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:20.650444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:23.752011 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:23.751981    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:13:23.754237 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:23.754211    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:13:23.839588 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:23.839550    2577 scope.go:117] "RemoveContainer" containerID="35a5d4969e846a83a33a7400a9b1d0101430a69a03bf4ff9a77f604d5c067686"
Sep 04 22:13:26.705016 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:26.700143    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"]
Sep 04 22:13:26.705016 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:26.700380    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw" podUID="7a30a4d6-4251-4c7f-8aae-08d6242197ed" containerName="maas-api" containerID="cri-o://8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008" gracePeriod=30
Sep 04 22:13:26.735081 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:26.735007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:26.826811 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:26.826766    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:26.926379 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:26.926305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:27.043304 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.042605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:27.070365 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.069365    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:13:27.171680 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.171622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a30a4d6-4251-4c7f-8aae-08d6242197ed-openshift-service-ca\") pod \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") "
Sep 04 22:13:27.171880 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.171852    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bm7l\" (UniqueName: \"kubernetes.io/projected/7a30a4d6-4251-4c7f-8aae-08d6242197ed-kube-api-access-5bm7l\") pod \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") "
Sep 04 22:13:27.172085 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.172069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-metrics-certs\") pod \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") "
Sep 04 22:13:27.172159 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.172135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-maas-api-tls\") pod \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\" (UID: \"7a30a4d6-4251-4c7f-8aae-08d6242197ed\") "
Sep 04 22:13:27.172280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.172254    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a30a4d6-4251-4c7f-8aae-08d6242197ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a30a4d6-4251-4c7f-8aae-08d6242197ed" (UID: "7a30a4d6-4251-4c7f-8aae-08d6242197ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:13:27.172545 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.172521    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a30a4d6-4251-4c7f-8aae-08d6242197ed-openshift-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:13:27.174493 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.174421    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a30a4d6-4251-4c7f-8aae-08d6242197ed" (UID: "7a30a4d6-4251-4c7f-8aae-08d6242197ed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:13:27.174616 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.174493    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a30a4d6-4251-4c7f-8aae-08d6242197ed" (UID: "7a30a4d6-4251-4c7f-8aae-08d6242197ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:13:27.174616 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.174539    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a30a4d6-4251-4c7f-8aae-08d6242197ed-kube-api-access-5bm7l" (OuterVolumeSpecName: "kube-api-access-5bm7l") pod "7a30a4d6-4251-4c7f-8aae-08d6242197ed" (UID: "7a30a4d6-4251-4c7f-8aae-08d6242197ed"). InnerVolumeSpecName "kube-api-access-5bm7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:13:27.273375 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.273293    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bm7l\" (UniqueName: \"kubernetes.io/projected/7a30a4d6-4251-4c7f-8aae-08d6242197ed-kube-api-access-5bm7l\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:13:27.273375 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.273324    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-metrics-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:13:27.273375 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.273334    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a30a4d6-4251-4c7f-8aae-08d6242197ed-maas-api-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:13:27.466121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.466078    2577 generic.go:356] "Generic (PLEG): container finished" podID="7a30a4d6-4251-4c7f-8aae-08d6242197ed" containerID="8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008" exitCode=0
Sep 04 22:13:27.466319 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.466176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw" event={"ID":"7a30a4d6-4251-4c7f-8aae-08d6242197ed","Type":"ContainerDied","Data":"8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008"}
Sep 04 22:13:27.466319 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.466274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw" event={"ID":"7a30a4d6-4251-4c7f-8aae-08d6242197ed","Type":"ContainerDied","Data":"94188e09ca85cc2d34749dde184880b2ff47bf81719d767c76c9a89a74afef7b"}
Sep 04 22:13:27.466319 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.466311    2577 scope.go:117] "RemoveContainer" containerID="8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008"
Sep 04 22:13:27.466513 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.466491    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"
Sep 04 22:13:27.489340 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.489319    2577 scope.go:117] "RemoveContainer" containerID="8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008"
Sep 04 22:13:27.489752 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:13:27.489726    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008\": container with ID starting with 8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008 not found: ID does not exist" containerID="8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008"
Sep 04 22:13:27.489752 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.489763    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008"} err="failed to get container status \"8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008\": rpc error: code = NotFound desc = could not find container \"8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008\": container with ID starting with 8f7f8f197a91e0a622675cd38e67c6c2aabacb90a49e97296ff3a68868dfa008 not found: ID does not exist"
Sep 04 22:13:27.498611 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.498579    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"]
Sep 04 22:13:27.504571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.504547    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bba28942-7877b454b7-vpdgw"]
Sep 04 22:13:27.853234 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:27.853197    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a30a4d6-4251-4c7f-8aae-08d6242197ed" path="/var/lib/kubelet/pods/7a30a4d6-4251-4c7f-8aae-08d6242197ed/volumes"
Sep 04 22:13:30.209113 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:30.209073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:35.290798 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:35.290759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:13:46.371699 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:13:46.371630    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:11.992148 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:11.992110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:12.263269 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:12.263241    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:17.774353 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:17.774276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:17.849139 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:17.849101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:18.026159 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:18.026075    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"]
Sep 04 22:14:18.026341 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:18.026298    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" containerID="cri-o://059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7" gracePeriod=30
Sep 04 22:14:18.057798 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:18.057771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:18.541220 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:18.541176    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:19.344065 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:19.344028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:19.444727 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:19.444696    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:19.544124 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:19.544093    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:20.173659 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:20.173603    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:20.261368 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:20.261335    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:20.362971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:20.362942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:21.387773 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:21.387740    2577 patch_prober.go:28] interesting pod/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:14:21.388196 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:21.387810    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:14:21.601480 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:21.601443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:22.399973 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:22.399938    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:23.257756 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.257725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:23.298994 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.298938    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:14:23.397541 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397509    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-certs\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.397729 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397557    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvpg6\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-kube-api-access-jvpg6\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.397729 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397585    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-credential-socket\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.397729 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-envoy\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.397886 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397769    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-socket\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.397886 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397806    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:14:23.397886 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397826    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e867b71d-0302-43f4-9a67-53179c285389-istio-podinfo\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.397886 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397866    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-istio-token\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.398089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397897    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-data\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.398089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e867b71d-0302-43f4-9a67-53179c285389-istiod-ca-cert\") pod \"e867b71d-0302-43f4-9a67-53179c285389\" (UID: \"e867b71d-0302-43f4-9a67-53179c285389\") "
Sep 04 22:14:23.398089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.397931    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:14:23.398089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398020    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:14:23.398311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398167    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-data" (OuterVolumeSpecName: "istio-data") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:14:23.398387 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398330    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e867b71d-0302-43f4-9a67-53179c285389-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:14:23.398438 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398418    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.398478 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398436    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.398478 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398451    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.398478 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398465    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.398581 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.398477    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e867b71d-0302-43f4-9a67-53179c285389-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.399969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.399941    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-kube-api-access-jvpg6" (OuterVolumeSpecName: "kube-api-access-jvpg6") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "kube-api-access-jvpg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:14:23.400109 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.399968    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-istio-token" (OuterVolumeSpecName: "istio-token") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:14:23.400415 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.400355    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e867b71d-0302-43f4-9a67-53179c285389-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:14:23.400415 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.400370    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e867b71d-0302-43f4-9a67-53179c285389" (UID: "e867b71d-0302-43f4-9a67-53179c285389"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:14:23.499419 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.499385    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvpg6\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-kube-api-access-jvpg6\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.499419 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.499417    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e867b71d-0302-43f4-9a67-53179c285389-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.499630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.499429    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e867b71d-0302-43f4-9a67-53179c285389-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.499630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.499440    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e867b71d-0302-43f4-9a67-53179c285389-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:14:23.804460 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.804426    2577 generic.go:356] "Generic (PLEG): container finished" podID="e867b71d-0302-43f4-9a67-53179c285389" containerID="059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7" exitCode=0
Sep 04 22:14:23.804610 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.804480    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"
Sep 04 22:14:23.804610 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.804496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" event={"ID":"e867b71d-0302-43f4-9a67-53179c285389","Type":"ContainerDied","Data":"059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7"}
Sep 04 22:14:23.804610 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.804551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t" event={"ID":"e867b71d-0302-43f4-9a67-53179c285389","Type":"ContainerDied","Data":"7f368339c86f85cfaf37f46c1fc46585eb1391b7c23aae18823ddaaecd9af5ca"}
Sep 04 22:14:23.804610 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.804581    2577 scope.go:117] "RemoveContainer" containerID="059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7"
Sep 04 22:14:23.814441 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.814420    2577 scope.go:117] "RemoveContainer" containerID="2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"
Sep 04 22:14:23.823524 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.823501    2577 scope.go:117] "RemoveContainer" containerID="059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7"
Sep 04 22:14:23.823875 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:14:23.823850    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7\": container with ID starting with 059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7 not found: ID does not exist" containerID="059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7"
Sep 04 22:14:23.823969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.823885    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7"} err="failed to get container status \"059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7\": rpc error: code = NotFound desc = could not find container \"059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7\": container with ID starting with 059aa0f7c1840e90920a177ebf08dc488736249ced725fa6e780b5cb42d4a5d7 not found: ID does not exist"
Sep 04 22:14:23.823969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.823911    2577 scope.go:117] "RemoveContainer" containerID="2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"
Sep 04 22:14:23.824222 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:14:23.824199    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d\": container with ID starting with 2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d not found: ID does not exist" containerID="2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"
Sep 04 22:14:23.824266 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.824232    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d"} err="failed to get container status \"2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d\": rpc error: code = NotFound desc = could not find container \"2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d\": container with ID starting with 2f8f17d7b9709e04bca33d5e3664fc4fb6d36bed8941644da02ed7a4ab89713d not found: ID does not exist"
Sep 04 22:14:23.826110 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.826091    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"]
Sep 04 22:14:23.832058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.832037    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t"]
Sep 04 22:14:23.851794 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.851773    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e867b71d-0302-43f4-9a67-53179c285389" path="/var/lib/kubelet/pods/e867b71d-0302-43f4-9a67-53179c285389/volumes"
Sep 04 22:14:23.871578 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.871559    2577 scope.go:117] "RemoveContainer" containerID="bdea1e2505229abef7251c119a85185308a8426e40e3f896a009714a8d361542"
Sep 04 22:14:23.879610 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:23.879597    2577 scope.go:117] "RemoveContainer" containerID="3c0ed5b075da99df5ac280ec30025d2c01913ac9119d85375fd70632ee42d037"
Sep 04 22:14:26.327100 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:26.327066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:26.384143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:26.384121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:27.578332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:27.578299    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:27.640212 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:27.640181    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:28.257907 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:28.257850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:33.675997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:33.675956    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:34.393035 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:34.392998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:34.500201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:34.500156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:34.592851 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:34.592815    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:41.764333 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:41.764296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:41.865969 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:41.865932    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:45.133488 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:45.133455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:45.366055 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:45.366025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:54.697737 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:54.697702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:14:54.795432 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:14:54.795393    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:00.137595 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.137561    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"]
Sep 04 22:15:00.138038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.137995    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a30a4d6-4251-4c7f-8aae-08d6242197ed" containerName="maas-api"
Sep 04 22:15:00.138038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138010    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a30a4d6-4251-4c7f-8aae-08d6242197ed" containerName="maas-api"
Sep 04 22:15:00.138038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138020    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy"
Sep 04 22:15:00.138038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138026    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy"
Sep 04 22:15:00.138038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138033    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy"
Sep 04 22:15:00.138038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138038    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy"
Sep 04 22:15:00.138330 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138117    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy"
Sep 04 22:15:00.138330 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138128    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a30a4d6-4251-4c7f-8aae-08d6242197ed" containerName="maas-api"
Sep 04 22:15:00.138330 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.138135    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e867b71d-0302-43f4-9a67-53179c285389" containerName="istio-proxy"
Sep 04 22:15:00.141308 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.141293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"
Sep 04 22:15:00.143702 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.143679    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:15:00.144909 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.144893    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"]
Sep 04 22:15:00.148744 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.148709    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"]
Sep 04 22:15:00.148964 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.148944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"
Sep 04 22:15:00.152454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.152434    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"]
Sep 04 22:15:00.152564 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.152520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"
Sep 04 22:15:00.154097 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.154071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"
Sep 04 22:15:00.159600 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.159578    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"]
Sep 04 22:15:00.161557 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.161528    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"]
Sep 04 22:15:00.167764 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.167745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"
Sep 04 22:15:00.215810 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.215789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"
Sep 04 22:15:00.453161 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.453136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"]
Sep 04 22:15:00.453703 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:00.453679    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b565633_da08_44bb_83fc_e469fcf5534d.slice/crio-c4a905fc07284b4a9c9b16cf96cb679a585e6989fffd919b9d1ce9957f04f393 WatchSource:0}: Error finding container c4a905fc07284b4a9c9b16cf96cb679a585e6989fffd919b9d1ce9957f04f393: Status 404 returned error can't find the container with id c4a905fc07284b4a9c9b16cf96cb679a585e6989fffd919b9d1ce9957f04f393
Sep 04 22:15:00.475241 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:00.475212    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec73f9bc_f88b_44bf_9a84_5a193b47c52b.slice/crio-1e6ac8ad468307ddb73e646dc3a8b118d5e3acf96b625c6649a714b2070e56fc WatchSource:0}: Error finding container 1e6ac8ad468307ddb73e646dc3a8b118d5e3acf96b625c6649a714b2070e56fc: Status 404 returned error can't find the container with id 1e6ac8ad468307ddb73e646dc3a8b118d5e3acf96b625c6649a714b2070e56fc
Sep 04 22:15:00.476147 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.476124    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"]
Sep 04 22:15:00.508919 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:00.508898    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"]
Sep 04 22:15:00.509577 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:00.509553    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8089bc4_ac16_48fe_b018_ea2590f14d0f.slice/crio-c2392214948b24fdd410b79ca869b3f95eb5c12d39d4412d50829f944c10c998 WatchSource:0}: Error finding container c2392214948b24fdd410b79ca869b3f95eb5c12d39d4412d50829f944c10c998: Status 404 returned error can't find the container with id c2392214948b24fdd410b79ca869b3f95eb5c12d39d4412d50829f944c10c998
Sep 04 22:15:01.014294 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.014261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp" event={"ID":"b8089bc4-ac16-48fe-b018-ea2590f14d0f","Type":"ContainerStarted","Data":"168e4ef97c8ea240a5221d93910cedf4a43b80f694183cdd74ba8fceb981a783"}
Sep 04 22:15:01.014476 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.014315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp" event={"ID":"b8089bc4-ac16-48fe-b018-ea2590f14d0f","Type":"ContainerStarted","Data":"c2392214948b24fdd410b79ca869b3f95eb5c12d39d4412d50829f944c10c998"}
Sep 04 22:15:01.015852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.015820    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck" event={"ID":"1b565633-da08-44bb-83fc-e469fcf5534d","Type":"ContainerStarted","Data":"ccccfa70c4789d8bb9d1d910cf1d8f87b9c5f52e5ed21fe400d917486a131e55"}
Sep 04 22:15:01.015975 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.015876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck" event={"ID":"1b565633-da08-44bb-83fc-e469fcf5534d","Type":"ContainerStarted","Data":"c4a905fc07284b4a9c9b16cf96cb679a585e6989fffd919b9d1ce9957f04f393"}
Sep 04 22:15:01.017364 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.017280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4" event={"ID":"ec73f9bc-f88b-44bf-9a84-5a193b47c52b","Type":"ContainerStarted","Data":"dbbd3ab4ac788f762f8b6c19c29ef1f98aa73ab610e773038dd631360b15c2c5"}
Sep 04 22:15:01.017364 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.017320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4" event={"ID":"ec73f9bc-f88b-44bf-9a84-5a193b47c52b","Type":"ContainerStarted","Data":"1e6ac8ad468307ddb73e646dc3a8b118d5e3acf96b625c6649a714b2070e56fc"}
Sep 04 22:15:01.029887 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.029835    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp" podStartSLOduration=1.0298219 podStartE2EDuration="1.0298219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:01.028054285 +0000 UTC m=+1297.800067297" watchObservedRunningTime="2026-09-04 22:15:01.0298219 +0000 UTC m=+1297.801834909"
Sep 04 22:15:01.045195 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.045149    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck" podStartSLOduration=1.04512512 podStartE2EDuration="1.04512512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:01.042986102 +0000 UTC m=+1297.814999112" watchObservedRunningTime="2026-09-04 22:15:01.04512512 +0000 UTC m=+1297.817138131"
Sep 04 22:15:01.058405 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:01.058358    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4" podStartSLOduration=1.058342387 podStartE2EDuration="1.058342387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:01.056057179 +0000 UTC m=+1297.828070189" watchObservedRunningTime="2026-09-04 22:15:01.058342387 +0000 UTC m=+1297.830355397"
Sep 04 22:15:02.025617 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:02.025583    2577 generic.go:356] "Generic (PLEG): container finished" podID="ec73f9bc-f88b-44bf-9a84-5a193b47c52b" containerID="dbbd3ab4ac788f762f8b6c19c29ef1f98aa73ab610e773038dd631360b15c2c5" exitCode=0
Sep 04 22:15:02.026104 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:02.025629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4" event={"ID":"ec73f9bc-f88b-44bf-9a84-5a193b47c52b","Type":"ContainerDied","Data":"dbbd3ab4ac788f762f8b6c19c29ef1f98aa73ab610e773038dd631360b15c2c5"}
Sep 04 22:15:02.027233 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:02.027210    2577 generic.go:356] "Generic (PLEG): container finished" podID="b8089bc4-ac16-48fe-b018-ea2590f14d0f" containerID="168e4ef97c8ea240a5221d93910cedf4a43b80f694183cdd74ba8fceb981a783" exitCode=0
Sep 04 22:15:02.027356 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:02.027285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp" event={"ID":"b8089bc4-ac16-48fe-b018-ea2590f14d0f","Type":"ContainerDied","Data":"168e4ef97c8ea240a5221d93910cedf4a43b80f694183cdd74ba8fceb981a783"}
Sep 04 22:15:02.028813 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:02.028767    2577 generic.go:356] "Generic (PLEG): container finished" podID="1b565633-da08-44bb-83fc-e469fcf5534d" containerID="ccccfa70c4789d8bb9d1d910cf1d8f87b9c5f52e5ed21fe400d917486a131e55" exitCode=0
Sep 04 22:15:02.028913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:02.028814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck" event={"ID":"1b565633-da08-44bb-83fc-e469fcf5534d","Type":"ContainerDied","Data":"ccccfa70c4789d8bb9d1d910cf1d8f87b9c5f52e5ed21fe400d917486a131e55"}
Sep 04 22:15:03.171214 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:03.171184    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"
Sep 04 22:15:03.230253 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:03.230230    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"
Sep 04 22:15:03.233133 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:03.233115    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"
Sep 04 22:15:04.041953 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.041924    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"
Sep 04 22:15:04.041953 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.041941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4" event={"ID":"ec73f9bc-f88b-44bf-9a84-5a193b47c52b","Type":"ContainerDied","Data":"1e6ac8ad468307ddb73e646dc3a8b118d5e3acf96b625c6649a714b2070e56fc"}
Sep 04 22:15:04.042195 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.041996    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e6ac8ad468307ddb73e646dc3a8b118d5e3acf96b625c6649a714b2070e56fc"
Sep 04 22:15:04.043311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.043287    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"
Sep 04 22:15:04.043429 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.043362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp" event={"ID":"b8089bc4-ac16-48fe-b018-ea2590f14d0f","Type":"ContainerDied","Data":"c2392214948b24fdd410b79ca869b3f95eb5c12d39d4412d50829f944c10c998"}
Sep 04 22:15:04.043429 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.043406    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2392214948b24fdd410b79ca869b3f95eb5c12d39d4412d50829f944c10c998"
Sep 04 22:15:04.044967 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.044934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck" event={"ID":"1b565633-da08-44bb-83fc-e469fcf5534d","Type":"ContainerDied","Data":"c4a905fc07284b4a9c9b16cf96cb679a585e6989fffd919b9d1ce9957f04f393"}
Sep 04 22:15:04.045099 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.044976    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4a905fc07284b4a9c9b16cf96cb679a585e6989fffd919b9d1ce9957f04f393"
Sep 04 22:15:04.045099 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:04.044945    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"
Sep 04 22:15:06.333113 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:06.333082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:12.444663 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:12.444597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:12.545495 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:12.545459    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:12.818072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:12.818040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:13.094481 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.094396    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"]
Sep 04 22:15:13.094976 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.094945    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec73f9bc-f88b-44bf-9a84-5a193b47c52b" containerName="cleanup"
Sep 04 22:15:13.094976 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.094977    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec73f9bc-f88b-44bf-9a84-5a193b47c52b" containerName="cleanup"
Sep 04 22:15:13.095149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095016    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b565633-da08-44bb-83fc-e469fcf5534d" containerName="cleanup"
Sep 04 22:15:13.095149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095025    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b565633-da08-44bb-83fc-e469fcf5534d" containerName="cleanup"
Sep 04 22:15:13.095149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095039    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8089bc4-ac16-48fe-b018-ea2590f14d0f" containerName="cleanup"
Sep 04 22:15:13.095149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095048    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8089bc4-ac16-48fe-b018-ea2590f14d0f" containerName="cleanup"
Sep 04 22:15:13.095417 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095151    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec73f9bc-f88b-44bf-9a84-5a193b47c52b" containerName="cleanup"
Sep 04 22:15:13.095417 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095164    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8089bc4-ac16-48fe-b018-ea2590f14d0f" containerName="cleanup"
Sep 04 22:15:13.095417 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.095178    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b565633-da08-44bb-83fc-e469fcf5534d" containerName="cleanup"
Sep 04 22:15:13.098583 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.098562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.100847 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.100828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-25d966-openshift-default-dockercfg-qlvnx\""
Sep 04 22:15:13.109150 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.108954    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"]
Sep 04 22:15:13.124755 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.124722    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:13.146339 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-podinfo\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146451 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-envoy\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146451 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cww8r\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-kube-api-access-cww8r\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146451 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-credential-socket\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146451 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-certs\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146653 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-socket\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146653 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-data\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146653 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-token\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.146794 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.146667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9109be-3b0b-4f50-9598-2f84bde776b7-istiod-ca-cert\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247267 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-socket\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247267 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-data\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247526 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-token\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247526 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9109be-3b0b-4f50-9598-2f84bde776b7-istiod-ca-cert\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247651 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-podinfo\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247651 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-envoy\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cww8r\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-kube-api-access-cww8r\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-credential-socket\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-data\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-certs\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.247962 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.247779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-socket\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.248132 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.248106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-credential-socket\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.248260 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.248133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-certs\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.248260 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.248133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9109be-3b0b-4f50-9598-2f84bde776b7-istiod-ca-cert\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.250156 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.250133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-podinfo\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.250250 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.250233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-envoy\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.256176 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.256147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-token\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.256506 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.256487    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cww8r\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-kube-api-access-cww8r\") pod \"e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") " pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.412653 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.412553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:13.574951 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.574913    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:13.707389 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.707324    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"]
Sep 04 22:15:13.710203 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:13.710172    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9109be_3b0b_4f50_9598_2f84bde776b7.slice/crio-0bb13c332dcef233b090aee461012d607eb2df4a66f8201674a98c0f4f60ea7f WatchSource:0}: Error finding container 0bb13c332dcef233b090aee461012d607eb2df4a66f8201674a98c0f4f60ea7f: Status 404 returned error can't find the container with id 0bb13c332dcef233b090aee461012d607eb2df4a66f8201674a98c0f4f60ea7f
Sep 04 22:15:13.712588 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.712551    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:13.712690 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.712670    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:13.712742 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:13.712725    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:14.104847 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:14.104813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" event={"ID":"cf9109be-3b0b-4f50-9598-2f84bde776b7","Type":"ContainerStarted","Data":"e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"}
Sep 04 22:15:14.105293 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:14.104865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" event={"ID":"cf9109be-3b0b-4f50-9598-2f84bde776b7","Type":"ContainerStarted","Data":"0bb13c332dcef233b090aee461012d607eb2df4a66f8201674a98c0f4f60ea7f"}
Sep 04 22:15:14.128943 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:14.128897    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podStartSLOduration=1.128882129 podStartE2EDuration="1.128882129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:14.1269936 +0000 UTC m=+1310.899006609" watchObservedRunningTime="2026-09-04 22:15:14.128882129 +0000 UTC m=+1310.900895138"
Sep 04 22:15:14.413210 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:14.413127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:14.418935 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:14.418907    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:15.111569 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:15.111531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:15.112524 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:15.112506    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:16.083536 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:16.083484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:16.173149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:16.173113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:17.196603 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.196574    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"]
Sep 04 22:15:17.201268 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.201246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.204853 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.204828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-25d966-serving-cert\""
Sep 04 22:15:17.204978 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.204838    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2qzmr\""
Sep 04 22:15:17.205355 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.205336    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 04 22:15:17.205440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.205362    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 04 22:15:17.205440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.205395    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:15:17.215418 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.213507    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"]
Sep 04 22:15:17.246081 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.246053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:17.282373 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.282345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69714a8-b81c-4101-b10d-fb742f7bf438-openshift-service-ca\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.282500 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.282407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.282500 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.282483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc7l6\" (UniqueName: \"kubernetes.io/projected/b69714a8-b81c-4101-b10d-fb742f7bf438-kube-api-access-hc7l6\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.282580 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.282567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-metrics-certs\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.346789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.346750    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:17.383896 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.383867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.384065 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.383912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc7l6\" (UniqueName: \"kubernetes.io/projected/b69714a8-b81c-4101-b10d-fb742f7bf438-kube-api-access-hc7l6\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.384065 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.383967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-metrics-certs\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.384065 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.383997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69714a8-b81c-4101-b10d-fb742f7bf438-openshift-service-ca\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.384065 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:15:17.384014    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-serving-cert: secret "maas-api-e2e-api-a-25d966-serving-cert" not found
Sep 04 22:15:17.384223 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:15:17.384114    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls podName:b69714a8-b81c-4101-b10d-fb742f7bf438 nodeName:}" failed. No retries permitted until 2026-09-04 22:15:17.884091006 +0000 UTC m=+1314.656103994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls") pod "maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" (UID: "b69714a8-b81c-4101-b10d-fb742f7bf438") : secret "maas-api-e2e-api-a-25d966-serving-cert" not found
Sep 04 22:15:17.384644 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.384622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69714a8-b81c-4101-b10d-fb742f7bf438-openshift-service-ca\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.386343 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.386325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-metrics-certs\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.392754 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.392734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc7l6\" (UniqueName: \"kubernetes.io/projected/b69714a8-b81c-4101-b10d-fb742f7bf438-kube-api-access-hc7l6\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.571342 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.571308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:17.722105 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.722065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:17.821435 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.821352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:17.889665 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.889609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:17.892058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:17.892033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls\") pod \"maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:18.116917 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:18.116834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:18.391621 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:18.391588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"]
Sep 04 22:15:18.392341 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:18.392313    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69714a8_b81c_4101_b10d_fb742f7bf438.slice/crio-881c59b109e04d27d99ef1fd5660b1c104479fe62f49b77cfb710410f4de7e7a WatchSource:0}: Error finding container 881c59b109e04d27d99ef1fd5660b1c104479fe62f49b77cfb710410f4de7e7a: Status 404 returned error can't find the container with id 881c59b109e04d27d99ef1fd5660b1c104479fe62f49b77cfb710410f4de7e7a
Sep 04 22:15:19.134598 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:19.134517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" event={"ID":"b69714a8-b81c-4101-b10d-fb742f7bf438","Type":"ContainerStarted","Data":"0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6"}
Sep 04 22:15:19.134598 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:19.134573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" event={"ID":"b69714a8-b81c-4101-b10d-fb742f7bf438","Type":"ContainerStarted","Data":"881c59b109e04d27d99ef1fd5660b1c104479fe62f49b77cfb710410f4de7e7a"}
Sep 04 22:15:19.134598 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:19.134595    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:19.156422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:19.156369    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" podStartSLOduration=1.688358777 podStartE2EDuration="2.156354836s" totalImagesPullingTime="467.996059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:19.154286649 +0000 UTC m=+1315.926299659" watchObservedRunningTime="2026-09-04 22:15:19.156354836 +0000 UTC m=+1315.928367845"
Sep 04 22:15:23.913488 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:23.913458    2577 scope.go:117] "RemoveContainer" containerID="b1696e624d39d50a43c5506984e5cc275929c10572751bf2a89f750144ad48f5"
Sep 04 22:15:23.922244 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:23.922222    2577 scope.go:117] "RemoveContainer" containerID="aabdec4b1b61e448c3a894e050c2a3c26f34d4ab831e77633ad42e1ec388b1f3"
Sep 04 22:15:25.063057 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:25.063026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:25.147037 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:25.147011    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:15:34.225799 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:34.225722    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerID="e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14" exitCode=0
Sep 04 22:15:34.226180 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:34.225796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" event={"ID":"cf9109be-3b0b-4f50-9598-2f84bde776b7","Type":"ContainerDied","Data":"e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"}
Sep 04 22:15:34.226180 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:34.226166    2577 scope.go:117] "RemoveContainer" containerID="e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"
Sep 04 22:15:34.227321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:34.227286    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:34.227422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:34.227355    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:34.227422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:34.227386    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:35.233631 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:35.233596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" event={"ID":"cf9109be-3b0b-4f50-9598-2f84bde776b7","Type":"ContainerStarted","Data":"b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe"}
Sep 04 22:15:35.412931 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:35.412884    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:35.413151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:35.413060    2577 patch_prober.go:28] interesting pod/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 04 22:15:35.413151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:35.413115    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 04 22:15:36.413477 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:36.413438    2577 patch_prober.go:28] interesting pod/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 04 22:15:36.413913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:36.413507    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 04 22:15:37.413622 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:37.413580    2577 patch_prober.go:28] interesting pod/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 04 22:15:37.414156 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:37.413714    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 04 22:15:38.101606 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:38.101558    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:38.413545 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:38.413445    2577 patch_prober.go:28] interesting pod/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 04 22:15:38.413545 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:38.413524    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 04 22:15:39.392399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:39.392369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:39.413044 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:39.413003    2577 patch_prober.go:28] interesting pod/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 04 22:15:39.413217 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:39.413064    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 04 22:15:39.493327 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:39.493291    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:40.417216 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:40.417179    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:40.417613 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:40.417593    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:40.418403 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:40.418382    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:15:41.058326 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.058253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:41.516704 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.516677    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:41.788547 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.788466    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"]
Sep 04 22:15:41.792336 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.792308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.794823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.794798    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dac33e-openshift-default-dockercfg-2hxhc\""
Sep 04 22:15:41.812196 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.808212    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"]
Sep 04 22:15:41.817832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.817809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:41.930818 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.930778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-envoy\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931020 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.930825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-socket\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931020 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.930869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-credential-socket\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931020 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.930995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istiod-ca-cert\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.931029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-data\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.931051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-certs\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.931074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-token\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.931094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-podinfo\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:41.931189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:41.931148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jllbf\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-kube-api-access-jllbf\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032685 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jllbf\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-kube-api-access-jllbf\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-envoy\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-socket\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032832 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-credential-socket\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istiod-ca-cert\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-data\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-certs\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.032971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-token\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.033189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.032979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-podinfo\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.033189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.033130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-socket\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.033298 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.033216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-credential-socket\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.033298 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.033270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-data\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.033384 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.033329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-certs\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.033743 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.033717    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istiod-ca-cert\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.035228 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.035197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-envoy\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.035556 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.035537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-podinfo\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.040107 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.040046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jllbf\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-kube-api-access-jllbf\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.040107 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.040053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-token\") pod \"e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") " pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.106485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.106458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:42.386571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.386540    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"]
Sep 04 22:15:42.386718 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:42.386540    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31af54e_7fd9_4d89_b0aa_a850656df7a7.slice/crio-1cfeda353ffed0587992bac423e3e4153f41abec637e64cbb1448e3df8ff044b WatchSource:0}: Error finding container 1cfeda353ffed0587992bac423e3e4153f41abec637e64cbb1448e3df8ff044b: Status 404 returned error can't find the container with id 1cfeda353ffed0587992bac423e3e4153f41abec637e64cbb1448e3df8ff044b
Sep 04 22:15:42.388885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.388853    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:42.388997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.388926    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:42.389061 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.388994    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:15:42.398200 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:42.398173    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:43.288631 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:43.288589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" event={"ID":"a31af54e-7fd9-4d89-b0aa-a850656df7a7","Type":"ContainerStarted","Data":"187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"}
Sep 04 22:15:43.289035 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:43.288683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" event={"ID":"a31af54e-7fd9-4d89-b0aa-a850656df7a7","Type":"ContainerStarted","Data":"1cfeda353ffed0587992bac423e3e4153f41abec637e64cbb1448e3df8ff044b"}
Sep 04 22:15:43.312458 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:43.312413    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podStartSLOduration=2.312398732 podStartE2EDuration="2.312398732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:43.309473739 +0000 UTC m=+1340.081486746" watchObservedRunningTime="2026-09-04 22:15:43.312398732 +0000 UTC m=+1340.084411742"
Sep 04 22:15:44.107079 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:44.107049    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:44.112964 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:44.112937    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:44.294194 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:44.294163    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:44.295002 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:44.294980    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:15:45.214243 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:45.214207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:45.314532 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:45.314505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:46.436873 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.436782    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"]
Sep 04 22:15:46.439953 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.439934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.441948 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.441927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-dac33e-serving-cert\""
Sep 04 22:15:46.451596 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.451572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"]
Sep 04 22:15:46.474811 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.474786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:46.547288 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.547084    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:46.575274 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.575239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-metrics-certs\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.575445 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.575356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-maas-api-tls\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.575445 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.575413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsdk\" (UniqueName: \"kubernetes.io/projected/3c32171b-07fd-4375-8a1b-147003bbabe0-kube-api-access-qdsdk\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.575528 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.575450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c32171b-07fd-4375-8a1b-147003bbabe0-openshift-service-ca\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.651092 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.651048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:46.676201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.676173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-maas-api-tls\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.676332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.676214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsdk\" (UniqueName: \"kubernetes.io/projected/3c32171b-07fd-4375-8a1b-147003bbabe0-kube-api-access-qdsdk\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.676332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.676256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c32171b-07fd-4375-8a1b-147003bbabe0-openshift-service-ca\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.676332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.676313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-metrics-certs\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.676958 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.676936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c32171b-07fd-4375-8a1b-147003bbabe0-openshift-service-ca\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.678722 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.678703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-metrics-certs\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.678799 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.678765    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-maas-api-tls\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.684010 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.683991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsdk\" (UniqueName: \"kubernetes.io/projected/3c32171b-07fd-4375-8a1b-147003bbabe0-kube-api-access-qdsdk\") pod \"maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.752576 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.752548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:46.922093 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:46.922065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:47.012448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:47.012373    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:47.034709 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:47.034681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"]
Sep 04 22:15:47.035694 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:15:47.035667    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c32171b_07fd_4375_8a1b_147003bbabe0.slice/crio-5e1868a717be0b9fd00dfed054e9146b520db4cb0a041ebd569cc271d185a634 WatchSource:0}: Error finding container 5e1868a717be0b9fd00dfed054e9146b520db4cb0a041ebd569cc271d185a634: Status 404 returned error can't find the container with id 5e1868a717be0b9fd00dfed054e9146b520db4cb0a041ebd569cc271d185a634
Sep 04 22:15:47.314295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:47.314212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n" event={"ID":"3c32171b-07fd-4375-8a1b-147003bbabe0","Type":"ContainerStarted","Data":"5e1868a717be0b9fd00dfed054e9146b520db4cb0a041ebd569cc271d185a634"}
Sep 04 22:15:48.322547 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:48.322515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n" event={"ID":"3c32171b-07fd-4375-8a1b-147003bbabe0","Type":"ContainerStarted","Data":"21a322fe303e644b50392fbafc10eda73587857f4c103f2f7b05214e0ace1955"}
Sep 04 22:15:48.322989 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:48.322575    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:48.344886 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:48.344838    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n" podStartSLOduration=1.71200551 podStartE2EDuration="2.344824087s" totalImagesPullingTime="632.818577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:48.342701224 +0000 UTC m=+1345.114714234" watchObservedRunningTime="2026-09-04 22:15:48.344824087 +0000 UTC m=+1345.116837097"
Sep 04 22:15:54.334330 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:54.334302    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:15:57.143992 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:57.143962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:58.042899 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:58.042852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:58.511823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:58.511786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:58.827498 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:58.827404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:15:58.925187 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:15:58.925140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:02.382763 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:02.382727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:02.484932 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:02.484898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:03.542834 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.542804    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"]
Sep 04 22:16:03.545710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.545691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.547591 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.547567    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-cc92e2-serving-cert\""
Sep 04 22:16:03.558086 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.558009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"]
Sep 04 22:16:03.637592 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.637563    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:03.659712 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.659688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.659834 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.659721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.659907 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.659841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grf54\" (UniqueName: \"kubernetes.io/projected/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-kube-api-access-grf54\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.659907 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.659870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-metrics-certs\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.737258 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.737214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:03.760470 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.760443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grf54\" (UniqueName: \"kubernetes.io/projected/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-kube-api-access-grf54\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.760598 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.760485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-metrics-certs\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.760598 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.760574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.760719 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.760609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.760760 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:03.760725    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-serving-cert: secret "maas-api-e2e-ipp-a-cc92e2-serving-cert" not found
Sep 04 22:16:03.760801 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:03.760792    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls podName:ab140c4b-83f9-4b96-a3b2-0d5bf7045116 nodeName:}" failed. No retries permitted until 2026-09-04 22:16:04.260772509 +0000 UTC m=+1361.032785498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls") pod "maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" (UID: "ab140c4b-83f9-4b96-a3b2-0d5bf7045116") : secret "maas-api-e2e-ipp-a-cc92e2-serving-cert" not found
Sep 04 22:16:03.761315 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.761293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.763033 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.763012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-metrics-certs\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:03.770584 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:03.770561    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grf54\" (UniqueName: \"kubernetes.io/projected/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-kube-api-access-grf54\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:04.203370 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.203321    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:04.264704 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.264672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:04.264872 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:04.264823    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-serving-cert: secret "maas-api-e2e-ipp-a-cc92e2-serving-cert" not found
Sep 04 22:16:04.264924 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:04.264896    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls podName:ab140c4b-83f9-4b96-a3b2-0d5bf7045116 nodeName:}" failed. No retries permitted until 2026-09-04 22:16:05.26488119 +0000 UTC m=+1362.036894178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls") pod "maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" (UID: "ab140c4b-83f9-4b96-a3b2-0d5bf7045116") : secret "maas-api-e2e-ipp-a-cc92e2-serving-cert" not found
Sep 04 22:16:04.303543 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.303508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:04.432661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.427358    2577 generic.go:356] "Generic (PLEG): container finished" podID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerID="187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37" exitCode=0
Sep 04 22:16:04.432661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.427477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" event={"ID":"a31af54e-7fd9-4d89-b0aa-a850656df7a7","Type":"ContainerDied","Data":"187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"}
Sep 04 22:16:04.432661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.428098    2577 scope.go:117] "RemoveContainer" containerID="187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"
Sep 04 22:16:04.432661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.429939    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:16:04.432661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.430027    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:16:04.432661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.430074    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:16:04.433536 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:04.432739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:05.276445 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:05.276413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:05.278888 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:05.278865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:05.357291 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:05.357252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:05.440805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:05.439877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" event={"ID":"a31af54e-7fd9-4d89-b0aa-a850656df7a7","Type":"ContainerStarted","Data":"f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2"}
Sep 04 22:16:05.651835 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:05.651797    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"]
Sep 04 22:16:05.653250 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:16:05.653221    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab140c4b_83f9_4b96_a3b2_0d5bf7045116.slice/crio-d2c456a0e0072e314b08dc6497187c716c0c558012efccd12697cec4fd0ca524 WatchSource:0}: Error finding container d2c456a0e0072e314b08dc6497187c716c0c558012efccd12697cec4fd0ca524: Status 404 returned error can't find the container with id d2c456a0e0072e314b08dc6497187c716c0c558012efccd12697cec4fd0ca524
Sep 04 22:16:06.107869 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.107471    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:16:06.107869 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.107582    2577 patch_prober.go:28] interesting pod/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 04 22:16:06.107869 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.107621    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 04 22:16:06.447049 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.446957    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" event={"ID":"ab140c4b-83f9-4b96-a3b2-0d5bf7045116","Type":"ContainerStarted","Data":"b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1"}
Sep 04 22:16:06.447049 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.447025    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:06.447049 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.447049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" event={"ID":"ab140c4b-83f9-4b96-a3b2-0d5bf7045116","Type":"ContainerStarted","Data":"d2c456a0e0072e314b08dc6497187c716c0c558012efccd12697cec4fd0ca524"}
Sep 04 22:16:06.466019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:06.465972    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" podStartSLOduration=3.095498446 podStartE2EDuration="3.465957568s" totalImagesPullingTime="370.459122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:16:06.462672773 +0000 UTC m=+1363.234685779" watchObservedRunningTime="2026-09-04 22:16:06.465957568 +0000 UTC m=+1363.237970577"
Sep 04 22:16:07.107108 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:07.107061    2577 patch_prober.go:28] interesting pod/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 04 22:16:07.107324 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:07.107132    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 04 22:16:07.471442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:07.471329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:08.107726 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:08.107691    2577 patch_prober.go:28] interesting pod/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 04 22:16:08.108024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:08.107992    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 04 22:16:09.107096 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:09.107056    2577 patch_prober.go:28] interesting pod/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 04 22:16:09.107665 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:09.107612    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 04 22:16:10.107226 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:10.107183    2577 patch_prober.go:28] interesting pod/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 04 22:16:10.107866 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:10.107827    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 04 22:16:10.214489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:10.214447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:11.111882 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:11.111855    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:16:11.112295 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:11.112131    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:16:11.112802 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:11.112783    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:16:12.457560 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:12.457530    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:16:13.241992 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:13.241960    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:24.038880 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:24.038844    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:24.692058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:24.692021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:27.296977 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:27.296926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:27.964774 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:27.964740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:28.301033 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.300992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:28.553480 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.553397    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"]
Sep 04 22:16:28.553671 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.553628    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" podUID="b69714a8-b81c-4101-b10d-fb742f7bf438" containerName="maas-api" containerID="cri-o://0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6" gracePeriod=30
Sep 04 22:16:28.584399 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.584361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:28.682778 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.682750    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:28.786254 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.786197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:28.816839 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.816787    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:16:28.882514 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.882485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:28.909662 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.909613    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls\") pod \"b69714a8-b81c-4101-b10d-fb742f7bf438\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") "
Sep 04 22:16:28.910390 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.909702    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc7l6\" (UniqueName: \"kubernetes.io/projected/b69714a8-b81c-4101-b10d-fb742f7bf438-kube-api-access-hc7l6\") pod \"b69714a8-b81c-4101-b10d-fb742f7bf438\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") "
Sep 04 22:16:28.910390 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.909737    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69714a8-b81c-4101-b10d-fb742f7bf438-openshift-service-ca\") pod \"b69714a8-b81c-4101-b10d-fb742f7bf438\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") "
Sep 04 22:16:28.910390 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.909812    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-metrics-certs\") pod \"b69714a8-b81c-4101-b10d-fb742f7bf438\" (UID: \"b69714a8-b81c-4101-b10d-fb742f7bf438\") "
Sep 04 22:16:28.910390 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.910152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69714a8-b81c-4101-b10d-fb742f7bf438-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b69714a8-b81c-4101-b10d-fb742f7bf438" (UID: "b69714a8-b81c-4101-b10d-fb742f7bf438"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:16:28.910676 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.910395    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69714a8-b81c-4101-b10d-fb742f7bf438-openshift-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:28.911949 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.911928    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b69714a8-b81c-4101-b10d-fb742f7bf438" (UID: "b69714a8-b81c-4101-b10d-fb742f7bf438"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:28.912421 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.912401    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b69714a8-b81c-4101-b10d-fb742f7bf438" (UID: "b69714a8-b81c-4101-b10d-fb742f7bf438"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:28.912468 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:28.912422    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69714a8-b81c-4101-b10d-fb742f7bf438-kube-api-access-hc7l6" (OuterVolumeSpecName: "kube-api-access-hc7l6") pod "b69714a8-b81c-4101-b10d-fb742f7bf438" (UID: "b69714a8-b81c-4101-b10d-fb742f7bf438"). InnerVolumeSpecName "kube-api-access-hc7l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:16:29.011865 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.011832    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-metrics-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:29.011865 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.011859    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69714a8-b81c-4101-b10d-fb742f7bf438-maas-api-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:29.011865 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.011868    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc7l6\" (UniqueName: \"kubernetes.io/projected/b69714a8-b81c-4101-b10d-fb742f7bf438-kube-api-access-hc7l6\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:29.150524 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.150442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:29.584493 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.584454    2577 generic.go:356] "Generic (PLEG): container finished" podID="b69714a8-b81c-4101-b10d-fb742f7bf438" containerID="0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6" exitCode=0
Sep 04 22:16:29.584957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.584499    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"
Sep 04 22:16:29.584957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.584540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" event={"ID":"b69714a8-b81c-4101-b10d-fb742f7bf438","Type":"ContainerDied","Data":"0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6"}
Sep 04 22:16:29.584957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.584588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl" event={"ID":"b69714a8-b81c-4101-b10d-fb742f7bf438","Type":"ContainerDied","Data":"881c59b109e04d27d99ef1fd5660b1c104479fe62f49b77cfb710410f4de7e7a"}
Sep 04 22:16:29.584957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.584610    2577 scope.go:117] "RemoveContainer" containerID="0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6"
Sep 04 22:16:29.595347 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.595328    2577 scope.go:117] "RemoveContainer" containerID="0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6"
Sep 04 22:16:29.595623 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:29.595604    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6\": container with ID starting with 0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6 not found: ID does not exist" containerID="0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6"
Sep 04 22:16:29.595712 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.595632    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6"} err="failed to get container status \"0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6\": rpc error: code = NotFound desc = could not find container \"0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6\": container with ID starting with 0643ab0bacdbe658e296c34ec6a09e917a763a7f4d7981d7ceda2393751413d6 not found: ID does not exist"
Sep 04 22:16:29.608468 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.608444    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"]
Sep 04 22:16:29.614693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.614671    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25d966-66f5df4c98-5hxkl"]
Sep 04 22:16:29.858575 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:29.853460    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69714a8-b81c-4101-b10d-fb742f7bf438" path="/var/lib/kubelet/pods/b69714a8-b81c-4101-b10d-fb742f7bf438/volumes"
Sep 04 22:16:31.514077 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:31.514041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:31.598974 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:31.598941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:32.657359 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:32.657322    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:32.760422 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:32.760386    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:32.854563 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:32.854525    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:33.127859 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:33.127826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:33.290037 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:33.290001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:35.294488 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:35.294455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:35.352954 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:35.352923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:35.539574 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:35.539538    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"]
Sep 04 22:16:35.539930 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:35.539876    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" containerID="cri-o://b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe" gracePeriod=30
Sep 04 22:16:35.557233 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:35.557157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:35.988716 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:35.988580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:40.419415 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.419381    2577 patch_prober.go:28] interesting pod/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:16:40.419808 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.419434    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:16:40.734226 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.734194    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:40.812794 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.812768    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:16:40.836913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.836889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:40.928051 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928027    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-data\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928181 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928070    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cww8r\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-kube-api-access-cww8r\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928181 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928107    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-envoy\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928181 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928125    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-certs\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928181 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928165    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-podinfo\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928194    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-socket\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928241    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-credential-socket\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-token\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:16:40.928401 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928364    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9109be-3b0b-4f50-9598-2f84bde776b7-istiod-ca-cert\") pod \"cf9109be-3b0b-4f50-9598-2f84bde776b7\" (UID: \"cf9109be-3b0b-4f50-9598-2f84bde776b7\") "
Sep 04 22:16:40.928675 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928453    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:16:40.928675 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928478    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:16:40.928815 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928778    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9109be-3b0b-4f50-9598-2f84bde776b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:16:40.928878 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928856    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:40.928935 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928878    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:40.928935 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.928892    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:40.929097 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.929075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:16:40.930431 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.930399    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-kube-api-access-cww8r" (OuterVolumeSpecName: "kube-api-access-cww8r") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "kube-api-access-cww8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:16:40.930554 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.930426    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:16:40.930554 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.930456    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:16:40.930554 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:40.930468    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf9109be-3b0b-4f50-9598-2f84bde776b7" (UID: "cf9109be-3b0b-4f50-9598-2f84bde776b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:16:41.030272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.030243    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:41.030272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.030270    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:41.030448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.030278    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9109be-3b0b-4f50-9598-2f84bde776b7-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:41.030448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.030286    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:41.030448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.030295    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9109be-3b0b-4f50-9598-2f84bde776b7-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:41.030448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.030304    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cww8r\" (UniqueName: \"kubernetes.io/projected/cf9109be-3b0b-4f50-9598-2f84bde776b7-kube-api-access-cww8r\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:41.662882 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.662851    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerID="b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe" exitCode=0
Sep 04 22:16:41.663272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.662903    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"
Sep 04 22:16:41.663272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.662932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" event={"ID":"cf9109be-3b0b-4f50-9598-2f84bde776b7","Type":"ContainerDied","Data":"b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe"}
Sep 04 22:16:41.663272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.662987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc" event={"ID":"cf9109be-3b0b-4f50-9598-2f84bde776b7","Type":"ContainerDied","Data":"0bb13c332dcef233b090aee461012d607eb2df4a66f8201674a98c0f4f60ea7f"}
Sep 04 22:16:41.663272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.663013    2577 scope.go:117] "RemoveContainer" containerID="b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe"
Sep 04 22:16:41.673285 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.673269    2577 scope.go:117] "RemoveContainer" containerID="e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"
Sep 04 22:16:41.681694 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.681603    2577 scope.go:117] "RemoveContainer" containerID="b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe"
Sep 04 22:16:41.681978 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:41.681951    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe\": container with ID starting with b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe not found: ID does not exist" containerID="b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe"
Sep 04 22:16:41.682072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.681982    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe"} err="failed to get container status \"b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe\": rpc error: code = NotFound desc = could not find container \"b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe\": container with ID starting with b35a430a0daa6ea9e913d0aca801d99c98a3b98d797e92b0d82996222823e4fe not found: ID does not exist"
Sep 04 22:16:41.682072 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.682006    2577 scope.go:117] "RemoveContainer" containerID="e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"
Sep 04 22:16:41.682255 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:16:41.682239    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14\": container with ID starting with e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14 not found: ID does not exist" containerID="e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"
Sep 04 22:16:41.682311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.682263    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14"} err="failed to get container status \"e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14\": rpc error: code = NotFound desc = could not find container \"e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14\": container with ID starting with e2053d1c615cff454af65bd98ad2e35690be816c0b0e28dcf327f4900fdf4d14 not found: ID does not exist"
Sep 04 22:16:41.683956 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.683937    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"]
Sep 04 22:16:41.688720 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.688696    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc"]
Sep 04 22:16:41.852241 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:41.852211    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" path="/var/lib/kubelet/pods/cf9109be-3b0b-4f50-9598-2f84bde776b7/volumes"
Sep 04 22:16:51.537538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.537503    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"]
Sep 04 22:16:51.538038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.537753    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n" podUID="3c32171b-07fd-4375-8a1b-147003bbabe0" containerName="maas-api" containerID="cri-o://21a322fe303e644b50392fbafc10eda73587857f4c103f2f7b05214e0ace1955" gracePeriod=30
Sep 04 22:16:51.570293 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.570269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:51.660204 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.660172    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:51.721930 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.721900    2577 generic.go:356] "Generic (PLEG): container finished" podID="3c32171b-07fd-4375-8a1b-147003bbabe0" containerID="21a322fe303e644b50392fbafc10eda73587857f4c103f2f7b05214e0ace1955" exitCode=0
Sep 04 22:16:51.722098 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.721984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n" event={"ID":"3c32171b-07fd-4375-8a1b-147003bbabe0","Type":"ContainerDied","Data":"21a322fe303e644b50392fbafc10eda73587857f4c103f2f7b05214e0ace1955"}
Sep 04 22:16:51.786019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.785993    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:16:51.928693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.928565    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-maas-api-tls\") pod \"3c32171b-07fd-4375-8a1b-147003bbabe0\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") "
Sep 04 22:16:51.928693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.928612    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c32171b-07fd-4375-8a1b-147003bbabe0-openshift-service-ca\") pod \"3c32171b-07fd-4375-8a1b-147003bbabe0\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") "
Sep 04 22:16:51.928908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.928697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-metrics-certs\") pod \"3c32171b-07fd-4375-8a1b-147003bbabe0\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") "
Sep 04 22:16:51.928908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.928810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdsdk\" (UniqueName: \"kubernetes.io/projected/3c32171b-07fd-4375-8a1b-147003bbabe0-kube-api-access-qdsdk\") pod \"3c32171b-07fd-4375-8a1b-147003bbabe0\" (UID: \"3c32171b-07fd-4375-8a1b-147003bbabe0\") "
Sep 04 22:16:51.929397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.929352    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c32171b-07fd-4375-8a1b-147003bbabe0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c32171b-07fd-4375-8a1b-147003bbabe0" (UID: "3c32171b-07fd-4375-8a1b-147003bbabe0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:16:51.931987 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.931942    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c32171b-07fd-4375-8a1b-147003bbabe0-kube-api-access-qdsdk" (OuterVolumeSpecName: "kube-api-access-qdsdk") pod "3c32171b-07fd-4375-8a1b-147003bbabe0" (UID: "3c32171b-07fd-4375-8a1b-147003bbabe0"). InnerVolumeSpecName "kube-api-access-qdsdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:16:51.932410 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.932371    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c32171b-07fd-4375-8a1b-147003bbabe0" (UID: "3c32171b-07fd-4375-8a1b-147003bbabe0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:51.932916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.932892    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c32171b-07fd-4375-8a1b-147003bbabe0" (UID: "3c32171b-07fd-4375-8a1b-147003bbabe0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:51.959884 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:51.959841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:52.026574 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.026546    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:52.029816 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.029797    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-metrics-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:52.029901 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.029819    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsdk\" (UniqueName: \"kubernetes.io/projected/3c32171b-07fd-4375-8a1b-147003bbabe0-kube-api-access-qdsdk\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:52.029901 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.029829    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c32171b-07fd-4375-8a1b-147003bbabe0-maas-api-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:52.029901 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.029838    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c32171b-07fd-4375-8a1b-147003bbabe0-openshift-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:16:52.157685 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.157630    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:52.728519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.728481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n" event={"ID":"3c32171b-07fd-4375-8a1b-147003bbabe0","Type":"ContainerDied","Data":"5e1868a717be0b9fd00dfed054e9146b520db4cb0a041ebd569cc271d185a634"}
Sep 04 22:16:52.728519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.728518    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"
Sep 04 22:16:52.729058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.728551    2577 scope.go:117] "RemoveContainer" containerID="21a322fe303e644b50392fbafc10eda73587857f4c103f2f7b05214e0ace1955"
Sep 04 22:16:52.751033 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.751010    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"]
Sep 04 22:16:52.758330 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:52.758309    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dac33e-6554979cb6-k7x4n"]
Sep 04 22:16:53.623476 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:53.623436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:53.852804 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:53.852768    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c32171b-07fd-4375-8a1b-147003bbabe0" path="/var/lib/kubelet/pods/3c32171b-07fd-4375-8a1b-147003bbabe0/volumes"
Sep 04 22:16:54.348874 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:54.348831    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:55.075292 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:55.075259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:56.454354 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:56.454314    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:58.609008 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:58.608976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:58.707834 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:58.707783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:58.849413 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:58.849380    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"]
Sep 04 22:16:58.849630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:58.849606    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy" containerID="cri-o://f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2" gracePeriod=30
Sep 04 22:16:58.875867 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:58.875797    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:16:59.278168 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:16:59.278133    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:01.552516 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:01.552490    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9c2ks_5c150594-d718-4b18-b6a2-2b81db2745dc/payload-processing/0.log"
Sep 04 22:17:04.109097 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.109070    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:17:04.138803 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138744    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-data\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.138917 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138814    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jllbf\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-kube-api-access-jllbf\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.138917 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-socket\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.138917 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138907    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-envoy\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.139038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138948    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-certs\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.139038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138964    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:04.139038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.138984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-credential-socket\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.139038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139012    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-podinfo\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.139252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139057    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istiod-ca-cert\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.139252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139139    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-token\") pod \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\" (UID: \"a31af54e-7fd9-4d89-b0aa-a850656df7a7\") "
Sep 04 22:17:04.139252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139154    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:04.139252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139204    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:04.139618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139484    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:17:04.139618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139551    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.139618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139571    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.139618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139572    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:04.139618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.139585    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.141120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.141095    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-kube-api-access-jllbf" (OuterVolumeSpecName: "kube-api-access-jllbf") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "kube-api-access-jllbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:04.141263 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.141233    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:17:04.141511 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.141488    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:04.141567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.141494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "a31af54e-7fd9-4d89-b0aa-a850656df7a7" (UID: "a31af54e-7fd9-4d89-b0aa-a850656df7a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:04.240948 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.240925    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.240948 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.240946    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jllbf\" (UniqueName: \"kubernetes.io/projected/a31af54e-7fd9-4d89-b0aa-a850656df7a7-kube-api-access-jllbf\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.241090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.240958    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.241090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.240966    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31af54e-7fd9-4d89-b0aa-a850656df7a7-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.241090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.240974    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.241090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.240982    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31af54e-7fd9-4d89-b0aa-a850656df7a7-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:04.801305 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.801269    2577 generic.go:356] "Generic (PLEG): container finished" podID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerID="f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2" exitCode=0
Sep 04 22:17:04.801491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.801322    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"
Sep 04 22:17:04.801491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.801351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" event={"ID":"a31af54e-7fd9-4d89-b0aa-a850656df7a7","Type":"ContainerDied","Data":"f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2"}
Sep 04 22:17:04.801491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.801414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4" event={"ID":"a31af54e-7fd9-4d89-b0aa-a850656df7a7","Type":"ContainerDied","Data":"1cfeda353ffed0587992bac423e3e4153f41abec637e64cbb1448e3df8ff044b"}
Sep 04 22:17:04.801491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.801447    2577 scope.go:117] "RemoveContainer" containerID="f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2"
Sep 04 22:17:04.811428 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.811414    2577 scope.go:117] "RemoveContainer" containerID="187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"
Sep 04 22:17:04.819413 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.819389    2577 scope.go:117] "RemoveContainer" containerID="f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2"
Sep 04 22:17:04.819926 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:04.819896    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2\": container with ID starting with f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2 not found: ID does not exist" containerID="f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2"
Sep 04 22:17:04.820004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.819937    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2"} err="failed to get container status \"f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2\": rpc error: code = NotFound desc = could not find container \"f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2\": container with ID starting with f082483fc7b2ebed307debc2b62f83d5fb12013c71316338a5df2399dc48f9d2 not found: ID does not exist"
Sep 04 22:17:04.820004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.819960    2577 scope.go:117] "RemoveContainer" containerID="187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"
Sep 04 22:17:04.820255 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:04.820233    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37\": container with ID starting with 187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37 not found: ID does not exist" containerID="187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"
Sep 04 22:17:04.820312 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.820264    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37"} err="failed to get container status \"187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37\": rpc error: code = NotFound desc = could not find container \"187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37\": container with ID starting with 187af1ae265e00ce3b27e2f5c27fb722113299a04a66921e3349eeccb2fb3f37 not found: ID does not exist"
Sep 04 22:17:04.822106 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.822089    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"]
Sep 04 22:17:04.825924 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:04.825899    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4"]
Sep 04 22:17:05.851238 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:05.851204    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" path="/var/lib/kubelet/pods/a31af54e-7fd9-4d89-b0aa-a850656df7a7/volumes"
Sep 04 22:17:07.327520 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:07.327467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:09.733081 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.733040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:09.737534 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.737507    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"]
Sep 04 22:17:09.739719 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.739693    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-fc3156-29809335-5djsp"]
Sep 04 22:17:09.808202 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.808148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:09.851284 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.851253    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8089bc4-ac16-48fe-b018-ea2590f14d0f" path="/var/lib/kubelet/pods/b8089bc4-ac16-48fe-b018-ea2590f14d0f/volumes"
Sep 04 22:17:09.874577 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.874552    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:09.934787 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:09.934757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:10.285374 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:10.285324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:16.144565 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:16.144450    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:16.243465 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:16.243414    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:16.390558 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:16.390528    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"]
Sep 04 22:17:16.390788 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:16.390758    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy" containerID="cri-o://e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd" gracePeriod=30
Sep 04 22:17:16.416618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:16.416534    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:16.853659 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:16.853613    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:21.638186 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.638163    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:17:21.702466 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702401    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-credential-socket\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702466 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-socket\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702504    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istiod-ca-cert\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-certs\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702620 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702552    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-token\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702754 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702698    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jph8p\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-kube-api-access-jph8p\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702800 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702757    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-data\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702800 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702697    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:21.702903 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702790    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-envoy\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.702903 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702799    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:21.702903 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-podinfo\") pod \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\" (UID: \"440ce58b-cfdc-47ac-a5ce-3426d0212b2c\") "
Sep 04 22:17:21.703074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702926    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:17:21.703074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.702927    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:21.703074 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.703015    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:21.703260 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.703237    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.703260 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.703255    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.703367 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.703264    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.703367 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.703275    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.703367 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.703290    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.705067 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.705036    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:21.705165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.705080    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-kube-api-access-jph8p" (OuterVolumeSpecName: "kube-api-access-jph8p") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "kube-api-access-jph8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:21.705165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.705089    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:21.705165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.705100    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "440ce58b-cfdc-47ac-a5ce-3426d0212b2c" (UID: "440ce58b-cfdc-47ac-a5ce-3426d0212b2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:17:21.804355 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.804334    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.804355 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.804356    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.804502 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.804369    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jph8p\" (UniqueName: \"kubernetes.io/projected/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-kube-api-access-jph8p\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.804502 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.804381    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/440ce58b-cfdc-47ac-a5ce-3426d0212b2c-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:21.900055 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.900029    2577 generic.go:356] "Generic (PLEG): container finished" podID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerID="e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd" exitCode=0
Sep 04 22:17:21.900171 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.900077    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"
Sep 04 22:17:21.900171 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.900108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" event={"ID":"440ce58b-cfdc-47ac-a5ce-3426d0212b2c","Type":"ContainerDied","Data":"e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd"}
Sep 04 22:17:21.900171 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.900163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8" event={"ID":"440ce58b-cfdc-47ac-a5ce-3426d0212b2c","Type":"ContainerDied","Data":"1495428395f9a06f502da68653064c744316048680924c649010f7c23f68d144"}
Sep 04 22:17:21.900280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.900193    2577 scope.go:117] "RemoveContainer" containerID="e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd"
Sep 04 22:17:21.909797 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.909779    2577 scope.go:117] "RemoveContainer" containerID="256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"
Sep 04 22:17:21.918017 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.917999    2577 scope.go:117] "RemoveContainer" containerID="e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd"
Sep 04 22:17:21.918279 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:21.918259    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd\": container with ID starting with e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd not found: ID does not exist" containerID="e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd"
Sep 04 22:17:21.918319 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.918291    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd"} err="failed to get container status \"e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd\": rpc error: code = NotFound desc = could not find container \"e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd\": container with ID starting with e88a7f95aaa887b844907e9ad97b86b5be03fdd5c38899a4b49ab66c42f3d7fd not found: ID does not exist"
Sep 04 22:17:21.918319 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.918308    2577 scope.go:117] "RemoveContainer" containerID="256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"
Sep 04 22:17:21.918559 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:21.918541    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61\": container with ID starting with 256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61 not found: ID does not exist" containerID="256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"
Sep 04 22:17:21.918605 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.918566    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61"} err="failed to get container status \"256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61\": rpc error: code = NotFound desc = could not find container \"256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61\": container with ID starting with 256683a85a7e9d7f20cc02649efcbc6dd5d59477fedc571367d6e42e42015c61 not found: ID does not exist"
Sep 04 22:17:21.928350 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.928328    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"]
Sep 04 22:17:21.932178 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:21.932161    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8"]
Sep 04 22:17:23.857012 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:23.856981    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" path="/var/lib/kubelet/pods/440ce58b-cfdc-47ac-a5ce-3426d0212b2c/volumes"
Sep 04 22:17:23.952630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:23.952600    2577 scope.go:117] "RemoveContainer" containerID="d7664a2208daa02b3c1b37aa82597c2f76eb7a9d4d881bd03560356580ad290f"
Sep 04 22:17:27.181126 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.181100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:27.185786 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.185762    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"]
Sep 04 22:17:27.188836 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.188811    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-3abe72-29809335-qqxn4"]
Sep 04 22:17:27.253286 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.253252    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:27.352078 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.352043    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:27.406998 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.406963    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:27.748766 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.748738    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:27.851300 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:27.851273    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec73f9bc-f88b-44bf-9a84-5a193b47c52b" path="/var/lib/kubelet/pods/ec73f9bc-f88b-44bf-9a84-5a193b47c52b/volumes"
Sep 04 22:17:32.231068 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.231038    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9c2ks_5c150594-d718-4b18-b6a2-2b81db2745dc/payload-processing/0.log"
Sep 04 22:17:32.611538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.611500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:32.906416 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906338    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"]
Sep 04 22:17:32.906809 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906793    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906811    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906821    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69714a8-b81c-4101-b10d-fb742f7bf438" containerName="maas-api"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906826    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69714a8-b81c-4101-b10d-fb742f7bf438" containerName="maas-api"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906839    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906844    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906852    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906856    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906863    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906868    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906880    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy"
Sep 04 22:17:32.906885 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906888    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906906    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c32171b-07fd-4375-8a1b-147003bbabe0" containerName="maas-api"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906911    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c32171b-07fd-4375-8a1b-147003bbabe0" containerName="maas-api"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906977    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906985    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69714a8-b81c-4101-b10d-fb742f7bf438" containerName="maas-api"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906992    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c32171b-07fd-4375-8a1b-147003bbabe0" containerName="maas-api"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.906999    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.907004    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.907011    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31af54e-7fd9-4d89-b0aa-a850656df7a7" containerName="istio-proxy"
Sep 04 22:17:32.907442 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.907015    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy"
Sep 04 22:17:32.911839 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.911819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:32.914254 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.914236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-b7805e-openshift-default-dockercfg-s5g6q\""
Sep 04 22:17:32.924677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.924622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"]
Sep 04 22:17:32.943573 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:32.943545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:33.006901 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.006862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-podinfo\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.006967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-credential-socket\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b04e8d94-2355-4042-bf05-0c1a66d705a6-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-envoy\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007090 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-certs\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-socket\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8447c\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-kube-api-access-8447c\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-token\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.007314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.007283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-data\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108024 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.107994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-data\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108190 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-podinfo\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108190 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-credential-socket\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108190 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b04e8d94-2355-4042-bf05-0c1a66d705a6-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108344 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-envoy\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108393 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-certs\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108457 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-socket\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108457 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-data\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108793 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8447c\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-kube-api-access-8447c\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b04e8d94-2355-4042-bf05-0c1a66d705a6-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-token\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.108916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-certs\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.109091 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-credential-socket\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.109091 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.108718    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-socket\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.110708 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.110685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-envoy\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.110823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.110687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-podinfo\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.115711 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.115691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8447c\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-kube-api-access-8447c\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.115711 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.115707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-token\") pod \"e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") " pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.223749 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.223684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:33.340981 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.340946    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:33.500429 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.500406    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"]
Sep 04 22:17:33.502867 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:17:33.502831    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04e8d94_2355_4042_bf05_0c1a66d705a6.slice/crio-9ec56e072e1263c7b31da4492ee4079c662b07bc97a95e494e950b62cef85452 WatchSource:0}: Error finding container 9ec56e072e1263c7b31da4492ee4079c662b07bc97a95e494e950b62cef85452: Status 404 returned error can't find the container with id 9ec56e072e1263c7b31da4492ee4079c662b07bc97a95e494e950b62cef85452
Sep 04 22:17:33.505566 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.505497    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:17:33.505677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.505566    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:17:33.505677 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.505592    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:17:33.789522 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.789484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:33.849112 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.849081    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:33.972704 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.972668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" event={"ID":"b04e8d94-2355-4042-bf05-0c1a66d705a6","Type":"ContainerStarted","Data":"ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"}
Sep 04 22:17:33.972870 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:33.972724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" event={"ID":"b04e8d94-2355-4042-bf05-0c1a66d705a6","Type":"ContainerStarted","Data":"9ec56e072e1263c7b31da4492ee4079c662b07bc97a95e494e950b62cef85452"}
Sep 04 22:17:34.008198 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.008144    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podStartSLOduration=2.008126768 podStartE2EDuration="2.008126768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:33.992035212 +0000 UTC m=+1450.764048248" watchObservedRunningTime="2026-09-04 22:17:34.008126768 +0000 UTC m=+1450.780139778"
Sep 04 22:17:34.027190 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.027161    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"]
Sep 04 22:17:34.027439 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.027415    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy" containerID="cri-o://390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d" gracePeriod=30
Sep 04 22:17:34.047928 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.047832    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:34.224583 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.224551    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:34.230045 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.230019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:34.978747 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.978713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:34.979567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:34.979551    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:35.936258 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:35.936221    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:36.034894 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:36.034855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:37.148906 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.148873    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"]
Sep 04 22:17:37.149517 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.149500    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy"
Sep 04 22:17:37.149517 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.149518    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="440ce58b-cfdc-47ac-a5ce-3426d0212b2c" containerName="istio-proxy"
Sep 04 22:17:37.149683 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.149610    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9109be-3b0b-4f50-9598-2f84bde776b7" containerName="istio-proxy"
Sep 04 22:17:37.153456 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.153435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.156427 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.156406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-b7805e-serving-cert\""
Sep 04 22:17:37.167583 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.167560    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"]
Sep 04 22:17:37.187361 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.187332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:37.243567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.243546    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:37.248603 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.248583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.248696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.248614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9ck2\" (UniqueName: \"kubernetes.io/projected/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-kube-api-access-k9ck2\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.248696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.248651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.248696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.248685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.349573 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.349536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.349573 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.349577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.349856 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:37.349700    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-serving-cert: secret "maas-api-e2e-ipp-cleanup-b7805e-serving-cert" not found
Sep 04 22:17:37.349856 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.349769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.349856 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:37.349792    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls podName:4d8fd7ea-c6d4-489b-8867-fd8d551b84c8 nodeName:}" failed. No retries permitted until 2026-09-04 22:17:37.849770057 +0000 UTC m=+1454.621783059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" (UID: "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8") : secret "maas-api-e2e-ipp-cleanup-b7805e-serving-cert" not found
Sep 04 22:17:37.349856 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.349831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9ck2\" (UniqueName: \"kubernetes.io/projected/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-kube-api-access-k9ck2\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.350459 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.350438    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.352189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.352168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.360825 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.360806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9ck2\" (UniqueName: \"kubernetes.io/projected/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-kube-api-access-k9ck2\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.404243 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.404181    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:37.745925 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.745836    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:37.848737 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.848700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:37.854974 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.854952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:37.857299 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:37.857279    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:38.065031 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:38.064997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:38.338814 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:38.338789    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"]
Sep 04 22:17:38.340336 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:17:38.340306    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8fd7ea_c6d4_489b_8867_fd8d551b84c8.slice/crio-a94b175591445c8363e1f342f081b6c2e513921ad8985778bafbf0e346ccd143 WatchSource:0}: Error finding container a94b175591445c8363e1f342f081b6c2e513921ad8985778bafbf0e346ccd143: Status 404 returned error can't find the container with id a94b175591445c8363e1f342f081b6c2e513921ad8985778bafbf0e346ccd143
Sep 04 22:17:38.341755 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:38.341739    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:17:39.000435 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.000400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" event={"ID":"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8","Type":"ContainerStarted","Data":"9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369"}
Sep 04 22:17:39.000610 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.000461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" event={"ID":"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8","Type":"ContainerStarted","Data":"a94b175591445c8363e1f342f081b6c2e513921ad8985778bafbf0e346ccd143"}
Sep 04 22:17:39.000682 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.000622    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:39.017366 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.017323    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" podStartSLOduration=1.570344301 podStartE2EDuration="2.017310651s" totalImagesPullingTime="446.96635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:39.016091779 +0000 UTC m=+1455.788104791" watchObservedRunningTime="2026-09-04 22:17:39.017310651 +0000 UTC m=+1455.789323661"
Sep 04 22:17:39.302204 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.302149    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:17:39.369007 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.368978    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-podinfo\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.369363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.369029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-envoy\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.369363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.369056    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-token\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.369363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.369147    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlgdm\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-kube-api-access-tlgdm\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.369363 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.369190    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-data\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.369604 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.369510    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:39.371231 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.371200    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:39.371346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.371280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-kube-api-access-tlgdm" (OuterVolumeSpecName: "kube-api-access-tlgdm") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "kube-api-access-tlgdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:39.371346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.371327    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:39.371346 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.371327    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:17:39.470343 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-credential-socket\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.470469 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-socket\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.470469 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470386    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-certs\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.470469 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470423    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istiod-ca-cert\") pod \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\" (UID: \"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8\") "
Sep 04 22:17:39.470665 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470611    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:39.470665 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470619    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:39.470764 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470686    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:39.470859 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470840    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" (UID: "eec40fa5-2b07-4f02-87f4-0c5549d7e5b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:17:39.470895 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470874    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470895 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470885    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470895 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470893    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470983 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470901    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlgdm\" (UniqueName: \"kubernetes.io/projected/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-kube-api-access-tlgdm\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470983 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470909    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470983 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470920    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470983 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470937    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.470983 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.470945    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:39.571804 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:39.571742    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:17:40.008623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.008589    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerID="390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d" exitCode=0
Sep 04 22:17:40.008823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.008660    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"
Sep 04 22:17:40.008823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.008678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" event={"ID":"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8","Type":"ContainerDied","Data":"390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d"}
Sep 04 22:17:40.008823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.008742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp" event={"ID":"eec40fa5-2b07-4f02-87f4-0c5549d7e5b8","Type":"ContainerDied","Data":"ea1858239229e0d1cb0b1972da9a9394503b2adf1aaedd8b302991e1d896fe7b"}
Sep 04 22:17:40.008823 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.008772    2577 scope.go:117] "RemoveContainer" containerID="390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d"
Sep 04 22:17:40.018042 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.018025    2577 scope.go:117] "RemoveContainer" containerID="76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"
Sep 04 22:17:40.026450 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.026435    2577 scope.go:117] "RemoveContainer" containerID="390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d"
Sep 04 22:17:40.026750 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:40.026733    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d\": container with ID starting with 390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d not found: ID does not exist" containerID="390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d"
Sep 04 22:17:40.026824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.026757    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d"} err="failed to get container status \"390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d\": rpc error: code = NotFound desc = could not find container \"390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d\": container with ID starting with 390def240ed070bb9dd35036f80a219599e8c603e0e878f4ac0ecb2d8a0c981d not found: ID does not exist"
Sep 04 22:17:40.026824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.026773    2577 scope.go:117] "RemoveContainer" containerID="76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"
Sep 04 22:17:40.026824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.026808    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"]
Sep 04 22:17:40.027021 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:17:40.027005    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3\": container with ID starting with 76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3 not found: ID does not exist" containerID="76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"
Sep 04 22:17:40.027060 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.027024    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3"} err="failed to get container status \"76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3\": rpc error: code = NotFound desc = could not find container \"76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3\": container with ID starting with 76013ba47199c34b7e905ba32777d195d57e2b3533c66c41b9d2ef92ace6f3c3 not found: ID does not exist"
Sep 04 22:17:40.031135 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:40.031111    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp"]
Sep 04 22:17:41.852606 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:41.852575    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" path="/var/lib/kubelet/pods/eec40fa5-2b07-4f02-87f4-0c5549d7e5b8/volumes"
Sep 04 22:17:45.019743 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:45.019711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:17:54.090782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:54.090744    2577 generic.go:356] "Generic (PLEG): container finished" podID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerID="ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9" exitCode=0
Sep 04 22:17:54.091301 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:54.090821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" event={"ID":"b04e8d94-2355-4042-bf05-0c1a66d705a6","Type":"ContainerDied","Data":"ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"}
Sep 04 22:17:54.091381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:54.091305    2577 scope.go:117] "RemoveContainer" containerID="ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"
Sep 04 22:17:54.092697 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:54.092665    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:17:54.092824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:54.092740    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:17:54.092824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:54.092782    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 04 22:17:55.102717 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:55.102680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" event={"ID":"b04e8d94-2355-4042-bf05-0c1a66d705a6","Type":"ContainerStarted","Data":"5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539"}
Sep 04 22:17:55.224025 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:55.223997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:17:55.224189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:55.224160    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 04 22:17:55.224232 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:55.224204    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 04 22:17:56.224715 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:56.224680    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 04 22:17:56.225114 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:56.224761    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 04 22:17:56.259258 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:56.259218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:57.224682 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:57.224625    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 04 22:17:57.224880 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:57.224702    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 04 22:17:58.114331 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:58.114297    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:17:58.225003 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:58.224971    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 04 22:17:58.225410 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:58.225025    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 04 22:17:59.224204 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:59.224163    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 04 22:17:59.224380 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:17:59.224223    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 04 22:18:00.228275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:00.228241    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:18:00.228701 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:00.228592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:18:00.229282 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:00.229266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:18:00.962959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:00.962898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:07.504985 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.504951    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"]
Sep 04 22:18:07.505784 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.505195    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" podUID="4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" containerName="maas-api" containerID="cri-o://9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369" gracePeriod=30
Sep 04 22:18:07.530987 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.530943    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:07.594699 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.594663    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:07.675115 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.675031    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:07.734845 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.734791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:07.758397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.758344    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:18:07.833898 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.833857    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9ck2\" (UniqueName: \"kubernetes.io/projected/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-kube-api-access-k9ck2\") pod \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") "
Sep 04 22:18:07.834044 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.833982    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-openshift-service-ca\") pod \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") "
Sep 04 22:18:07.834044 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.834011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-metrics-certs\") pod \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") "
Sep 04 22:18:07.834131 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.834050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls\") pod \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\" (UID: \"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8\") "
Sep 04 22:18:07.834416 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.834386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" (UID: "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:18:07.835991 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.835961    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-kube-api-access-k9ck2" (OuterVolumeSpecName: "kube-api-access-k9ck2") pod "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" (UID: "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8"). InnerVolumeSpecName "kube-api-access-k9ck2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:07.836121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.836098    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" (UID: "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:18:07.836233 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.836220    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" (UID: "4d8fd7ea-c6d4-489b-8867-fd8d551b84c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:18:07.935817 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.935787    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-openshift-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:07.935817 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.935811    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-metrics-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:07.935817 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.935820    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-maas-api-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:07.936005 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:07.935827    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9ck2\" (UniqueName: \"kubernetes.io/projected/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8-kube-api-access-k9ck2\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:08.138887 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.138804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:08.182658 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.182616    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" containerID="9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369" exitCode=0
Sep 04 22:18:08.182777 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.182672    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"
Sep 04 22:18:08.182777 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.182666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" event={"ID":"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8","Type":"ContainerDied","Data":"9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369"}
Sep 04 22:18:08.182854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.182788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj" event={"ID":"4d8fd7ea-c6d4-489b-8867-fd8d551b84c8","Type":"ContainerDied","Data":"a94b175591445c8363e1f342f081b6c2e513921ad8985778bafbf0e346ccd143"}
Sep 04 22:18:08.182854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.182810    2577 scope.go:117] "RemoveContainer" containerID="9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369"
Sep 04 22:18:08.191982 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.191967    2577 scope.go:117] "RemoveContainer" containerID="9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369"
Sep 04 22:18:08.192259 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:18:08.192240    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369\": container with ID starting with 9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369 not found: ID does not exist" containerID="9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369"
Sep 04 22:18:08.192320 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.192266    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369"} err="failed to get container status \"9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369\": rpc error: code = NotFound desc = could not find container \"9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369\": container with ID starting with 9997cc4b0560d69b3c3401e3418a9a8b85bece529a23c0b466e76b064278e369 not found: ID does not exist"
Sep 04 22:18:08.199842 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.199821    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"]
Sep 04 22:18:08.203395 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:08.203374    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-b7805e-66655dbfb7-khrpj"]
Sep 04 22:18:09.851569 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:09.851532    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" path="/var/lib/kubelet/pods/4d8fd7ea-c6d4-489b-8867-fd8d551b84c8/volumes"
Sep 04 22:18:13.723786 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:13.723752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:13.787372 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:13.787329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:13.959660 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:13.959604    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"]
Sep 04 22:18:13.959876 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:13.959842    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" containerID="cri-o://5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539" gracePeriod=30
Sep 04 22:18:13.981309 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:13.981243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:15.230480 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:15.230446    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 04 22:18:15.230852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:15.230503    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:18:17.858408 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:17.858371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:19.220780 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.220724    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:18:19.250937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.250911    2577 generic.go:356] "Generic (PLEG): container finished" podID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerID="5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539" exitCode=0
Sep 04 22:18:19.251058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.250954    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"
Sep 04 22:18:19.251058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.250972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" event={"ID":"b04e8d94-2355-4042-bf05-0c1a66d705a6","Type":"ContainerDied","Data":"5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539"}
Sep 04 22:18:19.251058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.251018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d" event={"ID":"b04e8d94-2355-4042-bf05-0c1a66d705a6","Type":"ContainerDied","Data":"9ec56e072e1263c7b31da4492ee4079c662b07bc97a95e494e950b62cef85452"}
Sep 04 22:18:19.251058 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.251042    2577 scope.go:117] "RemoveContainer" containerID="5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539"
Sep 04 22:18:19.261769 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.261744    2577 scope.go:117] "RemoveContainer" containerID="ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"
Sep 04 22:18:19.269613 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.269595    2577 scope.go:117] "RemoveContainer" containerID="5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539"
Sep 04 22:18:19.269937 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:18:19.269919    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539\": container with ID starting with 5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539 not found: ID does not exist" containerID="5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539"
Sep 04 22:18:19.270004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.269944    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539"} err="failed to get container status \"5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539\": rpc error: code = NotFound desc = could not find container \"5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539\": container with ID starting with 5af1f28e4d49a2d6a34e12f8f2223df8fe9e296459c0dd2786c0f910bfdb1539 not found: ID does not exist"
Sep 04 22:18:19.270004 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.269959    2577 scope.go:117] "RemoveContainer" containerID="ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"
Sep 04 22:18:19.270228 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:18:19.270209    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9\": container with ID starting with ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9 not found: ID does not exist" containerID="ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"
Sep 04 22:18:19.270278 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.270233    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9"} err="failed to get container status \"ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9\": rpc error: code = NotFound desc = could not find container \"ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9\": container with ID starting with ead2086c94bd1760c19cdd29c24283d16c5327fb3a47634e2cd7b41657ece5a9 not found: ID does not exist"
Sep 04 22:18:19.331574 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-certs\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331599    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-credential-socket\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331657    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-socket\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-podinfo\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331802 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b04e8d94-2355-4042-bf05-0c1a66d705a6-istiod-ca-cert\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331802 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331773    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-data\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331804    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8447c\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-kube-api-access-8447c\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331839    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-envoy\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.331908 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331864    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-token\") pod \"b04e8d94-2355-4042-bf05-0c1a66d705a6\" (UID: \"b04e8d94-2355-4042-bf05-0c1a66d705a6\") "
Sep 04 22:18:19.332023 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331832    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:18:19.332023 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331949    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:18:19.332023 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.331913    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:18:19.332186 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.332076    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:18:19.332280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.332255    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.332280 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.332263    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04e8d94-2355-4042-bf05-0c1a66d705a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:18:19.332440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.332283    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.332440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.332298    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.332440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.332306    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.334076 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.334050    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:18:19.334155 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.334082    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-kube-api-access-8447c" (OuterVolumeSpecName: "kube-api-access-8447c") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "kube-api-access-8447c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:19.334155 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.334099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:18:19.334155 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.334110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "b04e8d94-2355-4042-bf05-0c1a66d705a6" (UID: "b04e8d94-2355-4042-bf05-0c1a66d705a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:19.432921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.432891    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b04e8d94-2355-4042-bf05-0c1a66d705a6-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.432921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.432917    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8447c\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-kube-api-access-8447c\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.433051 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.432932    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.433051 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.432944    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.433051 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.432955    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b04e8d94-2355-4042-bf05-0c1a66d705a6-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:19.572272 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.572249    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"]
Sep 04 22:18:19.576049 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.576029    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d"]
Sep 04 22:18:19.851661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:19.851569    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" path="/var/lib/kubelet/pods/b04e8d94-2355-4042-bf05-0c1a66d705a6/volumes"
Sep 04 22:18:23.789973 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:23.789943    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:18:23.794147 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:23.794122    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:18:23.992541 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:23.992506    2577 scope.go:117] "RemoveContainer" containerID="0b022d8f3e720ff34f81573a1e82dc7f8cf9a13572230ae195edda73422e3b16"
Sep 04 22:18:24.000839 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:24.000818    2577 scope.go:117] "RemoveContainer" containerID="84f101f6f58f071f7b4a4f98ed5163b99bbaab6aba9f84613f727d462e0aa97c"
Sep 04 22:18:33.213888 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.213835    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"]
Sep 04 22:18:33.215999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.214663    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" podUID="ab140c4b-83f9-4b96-a3b2-0d5bf7045116" containerName="maas-api" containerID="cri-o://b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1" gracePeriod=30
Sep 04 22:18:33.256479 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.256445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:33.478087 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.478031    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:18:33.654526 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.654495    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-openshift-service-ca\") pod \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") "
Sep 04 22:18:33.654745 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.654566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grf54\" (UniqueName: \"kubernetes.io/projected/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-kube-api-access-grf54\") pod \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") "
Sep 04 22:18:33.654745 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.654706    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-metrics-certs\") pod \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") "
Sep 04 22:18:33.654745 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.654741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") pod \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\" (UID: \"ab140c4b-83f9-4b96-a3b2-0d5bf7045116\") "
Sep 04 22:18:33.654957 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.654931    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab140c4b-83f9-4b96-a3b2-0d5bf7045116" (UID: "ab140c4b-83f9-4b96-a3b2-0d5bf7045116"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:18:33.656696 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.656661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-kube-api-access-grf54" (OuterVolumeSpecName: "kube-api-access-grf54") pod "ab140c4b-83f9-4b96-a3b2-0d5bf7045116" (UID: "ab140c4b-83f9-4b96-a3b2-0d5bf7045116"). InnerVolumeSpecName "kube-api-access-grf54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:33.656814 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.656727    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab140c4b-83f9-4b96-a3b2-0d5bf7045116" (UID: "ab140c4b-83f9-4b96-a3b2-0d5bf7045116"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:18:33.656868 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.656810    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab140c4b-83f9-4b96-a3b2-0d5bf7045116" (UID: "ab140c4b-83f9-4b96-a3b2-0d5bf7045116"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:18:33.756149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.756129    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grf54\" (UniqueName: \"kubernetes.io/projected/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-kube-api-access-grf54\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:33.756242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.756151    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-metrics-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:33.756242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.756161    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-maas-api-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:33.756242 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:33.756169    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab140c4b-83f9-4b96-a3b2-0d5bf7045116-openshift-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:18:34.335991 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.335956    2577 generic.go:356] "Generic (PLEG): container finished" podID="ab140c4b-83f9-4b96-a3b2-0d5bf7045116" containerID="b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1" exitCode=0
Sep 04 22:18:34.336452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.336004    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"
Sep 04 22:18:34.336452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.336015    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" event={"ID":"ab140c4b-83f9-4b96-a3b2-0d5bf7045116","Type":"ContainerDied","Data":"b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1"}
Sep 04 22:18:34.336452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.336068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6" event={"ID":"ab140c4b-83f9-4b96-a3b2-0d5bf7045116","Type":"ContainerDied","Data":"d2c456a0e0072e314b08dc6497187c716c0c558012efccd12697cec4fd0ca524"}
Sep 04 22:18:34.336452 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.336098    2577 scope.go:117] "RemoveContainer" containerID="b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1"
Sep 04 22:18:34.345109 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.345093    2577 scope.go:117] "RemoveContainer" containerID="b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1"
Sep 04 22:18:34.345391 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:18:34.345373    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1\": container with ID starting with b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1 not found: ID does not exist" containerID="b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1"
Sep 04 22:18:34.345467 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.345398    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1"} err="failed to get container status \"b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1\": rpc error: code = NotFound desc = could not find container \"b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1\": container with ID starting with b0ad9fd432bb32549025b220a27e08bab0530537d1877ef7753e100bf093dde1 not found: ID does not exist"
Sep 04 22:18:34.354864 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.354841    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"]
Sep 04 22:18:34.361079 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.361057    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cc92e2-5f6895f497-tbjv6"]
Sep 04 22:18:34.619934 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:34.619853    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:18:35.851585 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:35.851552    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab140c4b-83f9-4b96-a3b2-0d5bf7045116" path="/var/lib/kubelet/pods/ab140c4b-83f9-4b96-a3b2-0d5bf7045116/volumes"
Sep 04 22:18:38.831959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:18:38.831923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:14.925781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:14.925746    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:16.048235 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:16.048196    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:21.630259 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:21.630227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:21.731089 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:21.731048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:21.896076 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:21.895995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:22.261174 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261143    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"]
Sep 04 22:19:22.261566 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261551    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy"
Sep 04 22:19:22.261614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261569    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy"
Sep 04 22:19:22.261614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261585    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy"
Sep 04 22:19:22.261614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261592    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy"
Sep 04 22:19:22.261614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261607    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab140c4b-83f9-4b96-a3b2-0d5bf7045116" containerName="maas-api"
Sep 04 22:19:22.261614 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261613    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab140c4b-83f9-4b96-a3b2-0d5bf7045116" containerName="maas-api"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261619    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261624    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261633    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" containerName="maas-api"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261652    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" containerName="maas-api"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261660    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261665    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261732    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261742    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab140c4b-83f9-4b96-a3b2-0d5bf7045116" containerName="maas-api"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261748    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8fd7ea-c6d4-489b-8867-fd8d551b84c8" containerName="maas-api"
Sep 04 22:19:22.261781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.261755    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy"
Sep 04 22:19:22.265045 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.265027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:22.267034 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.267012    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:19:22.267155 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.267045    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:19:22.272033 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.272007    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"]
Sep 04 22:19:22.348357 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.348326    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:22.351441 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.351416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41c54ed6-4a1b-45a2-a3d8-07d5dc495199-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5\" (UID: \"41c54ed6-4a1b-45a2-a3d8-07d5dc495199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:22.452247 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.452217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41c54ed6-4a1b-45a2-a3d8-07d5dc495199-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5\" (UID: \"41c54ed6-4a1b-45a2-a3d8-07d5dc495199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:22.452880 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.452862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41c54ed6-4a1b-45a2-a3d8-07d5dc495199-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5\" (UID: \"41c54ed6-4a1b-45a2-a3d8-07d5dc495199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:22.584002 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.583925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:22.857461 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:22.857436    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"]
Sep 04 22:19:22.860216 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:19:22.860178    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c54ed6_4a1b_45a2_a3d8_07d5dc495199.slice/crio-120dade79611838c891d8a8374ff0b89d6664cd079e0d382a5524d36425b80c1 WatchSource:0}: Error finding container 120dade79611838c891d8a8374ff0b89d6664cd079e0d382a5524d36425b80c1: Status 404 returned error can't find the container with id 120dade79611838c891d8a8374ff0b89d6664cd079e0d382a5524d36425b80c1
Sep 04 22:19:23.605837 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:23.605807    2577 generic.go:356] "Generic (PLEG): container finished" podID="41c54ed6-4a1b-45a2-a3d8-07d5dc495199" containerID="975ed1eeea724989438f6001712286e0eb6cc461591c22be39b8a399ae9a055e" exitCode=0
Sep 04 22:19:23.605984 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:23.605861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5" event={"ID":"41c54ed6-4a1b-45a2-a3d8-07d5dc495199","Type":"ContainerDied","Data":"975ed1eeea724989438f6001712286e0eb6cc461591c22be39b8a399ae9a055e"}
Sep 04 22:19:23.605984 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:23.605916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5" event={"ID":"41c54ed6-4a1b-45a2-a3d8-07d5dc495199","Type":"ContainerStarted","Data":"120dade79611838c891d8a8374ff0b89d6664cd079e0d382a5524d36425b80c1"}
Sep 04 22:19:24.745354 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:24.745333    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:24.872711 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:24.872632    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41c54ed6-4a1b-45a2-a3d8-07d5dc495199-maas-api-service-ca\") pod \"41c54ed6-4a1b-45a2-a3d8-07d5dc495199\" (UID: \"41c54ed6-4a1b-45a2-a3d8-07d5dc495199\") "
Sep 04 22:19:24.872966 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:24.872944    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c54ed6-4a1b-45a2-a3d8-07d5dc495199-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "41c54ed6-4a1b-45a2-a3d8-07d5dc495199" (UID: "41c54ed6-4a1b-45a2-a3d8-07d5dc495199"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:19:24.974147 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:24.974116    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41c54ed6-4a1b-45a2-a3d8-07d5dc495199-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:19:25.618073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:25.618039    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"
Sep 04 22:19:25.618073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:25.618066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5" event={"ID":"41c54ed6-4a1b-45a2-a3d8-07d5dc495199","Type":"ContainerDied","Data":"120dade79611838c891d8a8374ff0b89d6664cd079e0d382a5524d36425b80c1"}
Sep 04 22:19:25.618285 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:25.618113    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="120dade79611838c891d8a8374ff0b89d6664cd079e0d382a5524d36425b80c1"
Sep 04 22:19:32.670924 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:32.670886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:32.792453 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:32.792417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:32.894463 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:32.894427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:32.958326 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:32.958238    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"]
Sep 04 22:19:32.960750 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:32.960726    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f2fbdf-5nrn5"]
Sep 04 22:19:32.961228 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:32.961200    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:33.044255 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:33.044203    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:33.415874 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:33.415840    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:33.851849 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:33.851822    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c54ed6-4a1b-45a2-a3d8-07d5dc495199" path="/var/lib/kubelet/pods/41c54ed6-4a1b-45a2-a3d8-07d5dc495199/volumes"
Sep 04 22:19:38.981517 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:38.981476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:39.046546 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.046522    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:39.234910 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.234810    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:39.584015 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.583981    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"]
Sep 04 22:19:39.584406 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.584392    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c54ed6-4a1b-45a2-a3d8-07d5dc495199" containerName="revoke-keys"
Sep 04 22:19:39.584406 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.584407    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c54ed6-4a1b-45a2-a3d8-07d5dc495199" containerName="revoke-keys"
Sep 04 22:19:39.584558 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.584468    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c54ed6-4a1b-45a2-a3d8-07d5dc495199" containerName="revoke-keys"
Sep 04 22:19:39.584558 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.584478    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04e8d94-2355-4042-bf05-0c1a66d705a6" containerName="istio-proxy"
Sep 04 22:19:39.584558 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.584487    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec40fa5-2b07-4f02-87f4-0c5549d7e5b8" containerName="istio-proxy"
Sep 04 22:19:39.588056 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.588027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:39.590252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.590223    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:19:39.590252 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.590246    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:19:39.594629 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.594606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"]
Sep 04 22:19:39.689507 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.689469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2\" (UID: \"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:39.738687 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.738657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:39.790782 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.790761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2\" (UID: \"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:39.791361 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.791339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2\" (UID: \"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:39.900511 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:39.900432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:40.168630 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:40.168602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"]
Sep 04 22:19:40.170268 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:19:40.170240    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bcabcf_bb8c_4405_bb63_bc8e1355f50a.slice/crio-bec3720e6ed6e5e43b644b47ab3eaf468776d6d8aea52fee6ddd45db95fcd5ad WatchSource:0}: Error finding container bec3720e6ed6e5e43b644b47ab3eaf468776d6d8aea52fee6ddd45db95fcd5ad: Status 404 returned error can't find the container with id bec3720e6ed6e5e43b644b47ab3eaf468776d6d8aea52fee6ddd45db95fcd5ad
Sep 04 22:19:40.705967 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:40.705928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2" event={"ID":"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a","Type":"ContainerStarted","Data":"a8c7cc7919f790d104f770243468b423f594cd0849793880584d1275f39f22b1"}
Sep 04 22:19:40.706117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:40.705987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2" event={"ID":"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a","Type":"ContainerStarted","Data":"bec3720e6ed6e5e43b644b47ab3eaf468776d6d8aea52fee6ddd45db95fcd5ad"}
Sep 04 22:19:40.719061 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:40.718940    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2" podStartSLOduration=1.7189224319999998 podStartE2EDuration="1.718922432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:19:40.718372016 +0000 UTC m=+1577.490385025" watchObservedRunningTime="2026-09-04 22:19:40.718922432 +0000 UTC m=+1577.490935443"
Sep 04 22:19:41.713222 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:41.713186    2577 generic.go:356] "Generic (PLEG): container finished" podID="b4bcabcf-bb8c-4405-bb63-bc8e1355f50a" containerID="a8c7cc7919f790d104f770243468b423f594cd0849793880584d1275f39f22b1" exitCode=0
Sep 04 22:19:41.713688 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:41.713274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2" event={"ID":"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a","Type":"ContainerDied","Data":"a8c7cc7919f790d104f770243468b423f594cd0849793880584d1275f39f22b1"}
Sep 04 22:19:42.851596 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:42.851570    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:43.021657 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:43.021614    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a-maas-api-service-ca\") pod \"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a\" (UID: \"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a\") "
Sep 04 22:19:43.021940 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:43.021917    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4bcabcf-bb8c-4405-bb63-bc8e1355f50a" (UID: "b4bcabcf-bb8c-4405-bb63-bc8e1355f50a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:19:43.122857 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:43.122832    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:19:43.725151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:43.725117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2" event={"ID":"b4bcabcf-bb8c-4405-bb63-bc8e1355f50a","Type":"ContainerDied","Data":"bec3720e6ed6e5e43b644b47ab3eaf468776d6d8aea52fee6ddd45db95fcd5ad"}
Sep 04 22:19:43.725151 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:43.725147    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"
Sep 04 22:19:43.725369 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:43.725165    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bec3720e6ed6e5e43b644b47ab3eaf468776d6d8aea52fee6ddd45db95fcd5ad"
Sep 04 22:19:46.791852 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:46.791819    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:46.846213 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:46.846171    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:50.097790 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.097753    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"]
Sep 04 22:19:50.102381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.102353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:50.102529 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.102465    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6680c7-29809335-d7nck"]
Sep 04 22:19:50.174123 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.174088    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:50.232710 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.232675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:50.293206 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.293179    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"]
Sep 04 22:19:50.295579 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.295550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:50.295968 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.295946    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6680c7-8v9n2"]
Sep 04 22:19:50.349720 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.349626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:50.692661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:50.692544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:51.851255 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:51.851222    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b565633-da08-44bb-83fc-e469fcf5534d" path="/var/lib/kubelet/pods/1b565633-da08-44bb-83fc-e469fcf5534d/volumes"
Sep 04 22:19:51.851779 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:51.851572    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4bcabcf-bb8c-4405-bb63-bc8e1355f50a" path="/var/lib/kubelet/pods/b4bcabcf-bb8c-4405-bb63-bc8e1355f50a/volumes"
Sep 04 22:19:56.852051 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:56.852010    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:56.952060 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:56.952017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:57.104120 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.104025    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"]
Sep 04 22:19:57.104309 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.104278    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy" containerID="cri-o://6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5" gracePeriod=30
Sep 04 22:19:57.124813 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.124783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:57.475224 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.475136    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"]
Sep 04 22:19:57.475607 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.475587    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4bcabcf-bb8c-4405-bb63-bc8e1355f50a" containerName="revoke-keys"
Sep 04 22:19:57.475719 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.475610    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4bcabcf-bb8c-4405-bb63-bc8e1355f50a" containerName="revoke-keys"
Sep 04 22:19:57.475778 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.475734    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4bcabcf-bb8c-4405-bb63-bc8e1355f50a" containerName="revoke-keys"
Sep 04 22:19:57.478850 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.478828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:19:57.480921 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.480901    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:19:57.481018 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.480906    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dftg6\""
Sep 04 22:19:57.484403 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.484380    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"]
Sep 04 22:19:57.546830 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.546792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv\" (UID: \"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:19:57.566350 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.566318    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:19:57.647862 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.647834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv\" (UID: \"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:19:57.648430 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.648410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv\" (UID: \"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:19:57.791157 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:57.791126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:19:58.061916 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:58.061787    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"]
Sep 04 22:19:58.064816 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:19:58.064791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5a74d8_5440_4ffc_92e6_97bf8b0fb410.slice/crio-741b41dc31852bd530d4b6cdc4c3924872a0126c8b423f3c6595ac12de6c8ca3 WatchSource:0}: Error finding container 741b41dc31852bd530d4b6cdc4c3924872a0126c8b423f3c6595ac12de6c8ca3: Status 404 returned error can't find the container with id 741b41dc31852bd530d4b6cdc4c3924872a0126c8b423f3c6595ac12de6c8ca3
Sep 04 22:19:58.814833 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:58.814805    2577 generic.go:356] "Generic (PLEG): container finished" podID="4f5a74d8-5440-4ffc-92e6-97bf8b0fb410" containerID="47f5a97fbf55839bbe1d3656492440367140f92478b5094f915db3d1221ac969" exitCode=0
Sep 04 22:19:58.814963 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:58.814873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv" event={"ID":"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410","Type":"ContainerDied","Data":"47f5a97fbf55839bbe1d3656492440367140f92478b5094f915db3d1221ac969"}
Sep 04 22:19:58.814963 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:58.814949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv" event={"ID":"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410","Type":"ContainerStarted","Data":"741b41dc31852bd530d4b6cdc4c3924872a0126c8b423f3c6595ac12de6c8ca3"}
Sep 04 22:19:59.955222 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:19:59.955197    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:20:00.069525 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:00.069497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410-maas-api-service-ca\") pod \"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410\" (UID: \"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410\") "
Sep 04 22:20:00.069888 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:00.069856    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f5a74d8-5440-4ffc-92e6-97bf8b0fb410" (UID: "4f5a74d8-5440-4ffc-92e6-97bf8b0fb410"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:20:00.170688 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:00.170621    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410-maas-api-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:00.827776 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:00.827748    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"
Sep 04 22:20:00.827968 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:00.827787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv" event={"ID":"4f5a74d8-5440-4ffc-92e6-97bf8b0fb410","Type":"ContainerDied","Data":"741b41dc31852bd530d4b6cdc4c3924872a0126c8b423f3c6595ac12de6c8ca3"}
Sep 04 22:20:00.827968 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:00.827834    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="741b41dc31852bd530d4b6cdc4c3924872a0126c8b423f3c6595ac12de6c8ca3"
Sep 04 22:20:02.360248 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.360227    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:20:02.490314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-socket\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490266    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-certs\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490314 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490299    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-podinfo\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490330    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-credential-socket\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-token\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490394    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5hzx\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-kube-api-access-h5hzx\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490435    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-envoy\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490460    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e25510-ff75-47b0-bd9e-f39bf9310822-istiod-ca-cert\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-data\") pod \"60e25510-ff75-47b0-bd9e-f39bf9310822\" (UID: \"60e25510-ff75-47b0-bd9e-f39bf9310822\") "
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490536    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:02.490602 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490591    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:02.491019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490737    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:02.491019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490821    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-data" (OuterVolumeSpecName: "istio-data") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:02.491019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e25510-ff75-47b0-bd9e-f39bf9310822-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:20:02.491019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490894    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.491019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490929    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.491019 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.490944    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.492746 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.492715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:02.492871 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.492797    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-token" (OuterVolumeSpecName: "istio-token") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:20:02.492871 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.492826    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-kube-api-access-h5hzx" (OuterVolumeSpecName: "kube-api-access-h5hzx") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "kube-api-access-h5hzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:20:02.492950 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.492896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60e25510-ff75-47b0-bd9e-f39bf9310822" (UID: "60e25510-ff75-47b0-bd9e-f39bf9310822"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:20:02.592274 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.592247    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.592274 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.592270    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5hzx\" (UniqueName: \"kubernetes.io/projected/60e25510-ff75-47b0-bd9e-f39bf9310822-kube-api-access-h5hzx\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.592439 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.592281    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.592439 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.592291    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e25510-ff75-47b0-bd9e-f39bf9310822-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.592439 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.592299    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.592439 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.592306    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e25510-ff75-47b0-bd9e-f39bf9310822-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:02.847184 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.847157    2577 generic.go:356] "Generic (PLEG): container finished" podID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerID="6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5" exitCode=0
Sep 04 22:20:02.847387 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.847208    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"
Sep 04 22:20:02.847387 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.847238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" event={"ID":"60e25510-ff75-47b0-bd9e-f39bf9310822","Type":"ContainerDied","Data":"6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5"}
Sep 04 22:20:02.847387 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.847293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr" event={"ID":"60e25510-ff75-47b0-bd9e-f39bf9310822","Type":"ContainerDied","Data":"bf24a399387686690ed6d41e7c12d91d7e0878d7c6152759e982042d74d45850"}
Sep 04 22:20:02.847387 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.847322    2577 scope.go:117] "RemoveContainer" containerID="6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5"
Sep 04 22:20:02.857661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.857631    2577 scope.go:117] "RemoveContainer" containerID="6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"
Sep 04 22:20:02.866364 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.866333    2577 scope.go:117] "RemoveContainer" containerID="6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5"
Sep 04 22:20:02.866698 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:20:02.866630    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5\": container with ID starting with 6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5 not found: ID does not exist" containerID="6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5"
Sep 04 22:20:02.866799 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.866695    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5"} err="failed to get container status \"6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5\": rpc error: code = NotFound desc = could not find container \"6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5\": container with ID starting with 6ad251c28e3cf2ed569ad83f1c5ee6addccbbfcdf7dd7d7f0d420571a41c44d5 not found: ID does not exist"
Sep 04 22:20:02.866799 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.866718    2577 scope.go:117] "RemoveContainer" containerID="6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"
Sep 04 22:20:02.867036 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:20:02.867014    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0\": container with ID starting with 6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0 not found: ID does not exist" containerID="6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"
Sep 04 22:20:02.867097 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.867045    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0"} err="failed to get container status \"6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0\": rpc error: code = NotFound desc = could not find container \"6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0\": container with ID starting with 6a0b8875681c5365df4b7491f7651b397f7852ad658c921875bab6a57c2621b0 not found: ID does not exist"
Sep 04 22:20:02.870347 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.870326    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"]
Sep 04 22:20:02.877454 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:02.877433    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr"]
Sep 04 22:20:03.851449 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:03.851411    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" path="/var/lib/kubelet/pods/60e25510-ff75-47b0-bd9e-f39bf9310822/volumes"
Sep 04 22:20:06.147693 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:06.147664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:06.328268 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:06.328236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:08.084789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:08.084736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:08.085178 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:08.085039    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"]
Sep 04 22:20:08.086811 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:08.086789    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7a26c9-ptbsv"]
Sep 04 22:20:08.149995 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:08.149967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:08.571611 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:08.571574    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:09.851274 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:09.851244    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5a74d8-5440-4ffc-92e6-97bf8b0fb410" path="/var/lib/kubelet/pods/4f5a74d8-5440-4ffc-92e6-97bf8b0fb410/volumes"
Sep 04 22:20:14.319381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:14.319341    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:14.382163 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:14.382132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:14.571485 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:14.571405    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"]
Sep 04 22:20:14.571667 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:14.571626    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy" containerID="cri-o://14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73" gracePeriod=30
Sep 04 22:20:14.593458 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:14.593418    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:19.827432 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.827407    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:20:19.935294 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935223    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-socket\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935294 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935275    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istiod-ca-cert\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935498 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935298    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-envoy\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935498 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935329    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-certs\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935498 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-podinfo\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935498 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-credential-socket\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935498 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935484    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:19.935805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935660    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-data\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935624    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:19.935805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:19.935805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935719    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:20:19.935805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935744    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph2jp\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-kube-api-access-ph2jp\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.935805 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-token\") pod \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\" (UID: \"0bb78f12-9fa2-40b2-9feb-f454cbd33988\") "
Sep 04 22:20:19.936121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.935962    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-data" (OuterVolumeSpecName: "istio-data") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:19.936121 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.936107    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:19.936231 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.936129    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istiod-ca-cert\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:19.936231 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.936143    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-workload-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:19.936231 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.936156    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-credential-socket\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:19.936231 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.936169    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-data\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:19.937808 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.937781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:20:19.937948 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.937913    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-kube-api-access-ph2jp" (OuterVolumeSpecName: "kube-api-access-ph2jp") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "kube-api-access-ph2jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:20:19.938105 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.938085    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:20:19.938675 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.938659    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-token" (OuterVolumeSpecName: "istio-token") pod "0bb78f12-9fa2-40b2-9feb-f454cbd33988" (UID: "0bb78f12-9fa2-40b2-9feb-f454cbd33988"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:20:19.942652 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.942616    2577 generic.go:356] "Generic (PLEG): container finished" podID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerID="14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73" exitCode=0
Sep 04 22:20:19.942773 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.942675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" event={"ID":"0bb78f12-9fa2-40b2-9feb-f454cbd33988","Type":"ContainerDied","Data":"14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73"}
Sep 04 22:20:19.942773 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.942685    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"
Sep 04 22:20:19.942773 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.942737    2577 scope.go:117] "RemoveContainer" containerID="14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73"
Sep 04 22:20:19.942937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.942727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9" event={"ID":"0bb78f12-9fa2-40b2-9feb-f454cbd33988","Type":"ContainerDied","Data":"5f9f8f9aacfd5ba99982e03c0485073b8534a19e89321782e6ec52b1f51294d1"}
Sep 04 22:20:19.958688 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.958666    2577 scope.go:117] "RemoveContainer" containerID="e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"
Sep 04 22:20:19.966589 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.966560    2577 scope.go:117] "RemoveContainer" containerID="14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73"
Sep 04 22:20:19.966921 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:20:19.966902    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73\": container with ID starting with 14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73 not found: ID does not exist" containerID="14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73"
Sep 04 22:20:19.966997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.966928    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73"} err="failed to get container status \"14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73\": rpc error: code = NotFound desc = could not find container \"14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73\": container with ID starting with 14fb30940b7f541e5b94260e5e1eb72d13609afe1a60486f0b2431f6d8152f73 not found: ID does not exist"
Sep 04 22:20:19.966997 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.966945    2577 scope.go:117] "RemoveContainer" containerID="e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"
Sep 04 22:20:19.967230 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:20:19.967208    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473\": container with ID starting with e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473 not found: ID does not exist" containerID="e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"
Sep 04 22:20:19.967275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.967239    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473"} err="failed to get container status \"e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473\": rpc error: code = NotFound desc = could not find container \"e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473\": container with ID starting with e4226743a719ddb9ab88f3673d0daef16eb0267d905ba34205e2a8d7a5221473 not found: ID does not exist"
Sep 04 22:20:19.968775 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.968751    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"]
Sep 04 22:20:19.970603 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:19.970583    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9"]
Sep 04 22:20:20.036854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:20.036831    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-envoy\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:20.036854 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:20.036853    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-podinfo\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:20.036979 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:20.036866    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph2jp\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-kube-api-access-ph2jp\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:20.036979 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:20.036879    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb78f12-9fa2-40b2-9feb-f454cbd33988-istio-token\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:20:21.851601 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:21.851569    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" path="/var/lib/kubelet/pods/0bb78f12-9fa2-40b2-9feb-f454cbd33988/volumes"
Sep 04 22:20:50.417910 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:50.417871    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:20:50.466841 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:20:50.466809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:21:24.064142 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:24.064109    2577 scope.go:117] "RemoveContainer" containerID="ccccfa70c4789d8bb9d1d910cf1d8f87b9c5f52e5ed21fe400d917486a131e55"
Sep 04 22:21:24.072191 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:24.072171    2577 scope.go:117] "RemoveContainer" containerID="168e4ef97c8ea240a5221d93910cedf4a43b80f694183cdd74ba8fceb981a783"
Sep 04 22:21:24.081791 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:24.081758    2577 scope.go:117] "RemoveContainer" containerID="dbbd3ab4ac788f762f8b6c19c29ef1f98aa73ab610e773038dd631360b15c2c5"
Sep 04 22:21:39.770276 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:39.770239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:21:40.595165 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:40.595126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:21:40.696353 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:40.696315    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:21:42.147257 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:42.147217    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:21:47.944864 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:21:47.944772    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:22:45.950211 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:45.950175    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"]
Sep 04 22:22:45.950796 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:45.950371    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv" podUID="3bfe86b8-4dda-44ce-9daa-49aad673c3a3" containerName="manager" containerID="cri-o://5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a" gracePeriod=10
Sep 04 22:22:46.495512 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.495491    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:22:46.590661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.590573    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-extensions-socket-volume\") pod \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") "
Sep 04 22:22:46.590661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.590606    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwdtv\" (UniqueName: \"kubernetes.io/projected/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-kube-api-access-bwdtv\") pod \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\" (UID: \"3bfe86b8-4dda-44ce-9daa-49aad673c3a3\") "
Sep 04 22:22:46.591038 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.591014    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bfe86b8-4dda-44ce-9daa-49aad673c3a3" (UID: "3bfe86b8-4dda-44ce-9daa-49aad673c3a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:22:46.592621 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.592600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-kube-api-access-bwdtv" (OuterVolumeSpecName: "kube-api-access-bwdtv") pod "3bfe86b8-4dda-44ce-9daa-49aad673c3a3" (UID: "3bfe86b8-4dda-44ce-9daa-49aad673c3a3"). InnerVolumeSpecName "kube-api-access-bwdtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:22:46.690296 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.690266    2577 generic.go:356] "Generic (PLEG): container finished" podID="3bfe86b8-4dda-44ce-9daa-49aad673c3a3" containerID="5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a" exitCode=0
Sep 04 22:22:46.690423 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.690304    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"
Sep 04 22:22:46.690423 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.690330    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv" event={"ID":"3bfe86b8-4dda-44ce-9daa-49aad673c3a3","Type":"ContainerDied","Data":"5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a"}
Sep 04 22:22:46.690423 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.690386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv" event={"ID":"3bfe86b8-4dda-44ce-9daa-49aad673c3a3","Type":"ContainerDied","Data":"4785a860112fa8a52e777de2a9b9b1e112efba11e7f411e9fb402bd6b16c642b"}
Sep 04 22:22:46.690423 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.690421    2577 scope.go:117] "RemoveContainer" containerID="5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a"
Sep 04 22:22:46.691404 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.691379    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-extensions-socket-volume\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:22:46.691497 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.691407    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwdtv\" (UniqueName: \"kubernetes.io/projected/3bfe86b8-4dda-44ce-9daa-49aad673c3a3-kube-api-access-bwdtv\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:22:46.699740 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.699723    2577 scope.go:117] "RemoveContainer" containerID="5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a"
Sep 04 22:22:46.699966 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:22:46.699948    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a\": container with ID starting with 5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a not found: ID does not exist" containerID="5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a"
Sep 04 22:22:46.700011 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.699975    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a"} err="failed to get container status \"5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a\": rpc error: code = NotFound desc = could not find container \"5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a\": container with ID starting with 5b235c61e25f2ee3de250b08a496c8da665b7df2871b832af48f0151aa0e270a not found: ID does not exist"
Sep 04 22:22:46.715571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.712590    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"]
Sep 04 22:22:46.717781 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:46.717733    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5fkgv"]
Sep 04 22:22:47.851131 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:22:47.851097    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bfe86b8-4dda-44ce-9daa-49aad673c3a3" path="/var/lib/kubelet/pods/3bfe86b8-4dda-44ce-9daa-49aad673c3a3/volumes"
Sep 04 22:23:23.822651 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:23.822608    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:23:23.829827 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:23.829803    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:23:46.705655 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.705598    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"]
Sep 04 22:23:46.706052 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706008    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5a74d8-5440-4ffc-92e6-97bf8b0fb410" containerName="revoke-keys"
Sep 04 22:23:46.706052 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706021    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5a74d8-5440-4ffc-92e6-97bf8b0fb410" containerName="revoke-keys"
Sep 04 22:23:46.706052 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706037    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy"
Sep 04 22:23:46.706052 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706044    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706053    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706062    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706079    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bfe86b8-4dda-44ce-9daa-49aad673c3a3" containerName="manager"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706084    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bfe86b8-4dda-44ce-9daa-49aad673c3a3" containerName="manager"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706091    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706096    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706167    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706176    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706181    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy"
Sep 04 22:23:46.706189 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706187    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bfe86b8-4dda-44ce-9daa-49aad673c3a3" containerName="manager"
Sep 04 22:23:46.706489 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.706194    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5a74d8-5440-4ffc-92e6-97bf8b0fb410" containerName="revoke-keys"
Sep 04 22:23:46.709207 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.709189    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:46.711755 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.711735    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7dqjc\""
Sep 04 22:23:46.719966 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.719944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"]
Sep 04 22:23:46.735578 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.735554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggpj\" (UniqueName: \"kubernetes.io/projected/d717f481-39f5-49b3-aa6c-31b27e942dc6-kube-api-access-zggpj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qg4wz\" (UID: \"d717f481-39f5-49b3-aa6c-31b27e942dc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:46.735735 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.735593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d717f481-39f5-49b3-aa6c-31b27e942dc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qg4wz\" (UID: \"d717f481-39f5-49b3-aa6c-31b27e942dc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:46.836956 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.836932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zggpj\" (UniqueName: \"kubernetes.io/projected/d717f481-39f5-49b3-aa6c-31b27e942dc6-kube-api-access-zggpj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qg4wz\" (UID: \"d717f481-39f5-49b3-aa6c-31b27e942dc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:46.837047 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.836977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d717f481-39f5-49b3-aa6c-31b27e942dc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qg4wz\" (UID: \"d717f481-39f5-49b3-aa6c-31b27e942dc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:46.837301 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.837284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d717f481-39f5-49b3-aa6c-31b27e942dc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qg4wz\" (UID: \"d717f481-39f5-49b3-aa6c-31b27e942dc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:46.845412 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:46.845395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggpj\" (UniqueName: \"kubernetes.io/projected/d717f481-39f5-49b3-aa6c-31b27e942dc6-kube-api-access-zggpj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qg4wz\" (UID: \"d717f481-39f5-49b3-aa6c-31b27e942dc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:47.021000 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:47.020980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:47.297347 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:47.297297    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"]
Sep 04 22:23:47.299896 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:23:47.299869    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd717f481_39f5_49b3_aa6c_31b27e942dc6.slice/crio-eed1e24c4555ab82a1e3cc83f27183aa8b3782f4f6c5679f4345beda6225cc10 WatchSource:0}: Error finding container eed1e24c4555ab82a1e3cc83f27183aa8b3782f4f6c5679f4345beda6225cc10: Status 404 returned error can't find the container with id eed1e24c4555ab82a1e3cc83f27183aa8b3782f4f6c5679f4345beda6225cc10
Sep 04 22:23:48.008257 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:48.008223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz" event={"ID":"d717f481-39f5-49b3-aa6c-31b27e942dc6","Type":"ContainerStarted","Data":"9374a0a9eaf7b92a4a75bd50dc48f0a852a592f61bf1b5024eca999ea9fbf3b0"}
Sep 04 22:23:48.008652 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:48.008284    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz" event={"ID":"d717f481-39f5-49b3-aa6c-31b27e942dc6","Type":"ContainerStarted","Data":"eed1e24c4555ab82a1e3cc83f27183aa8b3782f4f6c5679f4345beda6225cc10"}
Sep 04 22:23:48.008652 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:48.008340    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:23:48.029141 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:48.029099    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz" podStartSLOduration=2.029086253 podStartE2EDuration="2.029086253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:23:48.026094023 +0000 UTC m=+1824.798107032" watchObservedRunningTime="2026-09-04 22:23:48.029086253 +0000 UTC m=+1824.801099263"
Sep 04 22:23:59.016535 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:23:59.016493    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qg4wz"
Sep 04 22:24:32.287945 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:24:32.287905    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:24:47.367367 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:24:47.367280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:25:20.326301 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:20.326267    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:25:21.810794 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:21.810759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:25:24.135402 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:24.135371    2577 scope.go:117] "RemoveContainer" containerID="975ed1eeea724989438f6001712286e0eb6cc461591c22be39b8a399ae9a055e"
Sep 04 22:25:39.949836 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.949790    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"]
Sep 04 22:25:39.950201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.950181    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy"
Sep 04 22:25:39.950201 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.950194    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e25510-ff75-47b0-bd9e-f39bf9310822" containerName="istio-proxy"
Sep 04 22:25:39.950275 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.950257    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb78f12-9fa2-40b2-9feb-f454cbd33988" containerName="istio-proxy"
Sep 04 22:25:39.953154 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.953139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:39.955820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.955799    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 04 22:25:39.955820 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.955807    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2qzmr\""
Sep 04 22:25:39.956048 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.955853    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:25:39.956048 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.955875    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 04 22:25:39.956048 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.955808    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 04 22:25:39.962296 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:39.962274    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"]
Sep 04 22:25:40.028071 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.028045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31b3194-979c-4912-b7f0-7f53eb65b457-openshift-service-ca\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.028218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.028075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-maas-api-tls\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.028218 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.028096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-metrics-certs\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.028300 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.028241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mffs9\" (UniqueName: \"kubernetes.io/projected/b31b3194-979c-4912-b7f0-7f53eb65b457-kube-api-access-mffs9\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.128971 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.128940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mffs9\" (UniqueName: \"kubernetes.io/projected/b31b3194-979c-4912-b7f0-7f53eb65b457-kube-api-access-mffs9\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.129091 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.128983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31b3194-979c-4912-b7f0-7f53eb65b457-openshift-service-ca\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.129091 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.129000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-maas-api-tls\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.129091 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.129025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-metrics-certs\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.129722 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.129695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31b3194-979c-4912-b7f0-7f53eb65b457-openshift-service-ca\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.131429 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.131397    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-metrics-certs\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.131538 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.131472    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-maas-api-tls\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.135570 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.135552    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mffs9\" (UniqueName: \"kubernetes.io/projected/b31b3194-979c-4912-b7f0-7f53eb65b457-kube-api-access-mffs9\") pod \"maas-api-65db659b7c-ssd8s\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") " pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.264773 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.264749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:40.537278 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.537179    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"]
Sep 04 22:25:40.543477 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.543448    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:25:40.576423 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:40.576401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s" event={"ID":"b31b3194-979c-4912-b7f0-7f53eb65b457","Type":"ContainerStarted","Data":"5ba92b53de1cb2a084c934f86d46ac8143a3b6f27f261361cb122f2d0d9e8922"}
Sep 04 22:25:41.582508 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:41.582474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s" event={"ID":"b31b3194-979c-4912-b7f0-7f53eb65b457","Type":"ContainerStarted","Data":"08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede"}
Sep 04 22:25:41.583109 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:41.582547    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:41.598760 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:41.598716    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s" podStartSLOduration=2.145251268 podStartE2EDuration="2.59870024s" totalImagesPullingTime="453.448972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:25:41.597301631 +0000 UTC m=+1938.369314642" watchObservedRunningTime="2026-09-04 22:25:41.59870024 +0000 UTC m=+1938.370713296"
Sep 04 22:25:47.592139 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.592105    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:47.689332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.689302    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"]
Sep 04 22:25:47.693516 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.693497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.701371 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.701341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"]
Sep 04 22:25:47.788814 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.788788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b717eaac-d385-4425-994b-fb5cf9568f77-metrics-certs\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.788959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.788827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b717eaac-d385-4425-994b-fb5cf9568f77-maas-api-tls\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.788959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.788854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b717eaac-d385-4425-994b-fb5cf9568f77-openshift-service-ca\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.788959 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.788921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvkh\" (UniqueName: \"kubernetes.io/projected/b717eaac-d385-4425-994b-fb5cf9568f77-kube-api-access-tcvkh\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.889937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.889873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b717eaac-d385-4425-994b-fb5cf9568f77-maas-api-tls\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.889937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.889912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b717eaac-d385-4425-994b-fb5cf9568f77-openshift-service-ca\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.889937 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.889930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvkh\" (UniqueName: \"kubernetes.io/projected/b717eaac-d385-4425-994b-fb5cf9568f77-kube-api-access-tcvkh\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.890117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.890007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b717eaac-d385-4425-994b-fb5cf9568f77-metrics-certs\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.890661 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.890606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b717eaac-d385-4425-994b-fb5cf9568f77-openshift-service-ca\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.892321 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.892304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b717eaac-d385-4425-994b-fb5cf9568f77-metrics-certs\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.892397 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.892344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b717eaac-d385-4425-994b-fb5cf9568f77-maas-api-tls\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:47.897925 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:47.897905    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvkh\" (UniqueName: \"kubernetes.io/projected/b717eaac-d385-4425-994b-fb5cf9568f77-kube-api-access-tcvkh\") pod \"maas-api-755dcb75c7-hr5s9\" (UID: \"b717eaac-d385-4425-994b-fb5cf9568f77\") " pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:48.006769 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:48.006749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:48.277309 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:48.277283    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"]
Sep 04 22:25:48.279705 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:25:48.279678    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb717eaac_d385_4425_994b_fb5cf9568f77.slice/crio-e958ab0c496606648ae2a681154ed473343914f803a49f688fe8c277f6182cb8 WatchSource:0}: Error finding container e958ab0c496606648ae2a681154ed473343914f803a49f688fe8c277f6182cb8: Status 404 returned error can't find the container with id e958ab0c496606648ae2a681154ed473343914f803a49f688fe8c277f6182cb8
Sep 04 22:25:48.616623 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:48.616546    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9" event={"ID":"b717eaac-d385-4425-994b-fb5cf9568f77","Type":"ContainerStarted","Data":"e958ab0c496606648ae2a681154ed473343914f803a49f688fe8c277f6182cb8"}
Sep 04 22:25:49.623429 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:49.623388    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9" event={"ID":"b717eaac-d385-4425-994b-fb5cf9568f77","Type":"ContainerStarted","Data":"ee4bb15c9263409862e7d79739c90bb0434655b3014d627fc1970bda5f535d5d"}
Sep 04 22:25:49.623851 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:49.623477    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:49.640055 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:49.640013    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9" podStartSLOduration=2.211519307 podStartE2EDuration="2.639996225s" totalImagesPullingTime="428.476918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:25:49.638626562 +0000 UTC m=+1946.410639574" watchObservedRunningTime="2026-09-04 22:25:49.639996225 +0000 UTC m=+1946.412009235"
Sep 04 22:25:51.202901 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:51.202866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fggs5_3a630392-dc86-4290-a0e6-de385a8387b5/manager/0.log"
Sep 04 22:25:51.558943 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:51.558918    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8fs79_684bbab4-d316-4ea8-aabb-0438d6d33f2d/server/0.log"
Sep 04 22:25:51.679872 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:51.679833    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-467nx_1f5caba1-be57-4c2d-9927-cd9f38e312ab/manager/0.log"
Sep 04 22:25:52.047553 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:52.047528    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764b98687b-dxlhg_2875c0a6-a410-4e1f-b499-367225ffd9e6/copy-manifests/0.log"
Sep 04 22:25:52.064529 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:52.064504    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764b98687b-dxlhg_2875c0a6-a410-4e1f-b499-367225ffd9e6/manager/0.log"
Sep 04 22:25:52.411736 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:52.411661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65db659b7c-ssd8s_b31b3194-979c-4912-b7f0-7f53eb65b457/maas-api/0.log"
Sep 04 22:25:52.524299 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:52.524276    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-755dcb75c7-hr5s9_b717eaac-d385-4425-994b-fb5cf9568f77/maas-api/0.log"
Sep 04 22:25:53.756320 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:53.756286    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-kqll5_4197b7e5-2b49-412b-8c79-ea6f934ad91a/manager/0.log"
Sep 04 22:25:53.865132 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:53.865102    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-k8pp9_92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c/manager/0.log"
Sep 04 22:25:53.971550 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:53.971526    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-rlv5s_a832b64a-a1de-4b3c-945b-a2d80e469e18/kuadrant-console-plugin/0.log"
Sep 04 22:25:54.094434 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:54.094367    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-qg4wz_d717f481-39f5-49b3-aa6c-31b27e942dc6/manager/0.log"
Sep 04 22:25:54.336549 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:54.336519    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-6xbzg_a8afae98-1d24-4d64-900d-47f594dc2be3/manager/0.log"
Sep 04 22:25:54.935940 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:54.935906    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85db8bc976-rqrh9_578d2029-0fa5-4df3-9700-13c43b5c8514/kube-auth-proxy/0.log"
Sep 04 22:25:55.428440 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:55.428402    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9c2ks_5c150594-d718-4b18-b6a2-2b81db2745dc/payload-processing/0.log"
Sep 04 22:25:55.545888 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:55.545864    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f6c8885b8-v8qbh_7802a7ba-c4b5-49f2-9988-f4462937de53/router/0.log"
Sep 04 22:25:55.633842 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:55.633811    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-755dcb75c7-hr5s9"
Sep 04 22:25:55.679123 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:55.679037    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"]
Sep 04 22:25:55.679293 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:55.679270    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s" podUID="b31b3194-979c-4912-b7f0-7f53eb65b457" containerName="maas-api" containerID="cri-o://08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede" gracePeriod=30
Sep 04 22:25:55.930381 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:55.930323    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:56.019358 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.019329    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hqwnl_bed8ce1d-cc76-4316-877e-ce60d3472da6/main/0.log"
Sep 04 22:25:56.059691 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.059665    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-maas-api-tls\") pod \"b31b3194-979c-4912-b7f0-7f53eb65b457\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") "
Sep 04 22:25:56.059828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.059696    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31b3194-979c-4912-b7f0-7f53eb65b457-openshift-service-ca\") pod \"b31b3194-979c-4912-b7f0-7f53eb65b457\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") "
Sep 04 22:25:56.059828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.059775    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mffs9\" (UniqueName: \"kubernetes.io/projected/b31b3194-979c-4912-b7f0-7f53eb65b457-kube-api-access-mffs9\") pod \"b31b3194-979c-4912-b7f0-7f53eb65b457\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") "
Sep 04 22:25:56.059828 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.059791    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-metrics-certs\") pod \"b31b3194-979c-4912-b7f0-7f53eb65b457\" (UID: \"b31b3194-979c-4912-b7f0-7f53eb65b457\") "
Sep 04 22:25:56.060098 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.060075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31b3194-979c-4912-b7f0-7f53eb65b457-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b31b3194-979c-4912-b7f0-7f53eb65b457" (UID: "b31b3194-979c-4912-b7f0-7f53eb65b457"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:25:56.061913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.061884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b31b3194-979c-4912-b7f0-7f53eb65b457" (UID: "b31b3194-979c-4912-b7f0-7f53eb65b457"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:25:56.061913 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.061883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31b3194-979c-4912-b7f0-7f53eb65b457-kube-api-access-mffs9" (OuterVolumeSpecName: "kube-api-access-mffs9") pod "b31b3194-979c-4912-b7f0-7f53eb65b457" (UID: "b31b3194-979c-4912-b7f0-7f53eb65b457"). InnerVolumeSpecName "kube-api-access-mffs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:25:56.062048 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.061919    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b31b3194-979c-4912-b7f0-7f53eb65b457" (UID: "b31b3194-979c-4912-b7f0-7f53eb65b457"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:25:56.161323 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.161298    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-maas-api-tls\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:25:56.161323 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.161320    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31b3194-979c-4912-b7f0-7f53eb65b457-openshift-service-ca\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:25:56.161448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.161332    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mffs9\" (UniqueName: \"kubernetes.io/projected/b31b3194-979c-4912-b7f0-7f53eb65b457-kube-api-access-mffs9\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:25:56.161448 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.161341    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b31b3194-979c-4912-b7f0-7f53eb65b457-metrics-certs\") on node \"ip-10-0-128-61.ec2.internal\" DevicePath \"\""
Sep 04 22:25:56.248674 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.248603    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjtjrl_dd5dd81e-f505-4499-a217-98e3d58e3a1a/main/0.log"
Sep 04 22:25:56.660556 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.660526    2577 generic.go:356] "Generic (PLEG): container finished" podID="b31b3194-979c-4912-b7f0-7f53eb65b457" containerID="08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede" exitCode=0
Sep 04 22:25:56.660731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.660583    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"
Sep 04 22:25:56.660731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.660611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s" event={"ID":"b31b3194-979c-4912-b7f0-7f53eb65b457","Type":"ContainerDied","Data":"08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede"}
Sep 04 22:25:56.660731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.660678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s" event={"ID":"b31b3194-979c-4912-b7f0-7f53eb65b457","Type":"ContainerDied","Data":"5ba92b53de1cb2a084c934f86d46ac8143a3b6f27f261361cb122f2d0d9e8922"}
Sep 04 22:25:56.660731 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.660702    2577 scope.go:117] "RemoveContainer" containerID="08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede"
Sep 04 22:25:56.670463 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.670446    2577 scope.go:117] "RemoveContainer" containerID="08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede"
Sep 04 22:25:56.670769 ip-10-0-128-61 kubenswrapper[2577]: E0904 22:25:56.670751    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede\": container with ID starting with 08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede not found: ID does not exist" containerID="08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede"
Sep 04 22:25:56.670845 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.670777    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede"} err="failed to get container status \"08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede\": rpc error: code = NotFound desc = could not find container \"08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede\": container with ID starting with 08a21c4aef5cb50d3e0b0d8cac852a9574a136dd85d2c5f0511a3d33412f1ede not found: ID does not exist"
Sep 04 22:25:56.681520 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.681494    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"]
Sep 04 22:25:56.685985 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:56.685962    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-65db659b7c-ssd8s"]
Sep 04 22:25:57.851116 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:25:57.851075    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31b3194-979c-4912-b7f0-7f53eb65b457" path="/var/lib/kubelet/pods/b31b3194-979c-4912-b7f0-7f53eb65b457/volumes"
Sep 04 22:26:01.712135 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:01.712104    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:26:01.778824 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:01.778794    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:26:04.715561 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:04.715531    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dvvh2_db1ee4f6-293f-4063-9cb4-acdedfc96fa7/global-pull-secret-syncer/0.log"
Sep 04 22:26:04.844773 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:04.844728    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log"
Sep 04 22:26:04.925216 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:04.925181    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-61.ec2.internal_fed4194045521f365d114faefa73311c/haproxy/0.log"
Sep 04 22:26:09.678368 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:09.678337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-kqll5_4197b7e5-2b49-412b-8c79-ea6f934ad91a/manager/0.log"
Sep 04 22:26:09.715143 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:09.715115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-k8pp9_92fe8ffe-a883-4e2e-a0ec-ebb9ec2cbc9c/manager/0.log"
Sep 04 22:26:09.739106 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:09.739086    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-rlv5s_a832b64a-a1de-4b3c-945b-a2d80e469e18/kuadrant-console-plugin/0.log"
Sep 04 22:26:09.785117 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:09.785092    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-qg4wz_d717f481-39f5-49b3-aa6c-31b27e942dc6/manager/0.log"
Sep 04 22:26:09.900789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:09.900762    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-6xbzg_a8afae98-1d24-4d64-900d-47f594dc2be3/manager/0.log"
Sep 04 22:26:11.618915 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:11.618885    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-hs27z_5b7e5697-f59b-4970-a58e-6f9bcb4b9a92/cluster-monitoring-operator/0.log"
Sep 04 22:26:11.941999 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:11.941927    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5pmq_5afad4f5-8523-4b19-9ecb-5e0b7210144c/node-exporter/0.log"
Sep 04 22:26:11.961512 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:11.961485    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5pmq_5afad4f5-8523-4b19-9ecb-5e0b7210144c/kube-rbac-proxy/0.log"
Sep 04 22:26:11.978479 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:11.978462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5pmq_5afad4f5-8523-4b19-9ecb-5e0b7210144c/init-textfile/0.log"
Sep 04 22:26:13.839792 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:13.839761    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-9hkfv_f8529306-7f66-4db0-bf84-65530b4f0547/networking-console-plugin/0.log"
Sep 04 22:26:14.411282 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.411256    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/1.log"
Sep 04 22:26:14.427938 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.427890    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ql6g5_f0ca4367-fd7e-4c51-a763-cd939e9c1154/console-operator/2.log"
Sep 04 22:26:14.943618 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.943590    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76957fc459-wh9bm_76fbdcdd-0308-4d63-af2b-6bd2da7440e7/console/0.log"
Sep 04 22:26:14.978557 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.978536    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-t7vpj_99d2eb09-b6bc-4752-95ed-fec54d0cadd8/download-server/0.log"
Sep 04 22:26:14.990848 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.990823    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"]
Sep 04 22:26:14.991184 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.991171    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31b3194-979c-4912-b7f0-7f53eb65b457" containerName="maas-api"
Sep 04 22:26:14.991184 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.991185    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31b3194-979c-4912-b7f0-7f53eb65b457" containerName="maas-api"
Sep 04 22:26:14.991311 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.991266    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31b3194-979c-4912-b7f0-7f53eb65b457" containerName="maas-api"
Sep 04 22:26:14.994483 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.994465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:14.997789 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.997767    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqs8f\"/\"kube-root-ca.crt\""
Sep 04 22:26:14.998398 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.998377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gqs8f\"/\"default-dockercfg-725pc\""
Sep 04 22:26:14.998476 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:14.998377    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqs8f\"/\"openshift-service-ca.crt\""
Sep 04 22:26:15.003150 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.003131    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"]
Sep 04 22:26:15.105392 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.105365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-podres\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.105505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.105398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-proc\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.105505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.105432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjlzg\" (UniqueName: \"kubernetes.io/projected/a448e24b-73ba-49f5-9a81-5349a42484b0-kube-api-access-fjlzg\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.105505 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.105466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-sys\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.105621 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.105515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-lib-modules\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-sys\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206149 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-lib-modules\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-podres\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-sys\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-proc\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-proc\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjlzg\" (UniqueName: \"kubernetes.io/projected/a448e24b-73ba-49f5-9a81-5349a42484b0-kube-api-access-fjlzg\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206332 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-lib-modules\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.206552 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.206340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a448e24b-73ba-49f5-9a81-5349a42484b0-podres\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.213571 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.213548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjlzg\" (UniqueName: \"kubernetes.io/projected/a448e24b-73ba-49f5-9a81-5349a42484b0-kube-api-access-fjlzg\") pod \"perf-node-gather-daemonset-bkd6p\" (UID: \"a448e24b-73ba-49f5-9a81-5349a42484b0\") " pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.304766 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.304744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.574535 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.574502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"]
Sep 04 22:26:15.577382 ip-10-0-128-61 kubenswrapper[2577]: W0904 22:26:15.577360    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda448e24b_73ba_49f5_9a81_5349a42484b0.slice/crio-f751b91fea857d28a06ac818e0b3867750b49bdabfb7831f361f4c54e221d118 WatchSource:0}: Error finding container f751b91fea857d28a06ac818e0b3867750b49bdabfb7831f361f4c54e221d118: Status 404 returned error can't find the container with id f751b91fea857d28a06ac818e0b3867750b49bdabfb7831f361f4c54e221d118
Sep 04 22:26:15.708519 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.708500    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-mlzpj_ecb25480-a856-42e8-9f87-eb170d89d8c8/volume-data-source-validator/0.log"
Sep 04 22:26:15.758814 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.758786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p" event={"ID":"a448e24b-73ba-49f5-9a81-5349a42484b0","Type":"ContainerStarted","Data":"26b886421a12913c796258ce54e0237f8d5dea3d21e46aec04567945aa2bb00e"}
Sep 04 22:26:15.758900 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.758837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p" event={"ID":"a448e24b-73ba-49f5-9a81-5349a42484b0","Type":"ContainerStarted","Data":"f751b91fea857d28a06ac818e0b3867750b49bdabfb7831f361f4c54e221d118"}
Sep 04 22:26:15.758900 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.758879    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:15.773931 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:15.773885    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p" podStartSLOduration=1.773872339 podStartE2EDuration="1.773872339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:26:15.772815595 +0000 UTC m=+1972.544828605" watchObservedRunningTime="2026-09-04 22:26:15.773872339 +0000 UTC m=+1972.545885383"
Sep 04 22:26:16.850124 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:16.850091    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kntzg_63185afc-d764-488c-8d3e-ff86a5494b41/dns/0.log"
Sep 04 22:26:16.868002 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:16.867970    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kntzg_63185afc-d764-488c-8d3e-ff86a5494b41/kube-rbac-proxy/0.log"
Sep 04 22:26:16.887491 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:16.887469    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fwp9d_6f381a89-94bb-48c7-8bdd-b44e56695651/dns-node-resolver/0.log"
Sep 04 22:26:17.492735 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:17.492700    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kkwjz_a17e9807-9b5e-4cc5-90c3-7c6afd89e797/node-ca/0.log"
Sep 04 22:26:18.628989 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:18.628958    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85db8bc976-rqrh9_578d2029-0fa5-4df3-9700-13c43b5c8514/kube-auth-proxy/0.log"
Sep 04 22:26:18.753364 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:18.753327    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9c2ks_5c150594-d718-4b18-b6a2-2b81db2745dc/payload-processing/0.log"
Sep 04 22:26:18.774469 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:18.774432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f6c8885b8-v8qbh_7802a7ba-c4b5-49f2-9988-f4462937de53/router/0.log"
Sep 04 22:26:19.567185 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:19.567155    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4wv5v_01c87113-e1fc-499c-8cd0-1eba43565af8/serve-healthcheck-canary/0.log"
Sep 04 22:26:20.073334 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.073292    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-8rx8q_bff74870-50dd-444a-9cf3-00135ed88165/insights-operator/0.log"
Sep 04 22:26:20.076302 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.076280    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-8rx8q_bff74870-50dd-444a-9cf3-00135ed88165/insights-operator/1.log"
Sep 04 22:26:20.224365 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.224336    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vl5vx_09623da6-2cb8-4eb4-a754-87ccd3c94a72/kube-rbac-proxy/0.log"
Sep 04 22:26:20.241073 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.241049    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vl5vx_09623da6-2cb8-4eb4-a754-87ccd3c94a72/exporter/0.log"
Sep 04 22:26:20.259818 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.259794    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vl5vx_09623da6-2cb8-4eb4-a754-87ccd3c94a72/extractor/0.log"
Sep 04 22:26:20.805155 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.805127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:26:20.862167 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:20.862134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7k9f_72d4dfda-8b90-4f4d-93f7-fe171807c3bb/konnectivity-agent/0.log" limit=1024
Sep 04 22:26:21.773936 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:21.773906    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gqs8f/perf-node-gather-daemonset-bkd6p"
Sep 04 22:26:22.376904 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:22.376877    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fggs5_3a630392-dc86-4290-a0e6-de385a8387b5/manager/0.log"
Sep 04 22:26:22.631714 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:22.631623    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8fs79_684bbab4-d316-4ea8-aabb-0438d6d33f2d/server/0.log"
Sep 04 22:26:22.743567 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:22.743541    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-467nx_1f5caba1-be57-4c2d-9927-cd9f38e312ab/manager/0.log"
Sep 04 22:26:22.948960 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:22.948884    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764b98687b-dxlhg_2875c0a6-a410-4e1f-b499-367225ffd9e6/manager/0.log"
Sep 04 22:26:22.965102 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:22.965073    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764b98687b-dxlhg_2875c0a6-a410-4e1f-b499-367225ffd9e6/copy-manifests/0.log"
Sep 04 22:26:24.155443 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:24.155411    2577 scope.go:117] "RemoveContainer" containerID="a8c7cc7919f790d104f770243468b423f594cd0849793880584d1275f39f22b1"
Sep 04 22:26:24.163923 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:24.163895    2577 scope.go:117] "RemoveContainer" containerID="47f5a97fbf55839bbe1d3656492440367140f92478b5094f915db3d1221ac969"
Sep 04 22:26:25.747947 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:25.747872    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85db8bc976-rqrh9_578d2029-0fa5-4df3-9700-13c43b5c8514/kube-auth-proxy/0.log"
Sep 04 22:26:25.852955 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:25.852922    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9c2ks_5c150594-d718-4b18-b6a2-2b81db2745dc/payload-processing/0.log"
Sep 04 22:26:25.867068 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:25.867047    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f6c8885b8-v8qbh_7802a7ba-c4b5-49f2-9988-f4462937de53/router/0.log"
Sep 04 22:26:27.579898 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:27.579868    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85db8bc976-rqrh9_578d2029-0fa5-4df3-9700-13c43b5c8514/kube-auth-proxy/0.log"
Sep 04 22:26:27.682477 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:27.682437    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9c2ks_5c150594-d718-4b18-b6a2-2b81db2745dc/payload-processing/0.log"
Sep 04 22:26:27.702882 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:27.702850    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f6c8885b8-v8qbh_7802a7ba-c4b5-49f2-9988-f4462937de53/router/0.log"
Sep 04 22:26:29.385724 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:29.385694    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-r6cwf_3e983334-06d4-4810-ab8b-eeffc1a18a2a/migrator/0.log"
Sep 04 22:26:29.402204 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:29.402183    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-r6cwf_3e983334-06d4-4810-ab8b-eeffc1a18a2a/graceful-termination/0.log"
Sep 04 22:26:29.740944 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:29.740855    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-xkcpb_3db4739a-47e2-47ea-8e10-b68b9e58c8d8/kube-storage-version-migrator-operator/1.log"
Sep 04 22:26:29.742730 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:29.742695    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-xkcpb_3db4739a-47e2-47ea-8e10-b68b9e58c8d8/kube-storage-version-migrator-operator/0.log"
Sep 04 22:26:30.686221 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.686196    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/kube-multus-additional-cni-plugins/0.log"
Sep 04 22:26:30.703897 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.703872    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/egress-router-binary-copy/0.log"
Sep 04 22:26:30.720022 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.719999    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/cni-plugins/0.log"
Sep 04 22:26:30.736362 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.736340    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/bond-cni-plugin/0.log"
Sep 04 22:26:30.753138 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.753122    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/routeoverride-cni/0.log"
Sep 04 22:26:30.770077 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.770058    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/whereabouts-cni-bincopy/0.log"
Sep 04 22:26:30.786934 ip-10-0-128-61 kubenswrapper[2577]: I0904 22:26:30.786918    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r2zk_70efcff8-67a7-4d35-9300-beff862fbb5f/whereabouts-cni/0.log"