Sep 07 16:54:45.642805 ip-10-0-128-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 16:54:45.642816 ip-10-0-128-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 16:54:45.642825 ip-10-0-128-63 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 16:54:45.643156 ip-10-0-128-63 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 16:54:55.727481 ip-10-0-128-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 07 16:54:55.727495 ip-10-0-128-63 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 195fd6639e77433a95b488db9320ad8a --
Sep 07 16:56:28.249854 ip-10-0-128-63 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 16:56:28.677524 ip-10-0-128-63 kubenswrapper[2545]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:28.677524 ip-10-0-128-63 kubenswrapper[2545]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 16:56:28.677524 ip-10-0-128-63 kubenswrapper[2545]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:28.677524 ip-10-0-128-63 kubenswrapper[2545]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 16:56:28.677524 ip-10-0-128-63 kubenswrapper[2545]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:28.680121 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.680031    2545 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 16:56:28.683314 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683297    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:28.683314 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683313    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:28.683314 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683317    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683330    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683334    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683338    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683341    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683344    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683346    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683349    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683352    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683355    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683357    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683360    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683362    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683365    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683367    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683370    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683373    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683376    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683378    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683381    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:28.683444 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683384    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683388    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683393    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683396    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683399    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683402    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683404    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683407    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683410    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683413    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683415    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683418    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683420    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683424    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683428    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683431    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683435    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683438    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:28.683976 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683441    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683444    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683447    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683449    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683452    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683455    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683459    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683461    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683464    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683467    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683470    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683473    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683476    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683479    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683481    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683484    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683487    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683489    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683492    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683494    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:28.684414 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683496    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683499    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683501    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683505    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683507    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683509    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683512    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683514    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683518    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683520    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683523    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683526    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683529    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683531    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683546    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683549    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683553    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683556    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683558    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683561    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:28.684932 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683564    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683566    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683569    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683571    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683574    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683576    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683579    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683581    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683584    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683586    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683589    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683593    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683595    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683598    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683600    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683603    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683606    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683608    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.683611    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684389    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:28.685422 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684399    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684404    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684407    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684410    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684419    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684422    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684426    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684428    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684431    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684434    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684436    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684439    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684441    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684444    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684446    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684449    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684452    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684454    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684457    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684459    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:28.685955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684462    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684464    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684467    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684470    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684473    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684475    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684478    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684481    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684483    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684486    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684488    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684491    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684494    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684496    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684499    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684501    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684504    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684512    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684515    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684518    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:28.686447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684520    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684523    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684525    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684528    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684530    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684547    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684551    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684553    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684556    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684559    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684561    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684564    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684568    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684572    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684575    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684578    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684581    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684583    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684586    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:28.687015 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684588    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684591    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684593    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684596    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684598    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684602    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684605    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684608    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684612    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684616    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684619    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684627    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684630    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684633    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684636    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684639    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684642    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684644    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684647    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684650    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:28.687484 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684653    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684655    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684659    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684662    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684664    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684667    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684670    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684672    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684675    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684679    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684682    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684685    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684688    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684691    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684694    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684697    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684699    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684703    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.684706    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:28.688003 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685084    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685088    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685091    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685094    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685098    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685100    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685103    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685107    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685111    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685114    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685117    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685120    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685123    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685125    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685128    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685130    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685133    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685135    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685138    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:28.688468 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685140    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685143    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685146    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685149    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685151    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685154    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685159    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685162    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685164    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685167    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685169    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685172    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685175    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685177    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685180    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685183    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685185    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685188    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685191    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:28.688955 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685193    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685196    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685198    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685200    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685203    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685205    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685208    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685211    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685213    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685215    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685218    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685221    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685223    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685226    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685228    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685231    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685233    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685236    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685239    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685241    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685244    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:28.689512 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685247    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685249    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685252    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685254    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685257    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685261    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685264    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685267    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685269    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685271    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685274    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685277    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685279    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685282    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685285    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685287    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685290    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685292    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685294    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:28.690040 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685299    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685302    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685305    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685308    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685311    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685313    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685316    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685319    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685322    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685325    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685328    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685330    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685333    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685337    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685339    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685342    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685345    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685347    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685350    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685352    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:28.690495 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.685354    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685427    2545 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685460    2545 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685465    2545 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685470    2545 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685475    2545 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685478    2545 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685483    2545 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685487    2545 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685491    2545 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685494    2545 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685497    2545 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685500    2545 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685503    2545 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685507    2545 flags.go:64] FLAG: --cgroup-root=""
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685510    2545 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685527    2545 flags.go:64] FLAG: --client-ca-file=""
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685531    2545 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685547    2545 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685553    2545 flags.go:64] FLAG: --cluster-domain=""
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685556    2545 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685559    2545 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685562    2545 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685566    2545 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 16:56:28.690998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685570    2545 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685573    2545 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685576    2545 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685579    2545 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685583    2545 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685586    2545 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685589    2545 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685593    2545 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685596    2545 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685600    2545 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685604    2545 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685610    2545 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685613    2545 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685616    2545 flags.go:64] FLAG: --enable-server="true"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685620    2545 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685624    2545 flags.go:64] FLAG: --event-burst="100"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685628    2545 flags.go:64] FLAG: --event-qps="50"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685631    2545 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685634    2545 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685637    2545 flags.go:64] FLAG: --eviction-hard=""
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685641    2545 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685644    2545 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685647    2545 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685650    2545 flags.go:64] FLAG: --eviction-soft=""
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685653    2545 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 16:56:28.691596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685656    2545 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685659    2545 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685662    2545 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685665    2545 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685668    2545 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685671    2545 flags.go:64] FLAG: --feature-gates=""
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685675    2545 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685678    2545 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685681    2545 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685684    2545 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685687    2545 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685690    2545 flags.go:64] FLAG: --help="false"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685694    2545 flags.go:64] FLAG: --hostname-override="ip-10-0-128-63.ec2.internal"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685697    2545 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685700    2545 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685703    2545 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685706    2545 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685710    2545 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685714    2545 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685717    2545 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685720    2545 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685723    2545 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685726    2545 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685730    2545 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 16:56:28.692247 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685733    2545 flags.go:64] FLAG: --kube-reserved=""
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685735    2545 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685738    2545 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685741    2545 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685744    2545 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685747    2545 flags.go:64] FLAG: --lock-file=""
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685750    2545 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685753    2545 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685756    2545 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685761    2545 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685764    2545 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685767    2545 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685770    2545 flags.go:64] FLAG: --logging-format="text"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685773    2545 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685776    2545 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685779    2545 flags.go:64] FLAG: --manifest-url=""
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685782    2545 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685786    2545 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685789    2545 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685794    2545 flags.go:64] FLAG: --max-pods="110"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685797    2545 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685800    2545 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685803    2545 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685806    2545 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685809    2545 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 16:56:28.692899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685812    2545 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685819    2545 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685826    2545 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685829    2545 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685832    2545 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685836    2545 flags.go:64] FLAG: --pod-cidr=""
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685839    2545 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685845    2545 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685848    2545 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685851    2545 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685854    2545 flags.go:64] FLAG: --port="10250"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685857    2545 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685860    2545 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f83151830745216d"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685863    2545 flags.go:64] FLAG: --qos-reserved=""
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685866    2545 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685869    2545 flags.go:64] FLAG: --register-node="true"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685872    2545 flags.go:64] FLAG: --register-with-taints=""
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685876    2545 flags.go:64] FLAG: --registry-burst="10"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685879    2545 flags.go:64] FLAG: --registry-qps="5"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685882    2545 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685885    2545 flags.go:64] FLAG: --reserved-memory=""
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685889    2545 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685892    2545 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685895    2545 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685898    2545 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 16:56:28.693544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685901    2545 flags.go:64] FLAG: --runonce="false"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685905    2545 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685908    2545 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685911    2545 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685914    2545 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685917    2545 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685920    2545 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685923    2545 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685927    2545 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685930    2545 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685934    2545 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685937    2545 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685940    2545 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685943    2545 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685946    2545 flags.go:64] FLAG: --system-cgroups=""
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685949    2545 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685955    2545 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685958    2545 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685961    2545 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685985    2545 flags.go:64] FLAG: --tls-min-version=""
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685989    2545 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685992    2545 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685995    2545 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.685998    2545 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.686001    2545 flags.go:64] FLAG: --v="2"
Sep 07 16:56:28.694167 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.686005    2545 flags.go:64] FLAG: --version="false"
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.686010    2545 flags.go:64] FLAG: --vmodule=""
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.686013    2545 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.686017    2545 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686132    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686137    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686142    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686145    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686151    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686154    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686157    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686159    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686162    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686165    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686168    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686172    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686175    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686178    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686180    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686183    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:28.694808 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686186    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686188    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686191    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686194    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686197    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686199    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686202    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686204    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686207    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686210    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686212    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686215    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686217    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686220    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686223    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686225    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686228    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686231    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686233    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686236    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:28.695292 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686240    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686242    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686245    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686249    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686252    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686255    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686258    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686262    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686265    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686267    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686270    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686273    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686275    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686278    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686281    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686284    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686286    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686289    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686292    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:28.695804 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686294    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686297    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686299    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686302    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686304    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686307    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686310    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686312    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686315    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686318    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686320    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686323    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686325    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686329    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686331    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686334    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686337    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686339    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686342    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686345    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:28.696304 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686348    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686351    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686354    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686357    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686359    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686362    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686364    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686367    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686370    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686373    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686375    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686378    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686380    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686383    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686385    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686389    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686393    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686396    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686399    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686401    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:28.697148 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686404    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686406    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686409    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.686411    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.687111    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.694879    2545 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.694895    2545 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.695887    2545 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.695894    2545 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695950    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695956    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695959    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695963    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695965    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:28.697833 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695968    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695971    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695974    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695976    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695979    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695981    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695985    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695987    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695990    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695993    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695995    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.695998    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696000    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696003    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696006    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696009    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696012    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696014    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696017    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696019    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:28.698196 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696022    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696025    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696027    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696030    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696034    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696036    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696039    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696041    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696044    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696046    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696049    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696052    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696054    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696057    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696060    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696062    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696065    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696067    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696070    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696073    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:28.698711 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696075    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696078    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696080    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696083    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696086    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696090    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696093    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696097    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696100    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696103    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696105    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696109    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696111    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696115    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696119    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696123    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696126    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696129    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696132    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:28.699194 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696134    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696137    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696140    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696142    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696145    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696148    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696150    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696153    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696156    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696158    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696161    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696163    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696166    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696168    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696171    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696174    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696176    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696179    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696181    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696184    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:28.699674 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696187    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696190    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696192    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696194    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696197    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696199    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696202    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696205    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696207    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696210    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696213    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696216    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696220    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696223    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:28.700192 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696226    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.696231    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696495    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696508    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696513    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696518    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696627    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696645    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696651    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696656    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696661    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696666    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696671    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696677    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696681    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:28.700590 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696685    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696692    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696699    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696712    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696716    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696722    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696727    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696734    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696739    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696746    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696750    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696755    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696759    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696764    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696768    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696777    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696782    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696787    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696791    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696796    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:28.700963 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696800    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696805    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696810    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696814    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696820    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696824    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696829    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696833    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696842    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696846    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696850    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696855    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696859    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696864    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696868    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696872    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696877    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696882    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696886    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696890    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:28.701447 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696899    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696904    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696908    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696912    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696916    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696921    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696925    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696930    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696938    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696944    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696948    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696953    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696957    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696967    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696971    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696976    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696980    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696985    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696990    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:28.701950 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696994    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.696999    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697003    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697007    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697012    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697016    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697022    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697032    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697036    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697040    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697044    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697048    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697052    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697057    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697061    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697065    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697069    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697073    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697077    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:28.702417 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697086    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697091    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697098    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697104    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697109    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697114    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697118    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:28.697123    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.697130    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.697394    2545 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.699704    2545 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.700765    2545 server.go:1019] "Starting client certificate rotation"
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.700859    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 16:56:28.702902 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.700894    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 16:56:28.703618 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.703604    2545 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 16:56:28.705189 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.705169    2545 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 16:56:28.714152 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.714132    2545 log.go:25] "Validated CRI v1 runtime API"
Sep 07 16:56:28.718030 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.718013    2545 log.go:25] "Validated CRI v1 image API"
Sep 07 16:56:28.718893 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.718876    2545 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 16:56:28.722302 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.722273    2545 fs.go:135] Filesystem UUIDs: map[756b1307-5b20-4dc6-a34b-69227fc34080:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a57f0b38-9ee3-4448-a178-d5cb1286fc74:/dev/nvme0n1p4]
Sep 07 16:56:28.722397 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.722300    2545 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 16:56:28.729051 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.728930    2545 manager.go:216] Machine: {Timestamp:2026-09-07 16:56:28.727527542 +0000 UTC m=+0.368082349 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101735 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2be3df5102f33fa05c667bd47f8500 SystemUUID:ec2be3df-5102-f33f-a05c-667bd47f8500 BootID:195fd663-9e77-433a-95b4-88db9320ad8a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:f5:66:af:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:f5:66:af:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:f3:7a:1a:13:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 16:56:28.729051 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.729037    2545 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 16:56:28.729223 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.729179    2545 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 16:56:28.732726 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.732701    2545 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 16:56:28.732858 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.732728    2545 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 16:56:28.733638 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.733628    2545 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 16:56:28.733671 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.733639    2545 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 16:56:28.733671 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.733647    2545 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 16:56:28.734454 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.734444    2545 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 16:56:28.736191 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.736178    2545 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 16:56:28.739979 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.739961    2545 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 16:56:28.740502 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740490    2545 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 16:56:28.740627 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740618    2545 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 16:56:28.740666 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740649    2545 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 16:56:28.740666 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740662    2545 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 16:56:28.740720 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740681    2545 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 16:56:28.740720 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740695    2545 kubelet.go:398] "Adding apiserver pod source"
Sep 07 16:56:28.740720 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.740705    2545 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 16:56:28.741250 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.741234    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 16:56:28.741302 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.741268    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 16:56:28.744952 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.744927    2545 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 16:56:28.747896 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.747881    2545 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 16:56:28.747951 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.747912    2545 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 16:56:28.748066 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748057    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 16:56:28.748107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748071    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 16:56:28.748107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748076    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 16:56:28.748107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748081    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 16:56:28.748107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748088    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 16:56:28.748107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748093    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 16:56:28.748737 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748728    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 16:56:28.748737 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748737    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 16:56:28.748801 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748744    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 16:56:28.748801 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748750    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 16:56:28.748801 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748758    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 16:56:28.748801 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.748766    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 16:56:28.749598 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.749585    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 16:56:28.749636 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.749601    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 16:56:28.753742 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.753730    2545 server.go:1268] "Started kubelet"
Sep 07 16:56:28.753857 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.753801    2545 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 16:56:28.753965 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.753845    2545 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 16:56:28.753965 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.753912    2545 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 16:56:28.754750 ip-10-0-128-63 systemd[1]: Started Kubernetes Kubelet.
Sep 07 16:56:28.754986 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.754878    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 16:56:28.755052 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.754983    2545 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 16:56:28.755477 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.755457    2545 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 16:56:28.755976 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.754858    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 16:56:28.756208 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.756195    2545 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 16:56:28.762020 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.762003    2545 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 16:56:28.762886 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.762865    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 16:56:28.763604 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.763588    2545 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 16:56:28.763704 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.763671    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:28.764314 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764299    2545 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 16:56:28.764314 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764299    2545 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 16:56:28.764457 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764326    2545 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 16:56:28.764457 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764441    2545 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 16:56:28.764457 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764451    2545 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 16:56:28.764599 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764571    2545 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 16:56:28.764636 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764604    2545 factory.go:55] Registering systemd factory
Sep 07 16:56:28.764636 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764613    2545 factory.go:223] Registration of the systemd container factory successfully
Sep 07 16:56:28.764846 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764835    2545 factory.go:153] Registering CRI-O factory
Sep 07 16:56:28.764881 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764850    2545 factory.go:223] Registration of the crio container factory successfully
Sep 07 16:56:28.764881 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764863    2545 factory.go:103] Registering Raw factory
Sep 07 16:56:28.764881 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.764876    2545 manager.go:1196] Started watching for new ooms in manager
Sep 07 16:56:28.765262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.765242    2545 manager.go:349] Starting recovery of all containers
Sep 07 16:56:28.776373 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.776311    2545 manager.go:354] Recovery completed
Sep 07 16:56:28.778633 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.778465    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 16:56:28.778633 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.778575    2545 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 16:56:28.779686 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.778482    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d3184b50d0edfc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-07 16:56:28.753702396 +0000 UTC m=+0.394257183,LastTimestamp:2026-09-07 16:56:28.753702396 +0000 UTC m=+0.394257183,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}"
Sep 07 16:56:28.784056 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.784039    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.785853 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.785837    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.785923 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.785866    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.785923 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.785878    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:28.786424 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.786407    2545 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 16:56:28.786424 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.786423    2545 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 16:56:28.786527 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.786441    2545 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 16:56:28.786527 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.786443    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.787135 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.787119    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.787190 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.787145    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.787190 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.787159    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:28.787964 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.787891    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d3184b52bb82ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-07 16:56:28.785853183 +0000 UTC m=+0.426407970,LastTimestamp:2026-09-07 16:56:28.785853183 +0000 UTC m=+0.426407970,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}"
Sep 07 16:56:28.788634 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.788621    2545 policy_none.go:49] "None policy: Start"
Sep 07 16:56:28.788669 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.788640    2545 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 16:56:28.788669 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.788654    2545 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 16:56:28.790585 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.790574    2545 policy_none.go:47] "Start"
Sep 07 16:56:28.797552 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.797524    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtf9t"
Sep 07 16:56:28.798849 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.798783    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d3184b52bbca78  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-63.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-07 16:56:28.78587148 +0000 UTC m=+0.426426267,LastTimestamp:2026-09-07 16:56:28.78587148 +0000 UTC m=+0.426426267,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}"
Sep 07 16:56:28.808632 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.808528    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d3184b52bbf39b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-63.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-07 16:56:28.785882011 +0000 UTC m=+0.426436798,LastTimestamp:2026-09-07 16:56:28.785882011 +0000 UTC m=+0.426436798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}"
Sep 07 16:56:28.815357 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.815285    2545 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-63.ec2.internal.18d3184b52bb82ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d3184b52bb82ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-07 16:56:28.785853183 +0000 UTC m=+0.426407970,LastTimestamp:2026-09-07 16:56:28.787135077 +0000 UTC m=+0.427689868,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.815758    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtf9t"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820110    2545 manager.go:337] "Starting Device Plugin manager"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.820141    2545 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820151    2545 server.go:87] "Starting device plugin registration server"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820458    2545 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820468    2545 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820579    2545 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820707    2545 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.820727    2545 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.821967    2545 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.822030    2545 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:28.839833 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.822921    2545 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-63.ec2.internal.18d3184b52bbca78\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d3184b52bbca78  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-63.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-07 16:56:28.78587148 +0000 UTC m=+0.426426267,LastTimestamp:2026-09-07 16:56:28.787152491 +0000 UTC m=+0.427707278,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}"
Sep 07 16:56:28.880522 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.880483    2545 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 16:56:28.881882 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.881866    2545 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 16:56:28.881961 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.881913    2545 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 16:56:28.881961 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.881936    2545 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 16:56:28.882044 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.882029    2545 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 16:56:28.885302 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.885284    2545 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:28.921199 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.921166    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.922174 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.922157    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.922265 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.922187    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.922265 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.922199    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:28.922265 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.922226    2545 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-63.ec2.internal"
Sep 07 16:56:28.938527 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.938447    2545 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-63.ec2.internal"
Sep 07 16:56:28.938527 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.938472    2545 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-63.ec2.internal\": node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:28.967407 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:28.967386    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:28.982596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.982570    2545 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"]
Sep 07 16:56:28.982680 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.982644    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.983501 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.983485    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.983564 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.983514    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.983564 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.983524    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:28.985767 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.985756    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.985870 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.985856    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:28.985906 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.985887    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.986604 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.986589    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.986604 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.986609    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.986716 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.986615    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.986716 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.986629    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:28.986773 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.986631    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.986773 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.986738    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:28.988764 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.988747    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:28.988852 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.988774    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:28.989419 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.989397    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:28.989512 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.989433    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:28.989512 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:28.989446    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:29.012108 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.012088    2545 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-63.ec2.internal\" not found" node="ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.016450 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.016434    2545 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-63.ec2.internal\" not found" node="ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.068323 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.068298    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.166255 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.166219    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e20bfcd8fa7c3756f9a221829a74dd57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"e20bfcd8fa7c3756f9a221829a74dd57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.166255 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.166255    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e20bfcd8fa7c3756f9a221829a74dd57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"e20bfcd8fa7c3756f9a221829a74dd57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.166457 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.166280    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07df7873c55aad720a5c1b311be3ff60-config\") pod \"kube-apiserver-proxy-ip-10-0-128-63.ec2.internal\" (UID: \"07df7873c55aad720a5c1b311be3ff60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.168882 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.168860    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.266631 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.266562    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e20bfcd8fa7c3756f9a221829a74dd57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"e20bfcd8fa7c3756f9a221829a74dd57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.266631 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.266592    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07df7873c55aad720a5c1b311be3ff60-config\") pod \"kube-apiserver-proxy-ip-10-0-128-63.ec2.internal\" (UID: \"07df7873c55aad720a5c1b311be3ff60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.266631 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.266608    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e20bfcd8fa7c3756f9a221829a74dd57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"e20bfcd8fa7c3756f9a221829a74dd57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.266816 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.266636    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e20bfcd8fa7c3756f9a221829a74dd57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"e20bfcd8fa7c3756f9a221829a74dd57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.266816 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.266658    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07df7873c55aad720a5c1b311be3ff60-config\") pod \"kube-apiserver-proxy-ip-10-0-128-63.ec2.internal\" (UID: \"07df7873c55aad720a5c1b311be3ff60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.266816 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.266658    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e20bfcd8fa7c3756f9a221829a74dd57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"e20bfcd8fa7c3756f9a221829a74dd57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.269472 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.269454    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.314815 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.314788    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.319651 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.319443    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:29.369813 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.369787    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.470407 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.470368    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.570591 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.570514    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.671075 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.671037    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.700321 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.700289    2545 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 16:56:29.700921 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.700509    2545 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 16:56:29.771997 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.771963    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.816787 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.816749    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:29.817963 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.817944    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:29.818062 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.817976    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:29.818062 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.817986    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:29.819082 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.819046    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 16:51:29 +0000 UTC" deadline="2028-03-04 10:32:25.617405979 +0000 UTC"
Sep 07 16:56:29.819129 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.819082    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13049h35m55.798326925s"
Sep 07 16:56:29.871923 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:29.871890    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20bfcd8fa7c3756f9a221829a74dd57.slice/crio-3c49690fc2c0bee5c7e87e3d037fdcc67a89b3b287eb67035e896cbfd83c5f7a WatchSource:0}: Error finding container 3c49690fc2c0bee5c7e87e3d037fdcc67a89b3b287eb67035e896cbfd83c5f7a: Status 404 returned error can't find the container with id 3c49690fc2c0bee5c7e87e3d037fdcc67a89b3b287eb67035e896cbfd83c5f7a
Sep 07 16:56:29.873007 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.872981    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:29.878408 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.878393    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 16:56:29.884160 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:29.884124    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07df7873c55aad720a5c1b311be3ff60.slice/crio-94726412a1eaeebd7cf4c4d8806c147a988e3e1384df583f4fe53c46ab25743a WatchSource:0}: Error finding container 94726412a1eaeebd7cf4c4d8806c147a988e3e1384df583f4fe53c46ab25743a: Status 404 returned error can't find the container with id 94726412a1eaeebd7cf4c4d8806c147a988e3e1384df583f4fe53c46ab25743a
Sep 07 16:56:29.887064 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.887019    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" event={"ID":"07df7873c55aad720a5c1b311be3ff60","Type":"ContainerStarted","Data":"94726412a1eaeebd7cf4c4d8806c147a988e3e1384df583f4fe53c46ab25743a"}
Sep 07 16:56:29.888191 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:29.888171    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" event={"ID":"e20bfcd8fa7c3756f9a221829a74dd57","Type":"ContainerStarted","Data":"3c49690fc2c0bee5c7e87e3d037fdcc67a89b3b287eb67035e896cbfd83c5f7a"}
Sep 07 16:56:29.974180 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:29.974136    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found"
Sep 07 16:56:30.014031 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.014009    2545 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:30.032508 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.032472    2545 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:30.064521 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.064479    2545 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:30.089963 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.089933    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 16:56:30.091195 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.091179    2545 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal"
Sep 07 16:56:30.109970 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.109940    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 16:56:30.346882 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.346796    2545 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:30.676352 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.676268    2545 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:30.742173 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.742143    2545 apiserver.go:52] "Watching apiserver"
Sep 07 16:56:30.751648 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.751617    2545 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 16:56:30.752161 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.752106    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4j6sg","openshift-network-diagnostics/network-check-target-482vq","openshift-network-operator/iptables-alerter-pfpn5","openshift-ovn-kubernetes/ovnkube-node-5mjkw","kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb","openshift-cluster-node-tuning-operator/tuned-jdn7z","openshift-image-registry/node-ca-ctfcw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal","openshift-multus/multus-additional-cni-plugins-hwrq4","openshift-multus/multus-rmcfm","openshift-multus/network-metrics-daemon-bzd4s","kube-system/global-pull-secret-syncer-nffqs","kube-system/konnectivity-agent-hqdcj"]
Sep 07 16:56:30.755349 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.754946    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.757361 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.757337    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.758176 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.758156    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.758279 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.758192    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.759899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.759876    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.761441 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.761415    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.761544 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.761464    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\""
Sep 07 16:56:30.762420 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.762152    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.763390 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.763363    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 16:56:30.765002 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.764984    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.765539 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.765504    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 16:56:30.765698 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.765673    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 16:56:30.767270 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.767251    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.768568 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.768407    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.768568 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.768414    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.769475 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.769457    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 16:56:30.770014 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.769744    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 16:56:30.770014 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.769750    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.770014 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.769928    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.771583 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.770964    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 16:56:30.771583 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.771105    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.773388 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.772989    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.773388 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.773078    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:30.775063 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775045    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-host\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775159 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775075    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzs94\" (UniqueName: \"kubernetes.io/projected/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-kube-api-access-wzs94\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.775159 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775101    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ca8bec1-41d5-4b8e-8076-a1457603064a-konnectivity-ca\") pod \"konnectivity-agent-hqdcj\" (UID: \"5ca8bec1-41d5-4b8e-8076-a1457603064a\") " pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.775159 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775124    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-kubernetes\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775159 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775151    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovn-node-metrics-cert\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.775377 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775189    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-systemd\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775377 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775221    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-kubelet\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.775377 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775274    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-multus-certs\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.775377 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775324    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptxz\" (UniqueName: \"kubernetes.io/projected/aaec868b-5f92-44ed-87c7-6bed19576466-kube-api-access-cptxz\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.775377 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775357    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-slash\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775386    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-var-lib-kubelet\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775409    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-run\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775442    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-sys\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775474    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-477d8\" (UniqueName: \"kubernetes.io/projected/8bc11b44-703f-413b-9c64-3f8b0511acd4-kube-api-access-477d8\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775498    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-cni-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775515    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-netns\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775575    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-cni-bin\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.775650 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775615    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaec868b-5f92-44ed-87c7-6bed19576466-host-slash\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.776065 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775649    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-socket-dir-parent\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.776065 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775703    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-cni-multus\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.776065 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775720    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-log-socket\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776065 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.775760    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776316 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776218    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:30.776316 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.776293    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776429    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovnkube-script-lib\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776476    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95n92\" (UniqueName: \"kubernetes.io/projected/fa54c1d5-9836-41a6-a55a-089833e7eaea-kube-api-access-95n92\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776499    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-modprobe-d\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776543    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-cni-binary-copy\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776574    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-hostroot\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776642    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-tuned\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776674    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaec868b-5f92-44ed-87c7-6bed19576466-iptables-alerter-script\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776704    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-etc-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776731    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-ovn\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776755    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776777    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bc11b44-703f-413b-9c64-3f8b0511acd4-tmp\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776816    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-kubelet\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776843    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-systemd\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776868    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776894    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-cni-netd\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.776936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776937    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovnkube-config\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776964    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-env-overrides\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.776986    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-lib-modules\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777011    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-conf-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777037    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-daemon-config\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777086    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-etc-kubernetes\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777110    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysctl-d\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777134    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-run-netns\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777158    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-node-log\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777184    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysconfig\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777276    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysctl-conf\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777303    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-k8s-cni-cncf-io\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777350    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-var-lib-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777375    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ca8bec1-41d5-4b8e-8076-a1457603064a-agent-certs\") pod \"konnectivity-agent-hqdcj\" (UID: \"5ca8bec1-41d5-4b8e-8076-a1457603064a\") " pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777436    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-system-cni-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777463    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-cni-bin\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777499    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-cnibin\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.777765 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777554    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-systemd-units\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.778487 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.777987    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 16:56:30.778487 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.778100    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 16:56:30.778487 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.778212    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.778487 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.778348    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\""
Sep 07 16:56:30.779692 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.779670    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 16:56:30.779803 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.779720    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.780073 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.780017    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.780697 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.780665    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\""
Sep 07 16:56:30.781089 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.781043    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.781491 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.781472    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.781601 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.781517    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.781990    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.782259    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.782522    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.782790    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.783045    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.783342    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.783682    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\""
Sep 07 16:56:30.785262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.785232    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.787498 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.787186    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\""
Sep 07 16:56:30.787498 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.787244    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 16:56:30.787498 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.787324    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 16:56:30.789807 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.789785    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:30.789917 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.789857    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:30.792625 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.792602    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 16:56:30.792811 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.792715    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\""
Sep 07 16:56:30.792811 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.792767    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 16:56:30.808049 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.808025    2545 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 16:56:30.852234 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.852190    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qg9rv"
Sep 07 16:56:30.865550 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.865507    2545 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 16:56:30.871405 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.871378    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qg9rv"
Sep 07 16:56:30.877880 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.877852    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.877894    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-var-lib-kubelet\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.877925    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-run\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.877944    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-sys\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.877966    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-477d8\" (UniqueName: \"kubernetes.io/projected/8bc11b44-703f-413b-9c64-3f8b0511acd4-kube-api-access-477d8\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.877990    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-cni-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878013    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-netns\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.878043 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878036    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-cni-bin\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878092    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaec868b-5f92-44ed-87c7-6bed19576466-host-slash\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878119    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-socket-dir-parent\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878144    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-cni-multus\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878170    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-log-socket\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878208    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878240    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-sys-fs\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878265    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e483962-770d-4578-b4b2-e770dff93296-serviceca\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878290    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eada764a-cb73-4632-940a-c6741d20b9e9-kubelet-config\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878320    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovnkube-script-lib\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878348    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95n92\" (UniqueName: \"kubernetes.io/projected/fa54c1d5-9836-41a6-a55a-089833e7eaea-kube-api-access-95n92\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878373    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-modprobe-d\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878398    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-cni-binary-copy\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.878438 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878442    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-hostroot\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878481    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzvxn\" (UniqueName: \"kubernetes.io/projected/18f90270-7f3d-4ee5-b293-14a694dcb4ea-kube-api-access-qzvxn\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878512    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-tuned\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878516    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-socket-dir-parent\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878546    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaec868b-5f92-44ed-87c7-6bed19576466-iptables-alerter-script\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878653    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-var-lib-kubelet\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878715    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-run\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878753    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-sys\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878774    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-etc-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878795    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-ovn\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878811    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878826    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bc11b44-703f-413b-9c64-3f8b0511acd4-tmp\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878848    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-kubelet\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878876    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-systemd\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878905    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878911    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-cni-bin\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878931    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-cni-netd\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879107 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878949    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovnkube-config\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878952    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaec868b-5f92-44ed-87c7-6bed19576466-host-slash\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878965    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-env-overrides\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878986    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879009    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-lib-modules\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879030    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-conf-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879066    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-daemon-config\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879089    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-etc-kubernetes\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879118    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3e3dff-1419-40e4-be56-bf9a303ed82d-tmp-dir\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879144    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysctl-d\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879170    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-run-netns\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879187    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-node-log\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879205    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879224    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-registration-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879240    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaec868b-5f92-44ed-87c7-6bed19576466-iptables-alerter-script\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879240    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47w4q\" (UniqueName: \"kubernetes.io/projected/86efae03-01dc-40d6-8b04-cd1be39382c8-kube-api-access-47w4q\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879272    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.879940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879304    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zdp8\" (UniqueName: \"kubernetes.io/projected/571814cc-9b65-4d71-b868-8cc002abb5bc-kube-api-access-2zdp8\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879347    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e483962-770d-4578-b4b2-e770dff93296-host\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879352    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-cni-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879376    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879397    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879418    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysconfig\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879444    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysctl-conf\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879462    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-k8s-cni-cncf-io\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879481    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-modprobe-d\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879483    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-var-lib-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879517    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-var-lib-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879530    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ca8bec1-41d5-4b8e-8076-a1457603064a-agent-certs\") pod \"konnectivity-agent-hqdcj\" (UID: \"5ca8bec1-41d5-4b8e-8076-a1457603064a\") " pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879554    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovnkube-script-lib\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879564    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4st\" (UniqueName: \"kubernetes.io/projected/8a3e3dff-1419-40e4-be56-bf9a303ed82d-kube-api-access-4v4st\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879605    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-system-cni-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879697    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-cni-multus\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879723    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-system-cni-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.880717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879749    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-log-socket\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879784    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-kubelet\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879819    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-run-netns\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879831    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-systemd\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.878875    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-netns\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879867    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-node-log\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879874    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879907    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-hostroot\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.879921    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-cni-netd\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880018    2545 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880026    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysconfig\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880176    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysctl-conf\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880223    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-k8s-cni-cncf-io\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880263    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-run-ovn\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880300    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-cni-bin\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880333    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eada764a-cb73-4632-940a-c6741d20b9e9-dbus\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880361    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-cnibin\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880389    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-systemd-units\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.881389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880413    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-cni-binary-copy\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880414    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovnkube-config\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880450    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-device-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880469    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-etc-kubernetes\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880482    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-system-cni-dir\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880484    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880502    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880525    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880547    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-systemd-units\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880560    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-conf-dir\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880562    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-host\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880613    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-socket-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880688    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-sysctl-d\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880851    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-lib-modules\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880888    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880925    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a3e3dff-1419-40e4-be56-bf9a303ed82d-hosts-file\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880958    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzs94\" (UniqueName: \"kubernetes.io/projected/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-kube-api-access-wzs94\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.882292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880964    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-cni-bin\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.880987    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ca8bec1-41d5-4b8e-8076-a1457603064a-konnectivity-ca\") pod \"konnectivity-agent-hqdcj\" (UID: \"5ca8bec1-41d5-4b8e-8076-a1457603064a\") " pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881012    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-etc-openvswitch\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881054    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cnibin\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881110    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-kubernetes\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881147    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-multus-daemon-config\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881144    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa54c1d5-9836-41a6-a55a-089833e7eaea-env-overrides\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881179    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovn-node-metrics-cert\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881256    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtpf\" (UniqueName: \"kubernetes.io/projected/5e483962-770d-4578-b4b2-e770dff93296-kube-api-access-jwtpf\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881310    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881357    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-cnibin\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881376    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-host\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881404    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-systemd\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-kubelet\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881438    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-kubernetes\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881466    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-multus-certs\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881513    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-run-multus-certs\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.883180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881523    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-systemd\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.884064 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881550    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-host-var-lib-kubelet\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.884064 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881566    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cptxz\" (UniqueName: \"kubernetes.io/projected/aaec868b-5f92-44ed-87c7-6bed19576466-kube-api-access-cptxz\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.884064 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881702    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-slash\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.884064 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.881877    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa54c1d5-9836-41a6-a55a-089833e7eaea-host-slash\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.884064 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.883033    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ca8bec1-41d5-4b8e-8076-a1457603064a-konnectivity-ca\") pod \"konnectivity-agent-hqdcj\" (UID: \"5ca8bec1-41d5-4b8e-8076-a1457603064a\") " pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.884578 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.884505    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bc11b44-703f-413b-9c64-3f8b0511acd4-etc-tuned\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.884678 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.884601    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa54c1d5-9836-41a6-a55a-089833e7eaea-ovn-node-metrics-cert\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.884945 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.884908    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bc11b44-703f-413b-9c64-3f8b0511acd4-tmp\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.886292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.886255    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ca8bec1-41d5-4b8e-8076-a1457603064a-agent-certs\") pod \"konnectivity-agent-hqdcj\" (UID: \"5ca8bec1-41d5-4b8e-8076-a1457603064a\") " pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:30.907446 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.907411    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-477d8\" (UniqueName: \"kubernetes.io/projected/8bc11b44-703f-413b-9c64-3f8b0511acd4-kube-api-access-477d8\") pod \"tuned-jdn7z\" (UID: \"8bc11b44-703f-413b-9c64-3f8b0511acd4\") " pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:30.913045 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.913010    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzs94\" (UniqueName: \"kubernetes.io/projected/9e1fb9c2-8665-4a8f-83ea-4073aa6f813e-kube-api-access-wzs94\") pod \"multus-rmcfm\" (UID: \"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e\") " pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:30.914098 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.914069    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptxz\" (UniqueName: \"kubernetes.io/projected/aaec868b-5f92-44ed-87c7-6bed19576466-kube-api-access-cptxz\") pod \"iptables-alerter-pfpn5\" (UID: \"aaec868b-5f92-44ed-87c7-6bed19576466\") " pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:30.918465 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.918433    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95n92\" (UniqueName: \"kubernetes.io/projected/fa54c1d5-9836-41a6-a55a-089833e7eaea-kube-api-access-95n92\") pod \"ovnkube-node-5mjkw\" (UID: \"fa54c1d5-9836-41a6-a55a-089833e7eaea\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:30.982368 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982261    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.982368 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982312    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-sys-fs\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.982368 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982339    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e483962-770d-4578-b4b2-e770dff93296-serviceca\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982382    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eada764a-cb73-4632-940a-c6741d20b9e9-kubelet-config\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982415    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982415    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzvxn\" (UniqueName: \"kubernetes.io/projected/18f90270-7f3d-4ee5-b293-14a694dcb4ea-kube-api-access-qzvxn\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982443    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-sys-fs\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982499    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982530    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3e3dff-1419-40e4-be56-bf9a303ed82d-tmp-dir\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982574    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982600    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-registration-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.982643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982630    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47w4q\" (UniqueName: \"kubernetes.io/projected/86efae03-01dc-40d6-8b04-cd1be39382c8-kube-api-access-47w4q\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982654    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982678    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zdp8\" (UniqueName: \"kubernetes.io/projected/571814cc-9b65-4d71-b868-8cc002abb5bc-kube-api-access-2zdp8\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982701    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e483962-770d-4578-b4b2-e770dff93296-host\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982723    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982746    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982777    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4st\" (UniqueName: \"kubernetes.io/projected/8a3e3dff-1419-40e4-be56-bf9a303ed82d-kube-api-access-4v4st\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982802    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eada764a-cb73-4632-940a-c6741d20b9e9-kubelet-config\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982827    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eada764a-cb73-4632-940a-c6741d20b9e9-dbus\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982853    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-device-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982876    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-system-cni-dir\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982904    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982935    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-socket-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982960    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.982988    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a3e3dff-1419-40e4-be56-bf9a303ed82d-hosts-file\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983014    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983034    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e483962-770d-4578-b4b2-e770dff93296-serviceca\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.983100 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983071    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cnibin\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983121    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-registration-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983122    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3e3dff-1419-40e4-be56-bf9a303ed82d-tmp-dir\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.983146    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983017    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cnibin\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983189    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwtpf\" (UniqueName: \"kubernetes.io/projected/5e483962-770d-4578-b4b2-e770dff93296-kube-api-access-jwtpf\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.983240    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:31.483192646 +0000 UTC m=+3.123747440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983273    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983273    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e483962-770d-4578-b4b2-e770dff93296-host\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983483    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a3e3dff-1419-40e4-be56-bf9a303ed82d-hosts-file\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983561    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eada764a-cb73-4632-940a-c6741d20b9e9-dbus\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983690    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-socket-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983724    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86efae03-01dc-40d6-8b04-cd1be39382c8-device-dir\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.983768    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:30.983810    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:31.483796404 +0000 UTC m=+3.124351178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983951    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.983992 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.983991    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18f90270-7f3d-4ee5-b293-14a694dcb4ea-system-cni-dir\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.984652 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.984041    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.984652 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.984096    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:30.984652 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:30.984116    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18f90270-7f3d-4ee5-b293-14a694dcb4ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:31.000717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.000691    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzvxn\" (UniqueName: \"kubernetes.io/projected/18f90270-7f3d-4ee5-b293-14a694dcb4ea-kube-api-access-qzvxn\") pod \"multus-additional-cni-plugins-hwrq4\" (UID: \"18f90270-7f3d-4ee5-b293-14a694dcb4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:31.007211 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.007188    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:31.007211 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.007215    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:31.007408 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.007229    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:31.007408 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.007373    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:31.50734642 +0000 UTC m=+3.147901214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:31.010169 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.010144    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4st\" (UniqueName: \"kubernetes.io/projected/8a3e3dff-1419-40e4-be56-bf9a303ed82d-kube-api-access-4v4st\") pod \"node-resolver-4j6sg\" (UID: \"8a3e3dff-1419-40e4-be56-bf9a303ed82d\") " pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:31.010998 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.010976    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwtpf\" (UniqueName: \"kubernetes.io/projected/5e483962-770d-4578-b4b2-e770dff93296-kube-api-access-jwtpf\") pod \"node-ca-ctfcw\" (UID: \"5e483962-770d-4578-b4b2-e770dff93296\") " pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:31.011220 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.011198    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zdp8\" (UniqueName: \"kubernetes.io/projected/571814cc-9b65-4d71-b868-8cc002abb5bc-kube-api-access-2zdp8\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:31.012386 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.012363    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47w4q\" (UniqueName: \"kubernetes.io/projected/86efae03-01dc-40d6-8b04-cd1be39382c8-kube-api-access-47w4q\") pod \"aws-ebs-csi-driver-node-df9pb\" (UID: \"86efae03-01dc-40d6-8b04-cd1be39382c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:31.068545 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.068486    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jdn7z"
Sep 07 16:56:31.080095 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.080069    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmcfm"
Sep 07 16:56:31.095288 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.095255    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfpn5"
Sep 07 16:56:31.102371 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.102341    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:31.111084 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.111057    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:31.118773 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.118735    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb"
Sep 07 16:56:31.127629 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.127594    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ctfcw"
Sep 07 16:56:31.134723 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.134701    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hwrq4"
Sep 07 16:56:31.142876 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.142852    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4j6sg"
Sep 07 16:56:31.487264 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.487226    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:31.487264 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.487269    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:31.487468 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.487400    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:31.487468 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.487405    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:31.487468 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.487457    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:32.487442104 +0000 UTC m=+4.127996878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:31.487575 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.487483    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:32.487466621 +0000 UTC m=+4.128021402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:31.587624 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.587579    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:31.587831 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.587722    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:31.587831 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.587747    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:31.587831 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.587760    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:31.587831 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:31.587821    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:32.58780127 +0000 UTC m=+4.228356065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:31.875835 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.875799    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:51:31 +0000 UTC" deadline="2028-02-11 23:01:31.006955844 +0000 UTC"
Sep 07 16:56:31.875835 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.875833    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12534h4m59.131126148s"
Sep 07 16:56:31.882648 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:31.882608    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca8bec1_41d5_4b8e_8076_a1457603064a.slice/crio-aa8c50fb1cae1a348f233eaaf49b8d2aafa933da46e418cb4ab3a7f0b377de72 WatchSource:0}: Error finding container aa8c50fb1cae1a348f233eaaf49b8d2aafa933da46e418cb4ab3a7f0b377de72: Status 404 returned error can't find the container with id aa8c50fb1cae1a348f233eaaf49b8d2aafa933da46e418cb4ab3a7f0b377de72
Sep 07 16:56:31.886286 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:31.886237    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaec868b_5f92_44ed_87c7_6bed19576466.slice/crio-d2a628077b9f412264f5d749ba0c1d8a9786163003c9bffb971c51af5054200c WatchSource:0}: Error finding container d2a628077b9f412264f5d749ba0c1d8a9786163003c9bffb971c51af5054200c: Status 404 returned error can't find the container with id d2a628077b9f412264f5d749ba0c1d8a9786163003c9bffb971c51af5054200c
Sep 07 16:56:31.889852 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:31.889824    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e483962_770d_4578_b4b2_e770dff93296.slice/crio-1ec10ee4c4a2bc740ef38f082b55bc8fec348066e86332a063dd6ecb953db11f WatchSource:0}: Error finding container 1ec10ee4c4a2bc740ef38f082b55bc8fec348066e86332a063dd6ecb953db11f: Status 404 returned error can't find the container with id 1ec10ee4c4a2bc740ef38f082b55bc8fec348066e86332a063dd6ecb953db11f
Sep 07 16:56:31.890094 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:31.890071    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86efae03_01dc_40d6_8b04_cd1be39382c8.slice/crio-8a2dbe1bcfb7b253f15574797de143ae1ac809f7a56f1cb79ed5e8b97a153b22 WatchSource:0}: Error finding container 8a2dbe1bcfb7b253f15574797de143ae1ac809f7a56f1cb79ed5e8b97a153b22: Status 404 returned error can't find the container with id 8a2dbe1bcfb7b253f15574797de143ae1ac809f7a56f1cb79ed5e8b97a153b22
Sep 07 16:56:31.891345 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:31.891169    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f90270_7f3d_4ee5_b293_14a694dcb4ea.slice/crio-91fa61410966851c2858a3457e572f827c7785f177c7b82744ce383ad7d360b0 WatchSource:0}: Error finding container 91fa61410966851c2858a3457e572f827c7785f177c7b82744ce383ad7d360b0: Status 404 returned error can't find the container with id 91fa61410966851c2858a3457e572f827c7785f177c7b82744ce383ad7d360b0
Sep 07 16:56:31.892375 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:56:31.892344    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1fb9c2_8665_4a8f_83ea_4073aa6f813e.slice/crio-41bc973effeac7a84698a570f158d7bad8fbb576efd928d920675e5bad36d2ee WatchSource:0}: Error finding container 41bc973effeac7a84698a570f158d7bad8fbb576efd928d920675e5bad36d2ee: Status 404 returned error can't find the container with id 41bc973effeac7a84698a570f158d7bad8fbb576efd928d920675e5bad36d2ee
Sep 07 16:56:31.894447 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.894327    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfpn5" event={"ID":"aaec868b-5f92-44ed-87c7-6bed19576466","Type":"ContainerStarted","Data":"d2a628077b9f412264f5d749ba0c1d8a9786163003c9bffb971c51af5054200c"}
Sep 07 16:56:31.898191 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:31.897934    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hqdcj" event={"ID":"5ca8bec1-41d5-4b8e-8076-a1457603064a","Type":"ContainerStarted","Data":"aa8c50fb1cae1a348f233eaaf49b8d2aafa933da46e418cb4ab3a7f0b377de72"}
Sep 07 16:56:32.496281 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.495406    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:32.496281 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.495465    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:32.496281 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.495640    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:32.496281 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.495712    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:34.495691655 +0000 UTC m=+6.136246457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:32.496281 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.496146    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:32.496281 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.496196    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:34.4961802 +0000 UTC m=+6.136734982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:32.597436 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.596721    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:32.597436 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.596938    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:32.597436 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.596960    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:32.597436 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.596972    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:32.597436 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.597037    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:34.597018095 +0000 UTC m=+6.237572886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:32.876572 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.876448    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:51:31 +0000 UTC" deadline="2028-04-05 19:00:20.068117458 +0000 UTC"
Sep 07 16:56:32.876572 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.876519    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13826h3m47.191603382s"
Sep 07 16:56:32.883639 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.883081    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:32.883639 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.883081    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:32.883639 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.883215    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:32.883639 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.883230    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:32.883639 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.883314    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:32.883639 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:32.883404    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:32.920726 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.920678    2545 generic.go:356] "Generic (PLEG): container finished" podID="e20bfcd8fa7c3756f9a221829a74dd57" containerID="71025fcacfc719d8dd6adc9b996bcb00044c8b9a84346d5389683e1ffb57a3ef" exitCode=0
Sep 07 16:56:32.920917 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.920781    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" event={"ID":"e20bfcd8fa7c3756f9a221829a74dd57","Type":"ContainerDied","Data":"71025fcacfc719d8dd6adc9b996bcb00044c8b9a84346d5389683e1ffb57a3ef"}
Sep 07 16:56:32.932515 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.932477    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jdn7z" event={"ID":"8bc11b44-703f-413b-9c64-3f8b0511acd4","Type":"ContainerStarted","Data":"7c76a3ace4858ec5d80ae6a9db39e4f62b63125cbe291a88f3952b0e9a11df43"}
Sep 07 16:56:32.937033 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.936900    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"ab4ed1204045945c56d58a22634a6ae5e99a9e9318355c491f3a87f9307dc9a3"}
Sep 07 16:56:32.948574 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.948482    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmcfm" event={"ID":"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e","Type":"ContainerStarted","Data":"41bc973effeac7a84698a570f158d7bad8fbb576efd928d920675e5bad36d2ee"}
Sep 07 16:56:32.954910 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.954834    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ctfcw" event={"ID":"5e483962-770d-4578-b4b2-e770dff93296","Type":"ContainerStarted","Data":"1ec10ee4c4a2bc740ef38f082b55bc8fec348066e86332a063dd6ecb953db11f"}
Sep 07 16:56:32.957152 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.956769    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" event={"ID":"07df7873c55aad720a5c1b311be3ff60","Type":"ContainerStarted","Data":"60a99463bc3478ddd37397ad8672843d8cb41e9aa463e7a30a15485cedf8d5a5"}
Sep 07 16:56:32.966475 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.966078    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4j6sg" event={"ID":"8a3e3dff-1419-40e4-be56-bf9a303ed82d","Type":"ContainerStarted","Data":"ef9f9d1aa41cc55b36a3ff598df3d2bb435cb44a0ee56b17e7e8670a8b9cf529"}
Sep 07 16:56:32.977596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.977560    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerStarted","Data":"91fa61410966851c2858a3457e572f827c7785f177c7b82744ce383ad7d360b0"}
Sep 07 16:56:32.984397 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:32.984316    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb" event={"ID":"86efae03-01dc-40d6-8b04-cd1be39382c8","Type":"ContainerStarted","Data":"8a2dbe1bcfb7b253f15574797de143ae1ac809f7a56f1cb79ed5e8b97a153b22"}
Sep 07 16:56:34.003858 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.003763    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" event={"ID":"e20bfcd8fa7c3756f9a221829a74dd57","Type":"ContainerStarted","Data":"ae731aff11a8802ef9f8cef8240f1279051b84e7a346cd34a99e8ee3a68c7f2e"}
Sep 07 16:56:34.036389 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.036319    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" podStartSLOduration=4.036290724 podStartE2EDuration="4.036290724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:32.992711852 +0000 UTC m=+4.633266652" watchObservedRunningTime="2026-09-07 16:56:34.036290724 +0000 UTC m=+5.676845525"
Sep 07 16:56:34.514255 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.513453    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:34.514255 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.513507    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:34.514255 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.513671    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:34.514255 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.513740    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:38.513720617 +0000 UTC m=+10.154275408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:34.514255 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.514162    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:34.514255 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.514215    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:38.514199251 +0000 UTC m=+10.154754043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:34.614884 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.614846    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:34.615076 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.615049    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:34.615145 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.615081    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:34.615145 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.615097    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:34.615249 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.615162    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:38.615142577 +0000 UTC m=+10.255697367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:34.883840 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.883756    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:34.883840 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.883788    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:34.884072 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.883904    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:34.884072 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.884040    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:34.884181 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:34.884096    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:34.884227 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:34.884174    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:36.883533 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:36.883130    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:36.883533 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:36.883258    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:36.883533 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:36.883390    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:36.883533 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:36.883476    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:36.884222 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:36.883715    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:36.884222 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:36.883830    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:38.548474 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:38.548434    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:38.548474 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:38.548488    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:38.549004 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.548671    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:38.549004 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.548732    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:56:46.548714508 +0000 UTC m=+18.189269287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:38.549211 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.549125    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:38.549211 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.549180    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:46.549166729 +0000 UTC m=+18.189721509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:38.649291 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:38.649249    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:38.649483 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.649451    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:38.649483 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.649484    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:38.649619 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.649498    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:38.649619 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.649577    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:46.649559291 +0000 UTC m=+18.290114080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:38.886251 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:38.885589    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:38.886251 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.885699    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:38.886251 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:38.886005    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:38.886251 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.886069    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:38.886251 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:38.886105    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:38.886251 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:38.886164    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:40.883299 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:40.883254    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:40.883781 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:40.883255    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:40.883781 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:40.883400    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:40.883781 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:40.883444    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:40.883781 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:40.883586    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:40.883781 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:40.883706    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:42.882681 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:42.882648    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:42.883066 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:42.882745    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:42.883066 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:42.882766    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:42.883066 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:42.882748    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:42.883066 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:42.882848    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:42.883066 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:42.882911    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:44.882619 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:44.882550    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:44.882619 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:44.882594    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:44.883129 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:44.882682    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:44.883129 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:44.882550    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:44.883129 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:44.882780    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:44.883129 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:44.882844    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:46.610740 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:46.610650    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:46.610740 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:46.610701    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:46.611207 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.610804    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:46.611207 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.610819    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:46.611207 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.610865    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:02.610851416 +0000 UTC m=+34.251406208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:46.611207 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.610880    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:02.610874829 +0000 UTC m=+34.251429603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:46.711837 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:46.711795    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:46.711997 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.711968    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:46.711997 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.711991    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:46.712115 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.712000    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:46.712115 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.712047    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:02.712033711 +0000 UTC m=+34.352588485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:46.883193 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:46.883121    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:46.883193 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:46.883137    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:46.883374 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.883228    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:46.883374 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:46.883281    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:46.883467 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.883396    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:46.883514 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:46.883476    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:48.884093 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:48.884054    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:48.884584 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:48.884161    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:48.884584 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:48.884169    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:48.884584 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:48.884195    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:48.884584 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:48.884271    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:48.884584 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:48.884353    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:50.882666 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:50.882486    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:50.883321 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:50.882529    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:50.883321 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:50.882735    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:50.883321 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:50.882811    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:50.883321 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:50.882599    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:50.883321 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:50.882885    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:51.039461 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.039376    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4j6sg" event={"ID":"8a3e3dff-1419-40e4-be56-bf9a303ed82d","Type":"ContainerStarted","Data":"5ee3ba44f6bc9c7e0454795df71376d87036b0c9bf407b08ee073717e2e1ec58"}
Sep 07 16:56:51.041508 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.041475    2545 generic.go:356] "Generic (PLEG): container finished" podID="18f90270-7f3d-4ee5-b293-14a694dcb4ea" containerID="29c9f419196a6997110dc19545ddfec0c00e2a5d93a2083b36da5705eb68571b" exitCode=0
Sep 07 16:56:51.041658 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.041514    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerDied","Data":"29c9f419196a6997110dc19545ddfec0c00e2a5d93a2083b36da5705eb68571b"}
Sep 07 16:56:51.043290 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.043251    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb" event={"ID":"86efae03-01dc-40d6-8b04-cd1be39382c8","Type":"ContainerStarted","Data":"a19a22efd5ddd3aa908d6b18f35c12f197db7febe9017ed9bc202425e808af68"}
Sep 07 16:56:51.044973 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.044948    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hqdcj" event={"ID":"5ca8bec1-41d5-4b8e-8076-a1457603064a","Type":"ContainerStarted","Data":"6766a28052c04b82b6f1dc89dab764efb851c8d3133576593385c5769b72d2ff"}
Sep 07 16:56:51.046575 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.046552    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jdn7z" event={"ID":"8bc11b44-703f-413b-9c64-3f8b0511acd4","Type":"ContainerStarted","Data":"6ae5c9c9ba4b24515fb9b505f1abb53965ef5d70a1c4e92e56cdf6acfea54d59"}
Sep 07 16:56:51.050126 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.050099    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"cfe5f5936bef40320557643117edaca5c124c48f475849744c13d980c6ac637e"}
Sep 07 16:56:51.050225 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.050162    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"d17b40e661192cf7dcef984c98e69ccde32af2b7efe4c321396171551c9eb5f5"}
Sep 07 16:56:51.050225 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.050212    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"47f998f58d1088cb35d0311745b9176500ec3c3d7276028c63fc48026dee57a8"}
Sep 07 16:56:51.050339 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.050262    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"a953a9dd81869eae9fd16b051dfddea20765fa439b6bdeadb39f01582542e97c"}
Sep 07 16:56:51.050339 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.050301    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"de8c92d14953a79bff1b8ed28d2cd272c323310f7ddcdc349609b15857f35013"}
Sep 07 16:56:51.050415 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.050341    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"b84fa3849c793d4578d22c8f083ba5c8cd7ba1df9d5b042838d8fc300feeb5cb"}
Sep 07 16:56:51.051808 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.051784    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmcfm" event={"ID":"9e1fb9c2-8665-4a8f-83ea-4073aa6f813e","Type":"ContainerStarted","Data":"282ec27dbb597904246f6bf7a12d3e91ca0244232e6afbe966141cc1b5b2c35b"}
Sep 07 16:56:51.053403 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.053381    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ctfcw" event={"ID":"5e483962-770d-4578-b4b2-e770dff93296","Type":"ContainerStarted","Data":"1f93be9f0f05637a787b2ee257cc91523a1eafb8c5dcc0eb44fd1f48197023f8"}
Sep 07 16:56:51.074596 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.074530    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" podStartSLOduration=21.074516664 podStartE2EDuration="21.074516664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:34.03697897 +0000 UTC m=+5.677533770" watchObservedRunningTime="2026-09-07 16:56:51.074516664 +0000 UTC m=+22.715071460"
Sep 07 16:56:51.074832 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.074813    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4j6sg" podStartSLOduration=3.843481371 podStartE2EDuration="22.074807601s" totalImagesPullingTime="18.23132623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.074335829 +0000 UTC m=+22.714890624" watchObservedRunningTime="2026-09-07 16:56:51.074807601 +0000 UTC m=+22.715362397"
Sep 07 16:56:51.116836 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.116788    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jdn7z" podStartSLOduration=3.862353696 podStartE2EDuration="22.116773161s" totalImagesPullingTime="18.254419465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.116299689 +0000 UTC m=+22.756854485" watchObservedRunningTime="2026-09-07 16:56:51.116773161 +0000 UTC m=+22.757327981"
Sep 07 16:56:51.156213 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.156151    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmcfm" podStartSLOduration=3.85884959 podStartE2EDuration="22.156129621s" totalImagesPullingTime="18.297280031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.155595483 +0000 UTC m=+22.796150298" watchObservedRunningTime="2026-09-07 16:56:51.156129621 +0000 UTC m=+22.796684420"
Sep 07 16:56:51.246929 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.246871    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ctfcw" podStartSLOduration=4.004276145 podStartE2EDuration="22.246850422s" totalImagesPullingTime="18.242574277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.211343714 +0000 UTC m=+22.851898524" watchObservedRunningTime="2026-09-07 16:56:51.246850422 +0000 UTC m=+22.887405220"
Sep 07 16:56:51.280975 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.280921    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hqdcj" podStartSLOduration=7.855123471 podStartE2EDuration="22.280904097s" totalImagesPullingTime="14.425780626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.280784161 +0000 UTC m=+22.921338953" watchObservedRunningTime="2026-09-07 16:56:51.280904097 +0000 UTC m=+22.921458916"
Sep 07 16:56:51.719971 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.719933    2545 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 16:56:51.832303 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.832145    2545 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T16:56:51.719957196Z","UUID":"78f26d14-9b7c-47ac-8cd9-1bc9f44f1585","Handler":null,"Name":"","Endpoint":""}
Sep 07 16:56:51.833926 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.833899    2545 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 16:56:51.834046 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:51.833939    2545 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 16:56:52.057455 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.057356    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfpn5" event={"ID":"aaec868b-5f92-44ed-87c7-6bed19576466","Type":"ContainerStarted","Data":"a715aa6fc5f03845c908315b7f247faf35b51c7f0e230db46229298f8804b536"}
Sep 07 16:56:52.059244 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.059206    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb" event={"ID":"86efae03-01dc-40d6-8b04-cd1be39382c8","Type":"ContainerStarted","Data":"c8f7ae4456ee9913826c39fe8c82130a749cc5f76cfc6897691f35bb6883bbe4"}
Sep 07 16:56:52.075758 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.075722    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:52.076454 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.076431    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:52.081479 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.081437    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pfpn5" podStartSLOduration=4.833656372 podStartE2EDuration="23.081419392s" totalImagesPullingTime="18.24776302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:52.079968108 +0000 UTC m=+23.720522923" watchObservedRunningTime="2026-09-07 16:56:52.081419392 +0000 UTC m=+23.721974188"
Sep 07 16:56:52.882329 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.882260    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:52.882459 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.882260    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:52.882459 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:52.882363    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:52.882459 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:52.882392    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:52.882648 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:52.882486    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:52.882648 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:52.882608    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:53.065143 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:53.065104    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"9ceb6d9e848c3ab3177a6776ebd340c437e033635241355b723728ada3418b4a"}
Sep 07 16:56:53.067510 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:53.067475    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb" event={"ID":"86efae03-01dc-40d6-8b04-cd1be39382c8","Type":"ContainerStarted","Data":"ca57a080c847bb87cd0cb57f205d467dcc9a1f45cb144e9cf8531343ddc66b0a"}
Sep 07 16:56:54.070663 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:54.070378    2545 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 16:56:54.882814 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:54.882779    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:54.883022 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:54.882780    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:54.883022 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:54.882904    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:54.883022 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:54.883005    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:54.883191 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:54.882789    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:54.883191 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:54.883156    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:56.882645 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:56.882434    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:56.883128 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:56.882434    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:56.883128 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:56.882722    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:56.883128 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:56.882445    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:56.883128 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:56.882774    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:56.883128 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:56.882854    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:57.080756 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.080714    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" event={"ID":"fa54c1d5-9836-41a6-a55a-089833e7eaea","Type":"ContainerStarted","Data":"c0595eda0672427a8a2d1b10e713738ba85921f10016cfb5d5cbf72a88cbccf6"}
Sep 07 16:56:57.081068 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.081038    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:57.083895 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.083869    2545 generic.go:356] "Generic (PLEG): container finished" podID="18f90270-7f3d-4ee5-b293-14a694dcb4ea" containerID="b95a6694bc18d224840ca69a5a6a1cb22d1ce3b9e3e75f87fea556a4af57b162" exitCode=0
Sep 07 16:56:57.083997 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.083913    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerDied","Data":"b95a6694bc18d224840ca69a5a6a1cb22d1ce3b9e3e75f87fea556a4af57b162"}
Sep 07 16:56:57.096643 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.096617    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:57.113492 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.113447    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw" podStartSLOduration=9.813313643 podStartE2EDuration="28.1134331s" totalImagesPullingTime="18.300119457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:57.113123129 +0000 UTC m=+28.753677925" watchObservedRunningTime="2026-09-07 16:56:57.1134331 +0000 UTC m=+28.753987931"
Sep 07 16:56:57.113648 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.113628    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9pb" podStartSLOduration=7.75223711 podStartE2EDuration="28.113620679s" totalImagesPullingTime="20.361383569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:53.087744665 +0000 UTC m=+24.728299472" watchObservedRunningTime="2026-09-07 16:56:57.113620679 +0000 UTC m=+28.754175488"
Sep 07 16:56:57.648674 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.648594    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:56:57.769384 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:57.769350    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:56:58.088139 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.088104    2545 generic.go:356] "Generic (PLEG): container finished" podID="18f90270-7f3d-4ee5-b293-14a694dcb4ea" containerID="aa252e795de32ed061ae1c52b70cf92c99fe99f0a29420e46ded8a456bdbd3df" exitCode=0
Sep 07 16:56:58.088843 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.088184    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerDied","Data":"aa252e795de32ed061ae1c52b70cf92c99fe99f0a29420e46ded8a456bdbd3df"}
Sep 07 16:56:58.088843 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.088662    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:58.088843 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.088730    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:58.104873 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.104852    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:56:58.185511 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.185481    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nffqs"]
Sep 07 16:56:58.185648 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.185594    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:58.185699 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:58.185675    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:58.191881 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.191823    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-482vq"]
Sep 07 16:56:58.191969 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.191928    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:58.192039 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:58.192019    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:56:58.210994 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.210966    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bzd4s"]
Sep 07 16:56:58.211101 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:58.211047    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:58.211140 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:58.211116    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:59.092936 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.092905    2545 generic.go:356] "Generic (PLEG): container finished" podID="18f90270-7f3d-4ee5-b293-14a694dcb4ea" containerID="e5b49116160c884a0a67deb559ca06a43639af4222ea35f023887a013d59d3b5" exitCode=0
Sep 07 16:56:59.093356 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.092967    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerDied","Data":"e5b49116160c884a0a67deb559ca06a43639af4222ea35f023887a013d59d3b5"}
Sep 07 16:56:59.397948 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.397914    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:59.398146 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.398042    2545 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 16:56:59.398460 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.398443    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hqdcj"
Sep 07 16:56:59.471733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.471701    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:56:59.882974 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.882930    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:56:59.883092 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.882942    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:56:59.883092 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:59.883074    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:56:59.883429 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:56:59.882946    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:56:59.883429 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:59.883295    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:56:59.883429 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:56:59.883390    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:57:01.882715 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:01.882684    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:01.882715 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:01.882716    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:01.883176 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:01.882687    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:01.883176 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:01.882793    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:57:01.883176 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:01.883083    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:57:01.884134 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:01.883720    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:57:02.498109 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:02.498072    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:02.567148 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:02.567109    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:02.628908 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:02.628865    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:02.628908 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:02.628908    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:02.629108 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.629034    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:57:02.629108 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.629091    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs podName:571814cc-9b65-4d71-b868-8cc002abb5bc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:34.629077501 +0000 UTC m=+66.269632276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs") pod "network-metrics-daemon-bzd4s" (UID: "571814cc-9b65-4d71-b868-8cc002abb5bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:57:02.629221 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.629037    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:57:02.629221 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.629202    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret podName:eada764a-cb73-4632-940a-c6741d20b9e9 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:34.629179503 +0000 UTC m=+66.269734279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret") pod "global-pull-secret-syncer-nffqs" (UID: "eada764a-cb73-4632-940a-c6741d20b9e9") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:57:02.729256 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:02.729212    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:02.729448 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.729416    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:57:02.729448 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.729432    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:57:02.729448 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.729445    2545 projected.go:196] Error preparing data for projected volume kube-api-access-5vfww for pod openshift-network-diagnostics/network-check-target-482vq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:57:02.729655 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:02.729500    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww podName:79a4e303-057c-4908-9550-903fadd66770 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:34.7294823 +0000 UTC m=+66.370037073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vfww" (UniqueName: "kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww") pod "network-check-target-482vq" (UID: "79a4e303-057c-4908-9550-903fadd66770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:57:03.883051 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:03.883012    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:03.883051 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:03.883049    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:03.883578 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:03.883018    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:03.883578 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:03.883140    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nffqs" podUID="eada764a-cb73-4632-940a-c6741d20b9e9"
Sep 07 16:57:03.883578 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:03.883202    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzd4s" podUID="571814cc-9b65-4d71-b868-8cc002abb5bc"
Sep 07 16:57:03.883578 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:03.883303    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-482vq" podUID="79a4e303-057c-4908-9550-903fadd66770"
Sep 07 16:57:04.106500 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.106418    2545 generic.go:356] "Generic (PLEG): container finished" podID="18f90270-7f3d-4ee5-b293-14a694dcb4ea" containerID="b9bfdbc2df31ba49c31c36afa2e05de24a4c430119a3c95ddf976e15b8dff5b8" exitCode=0
Sep 07 16:57:04.106500 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.106463    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerDied","Data":"b9bfdbc2df31ba49c31c36afa2e05de24a4c430119a3c95ddf976e15b8dff5b8"}
Sep 07 16:57:04.192421 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.192399    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeReady"
Sep 07 16:57:04.192584 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.192571    2545 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 16:57:04.270398 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.270357    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvgw9"]
Sep 07 16:57:04.293637 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.293607    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hxb6x"]
Sep 07 16:57:04.293773 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.293742    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.297974 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.297941    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 16:57:04.298099 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.298047    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\""
Sep 07 16:57:04.298158 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.297949    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 16:57:04.307724 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.307703    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-689df9dc99-khnxm"]
Sep 07 16:57:04.307837 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.307820    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.310972 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.310944    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\""
Sep 07 16:57:04.313870 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.313851    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 16:57:04.313870 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.313865    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 16:57:04.314007 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.313865    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 16:57:04.317826 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.317737    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvgw9"]
Sep 07 16:57:04.317826 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.317826    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hxb6x"]
Sep 07 16:57:04.317952 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.317837    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.318889 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.318870    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689df9dc99-khnxm"]
Sep 07 16:57:04.322712 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.322694    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 16:57:04.323002 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.322988    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 16:57:04.323057 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.322991    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 16:57:04.323616 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.323596    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g564b\""
Sep 07 16:57:04.329728 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.329710    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 16:57:04.440969 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.440873    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.440969 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.440919    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-certificates\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.440969 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.440938    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-trusted-ca\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.440981    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ae057be-ab5b-4946-9d28-13a52462ef3a-config-volume\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441026    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ae057be-ab5b-4946-9d28-13a52462ef3a-tmp-dir\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441050    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbsll\" (UniqueName: \"kubernetes.io/projected/5f67366e-3648-417f-9eac-c78536eea527-kube-api-access-lbsll\") pod \"ingress-canary-hxb6x\" (UID: \"5f67366e-3648-417f-9eac-c78536eea527\") " pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441074    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-image-registry-private-configuration\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441103    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-bound-sa-token\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441130    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f67366e-3648-417f-9eac-c78536eea527-cert\") pod \"ingress-canary-hxb6x\" (UID: \"5f67366e-3648-417f-9eac-c78536eea527\") " pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441144    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-installation-pull-secrets\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441175    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.441201 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441193    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llnsw\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-kube-api-access-llnsw\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.441492 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441207    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nrbs\" (UniqueName: \"kubernetes.io/projected/2ae057be-ab5b-4946-9d28-13a52462ef3a-kube-api-access-6nrbs\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.441492 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.441223    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f92a1108-d020-49da-94fb-5d85ec513dcc-ca-trust-extracted\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.454053 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.454025    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:04.542286 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542252    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-image-registry-private-configuration\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542289    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-bound-sa-token\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542308    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f67366e-3648-417f-9eac-c78536eea527-cert\") pod \"ingress-canary-hxb6x\" (UID: \"5f67366e-3648-417f-9eac-c78536eea527\") " pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.542402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542325    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-installation-pull-secrets\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542349    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542375    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llnsw\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-kube-api-access-llnsw\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542399    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nrbs\" (UniqueName: \"kubernetes.io/projected/2ae057be-ab5b-4946-9d28-13a52462ef3a-kube-api-access-6nrbs\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542427    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f92a1108-d020-49da-94fb-5d85ec513dcc-ca-trust-extracted\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:04.542455    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:04.542476    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689df9dc99-khnxm: secret "image-registry-tls" not found
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542496    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:04.542561    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls podName:f92a1108-d020-49da-94fb-5d85ec513dcc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.042518401 +0000 UTC m=+36.683073189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls") pod "image-registry-689df9dc99-khnxm" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc") : secret "image-registry-tls" not found
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542586    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-certificates\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542624    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-trusted-ca\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542646    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ae057be-ab5b-4946-9d28-13a52462ef3a-config-volume\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542669    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ae057be-ab5b-4946-9d28-13a52462ef3a-tmp-dir\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:04.542592    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542698    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbsll\" (UniqueName: \"kubernetes.io/projected/5f67366e-3648-417f-9eac-c78536eea527-kube-api-access-lbsll\") pod \"ingress-canary-hxb6x\" (UID: \"5f67366e-3648-417f-9eac-c78536eea527\") " pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.542733 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:04.542723    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls podName:2ae057be-ab5b-4946-9d28-13a52462ef3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.042711925 +0000 UTC m=+36.683266698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls") pod "dns-default-gvgw9" (UID: "2ae057be-ab5b-4946-9d28-13a52462ef3a") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:04.543319 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.542993    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f92a1108-d020-49da-94fb-5d85ec513dcc-ca-trust-extracted\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.543491 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.543468    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ae057be-ab5b-4946-9d28-13a52462ef3a-tmp-dir\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.543735 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.543717    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-certificates\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.543797 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.543751    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ae057be-ab5b-4946-9d28-13a52462ef3a-config-volume\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.544402 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.544369    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-trusted-ca\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.546743 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.546643    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-installation-pull-secrets\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.546818 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.546650    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-image-registry-private-configuration\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.546818 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.546704    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f67366e-3648-417f-9eac-c78536eea527-cert\") pod \"ingress-canary-hxb6x\" (UID: \"5f67366e-3648-417f-9eac-c78536eea527\") " pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.553577 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.553551    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-bound-sa-token\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.553675 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.553557    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llnsw\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-kube-api-access-llnsw\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:04.553842 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.553824    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nrbs\" (UniqueName: \"kubernetes.io/projected/2ae057be-ab5b-4946-9d28-13a52462ef3a-kube-api-access-6nrbs\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:04.554149 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.554133    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbsll\" (UniqueName: \"kubernetes.io/projected/5f67366e-3648-417f-9eac-c78536eea527-kube-api-access-lbsll\") pod \"ingress-canary-hxb6x\" (UID: \"5f67366e-3648-417f-9eac-c78536eea527\") " pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.557490 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.557470    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:04.648312 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.648271    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hxb6x"
Sep 07 16:57:04.975153 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:04.975121    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hxb6x"]
Sep 07 16:57:04.979281 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:04.979254    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f67366e_3648_417f_9eac_c78536eea527.slice/crio-f94738c25f96e6aa0d2c981ae3088b88fd0a14bfcf75a6dd3da1f2e1d9002ce4 WatchSource:0}: Error finding container f94738c25f96e6aa0d2c981ae3088b88fd0a14bfcf75a6dd3da1f2e1d9002ce4: Status 404 returned error can't find the container with id f94738c25f96e6aa0d2c981ae3088b88fd0a14bfcf75a6dd3da1f2e1d9002ce4
Sep 07 16:57:05.045730 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.045644    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:05.045730 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.045705    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:05.045906 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:05.045802    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:05.045906 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:05.045817    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689df9dc99-khnxm: secret "image-registry-tls" not found
Sep 07 16:57:05.045906 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:05.045800    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:05.045906 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:05.045867    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls podName:f92a1108-d020-49da-94fb-5d85ec513dcc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:06.045853943 +0000 UTC m=+37.686408716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls") pod "image-registry-689df9dc99-khnxm" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc") : secret "image-registry-tls" not found
Sep 07 16:57:05.045906 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:05.045879    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls podName:2ae057be-ab5b-4946-9d28-13a52462ef3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:06.045873814 +0000 UTC m=+37.686428587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls") pod "dns-default-gvgw9" (UID: "2ae057be-ab5b-4946-9d28-13a52462ef3a") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:05.109988 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.109946    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hxb6x" event={"ID":"5f67366e-3648-417f-9eac-c78536eea527","Type":"ContainerStarted","Data":"f94738c25f96e6aa0d2c981ae3088b88fd0a14bfcf75a6dd3da1f2e1d9002ce4"}
Sep 07 16:57:05.112946 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.112921    2545 generic.go:356] "Generic (PLEG): container finished" podID="18f90270-7f3d-4ee5-b293-14a694dcb4ea" containerID="1eb87a45605d9442290aaf02eeb05b708a39ddcfccc545d1d5e1d5ee6b680615" exitCode=0
Sep 07 16:57:05.113067 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.112967    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerDied","Data":"1eb87a45605d9442290aaf02eeb05b708a39ddcfccc545d1d5e1d5ee6b680615"}
Sep 07 16:57:05.882982 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.882946    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:05.883162 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.882955    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:05.883162 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.883071    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:05.891176 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.890999    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 16:57:05.892090 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.892070    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 16:57:05.892189 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.892102    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 16:57:05.892189 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.892106    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 16:57:05.892769 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.892738    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 16:57:05.892769 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:05.892753    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 16:57:06.053001 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:06.052969    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:06.053694 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:06.053090    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:06.053694 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:06.053136    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:06.053694 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:06.053158    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689df9dc99-khnxm: secret "image-registry-tls" not found
Sep 07 16:57:06.053694 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:06.053213    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:06.053694 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:06.053223    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls podName:f92a1108-d020-49da-94fb-5d85ec513dcc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:08.053201905 +0000 UTC m=+39.693756702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls") pod "image-registry-689df9dc99-khnxm" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc") : secret "image-registry-tls" not found
Sep 07 16:57:06.053694 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:06.053266    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls podName:2ae057be-ab5b-4946-9d28-13a52462ef3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:08.053249631 +0000 UTC m=+39.693804412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls") pod "dns-default-gvgw9" (UID: "2ae057be-ab5b-4946-9d28-13a52462ef3a") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:06.120665 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:06.120627    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" event={"ID":"18f90270-7f3d-4ee5-b293-14a694dcb4ea","Type":"ContainerStarted","Data":"69f8a0df239fde94ada5fb63f5bd34a939c1e01fa6f6dfca8110b4604ed60f58"}
Sep 07 16:57:06.148984 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:06.148871    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hwrq4" podStartSLOduration=8.151761844 podStartE2EDuration="37.148849279s" totalImagesPullingTime="28.997087435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:06.147744101 +0000 UTC m=+37.788298920" watchObservedRunningTime="2026-09-07 16:57:06.148849279 +0000 UTC m=+37.789404076"
Sep 07 16:57:06.281036 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:06.281001    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:06.424030 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:06.423951    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:07.396677 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:07.396642    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:07.491042 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:07.491006    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log" limit=1024
Sep 07 16:57:08.069379 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:08.069348    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:08.069592 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:08.069435    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:08.069592 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:08.069505    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:08.069592 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:08.069522    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689df9dc99-khnxm: secret "image-registry-tls" not found
Sep 07 16:57:08.069592 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:08.069580    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:08.069592 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:08.069593    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls podName:f92a1108-d020-49da-94fb-5d85ec513dcc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:12.069576262 +0000 UTC m=+43.710131049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls") pod "image-registry-689df9dc99-khnxm" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc") : secret "image-registry-tls" not found
Sep 07 16:57:08.069803 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:08.069628    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls podName:2ae057be-ab5b-4946-9d28-13a52462ef3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:12.069613356 +0000 UTC m=+43.710168131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls") pod "dns-default-gvgw9" (UID: "2ae057be-ab5b-4946-9d28-13a52462ef3a") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:08.127358 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:08.127322    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hxb6x" event={"ID":"5f67366e-3648-417f-9eac-c78536eea527","Type":"ContainerStarted","Data":"0d19ef3259f97ea807839515ae4a145990f54c70bce0703433b66c6994fb883c"}
Sep 07 16:57:08.151783 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:08.151737    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hxb6x" podStartSLOduration=1.4277605979999999 podStartE2EDuration="4.151718845s" totalImagesPullingTime="2.723958247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.151247874 +0000 UTC m=+39.791802681" watchObservedRunningTime="2026-09-07 16:57:08.151718845 +0000 UTC m=+39.792273640"
Sep 07 16:57:09.297599 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.297563    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"]
Sep 07 16:57:09.319198 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.319172    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"
Sep 07 16:57:09.328591 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.328571    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"]
Sep 07 16:57:09.329391 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.329371    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z46k4\""
Sep 07 16:57:09.329821 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.329804    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 07 16:57:09.330293 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.330280    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 07 16:57:09.478735 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.478693    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4b2j\" (UniqueName: \"kubernetes.io/projected/d8823593-2552-445d-9b1e-da8907bb9e77-kube-api-access-n4b2j\") pod \"migrator-fdbb8fdff-2kpz2\" (UID: \"d8823593-2552-445d-9b1e-da8907bb9e77\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"
Sep 07 16:57:09.579414 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.579383    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4b2j\" (UniqueName: \"kubernetes.io/projected/d8823593-2552-445d-9b1e-da8907bb9e77-kube-api-access-n4b2j\") pod \"migrator-fdbb8fdff-2kpz2\" (UID: \"d8823593-2552-445d-9b1e-da8907bb9e77\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"
Sep 07 16:57:09.658553 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.658508    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4b2j\" (UniqueName: \"kubernetes.io/projected/d8823593-2552-445d-9b1e-da8907bb9e77-kube-api-access-n4b2j\") pod \"migrator-fdbb8fdff-2kpz2\" (UID: \"d8823593-2552-445d-9b1e-da8907bb9e77\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"
Sep 07 16:57:09.833551 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.833454    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xvhqn"]
Sep 07 16:57:09.857652 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.857626    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xvhqn"]
Sep 07 16:57:09.857796 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.857726    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:09.864242 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.864224    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 16:57:09.864326 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.864224    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 16:57:09.864565 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.864549    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 16:57:09.864753 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.864737    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 16:57:09.864796 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.864770    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\""
Sep 07 16:57:09.927790 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.927762    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"
Sep 07 16:57:09.982999 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.982973    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hx6j\" (UniqueName: \"kubernetes.io/projected/630180ce-c496-42cd-82ba-12657a097968-kube-api-access-2hx6j\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:09.983124 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.983040    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/630180ce-c496-42cd-82ba-12657a097968-crio-socket\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:09.983124 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.983065    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/630180ce-c496-42cd-82ba-12657a097968-data-volume\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:09.983217 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.983135    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:09.983217 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:09.983208    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084070 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.083990    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/630180ce-c496-42cd-82ba-12657a097968-crio-socket\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084070 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.084020    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/630180ce-c496-42cd-82ba-12657a097968-data-volume\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084070 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.084048    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084296 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.084143    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.084296 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.084204    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:10.584188712 +0000 UTC m=+42.224743489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.084296 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.084218    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084296 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.084244    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/630180ce-c496-42cd-82ba-12657a097968-crio-socket\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084296 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.084252    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hx6j\" (UniqueName: \"kubernetes.io/projected/630180ce-c496-42cd-82ba-12657a097968-kube-api-access-2hx6j\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.084478 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.084317    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.084478 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.084382    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:10.584366519 +0000 UTC m=+42.224921307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.084478 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.084391    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/630180ce-c496-42cd-82ba-12657a097968-data-volume\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.093462 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.093437    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hx6j\" (UniqueName: \"kubernetes.io/projected/630180ce-c496-42cd-82ba-12657a097968-kube-api-access-2hx6j\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.250093 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.250063    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2"]
Sep 07 16:57:10.255851 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:10.255814    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8823593_2552_445d_9b1e_da8907bb9e77.slice/crio-33ac734d044f5fdcda8c38b4ed75d2bde3cd268ef3fb45c529040ca55967a1bc WatchSource:0}: Error finding container 33ac734d044f5fdcda8c38b4ed75d2bde3cd268ef3fb45c529040ca55967a1bc: Status 404 returned error can't find the container with id 33ac734d044f5fdcda8c38b4ed75d2bde3cd268ef3fb45c529040ca55967a1bc
Sep 07 16:57:10.589148 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.589113    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.589577 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.589208    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:10.589577 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.589261    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.589577 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.589304    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.589577 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.589362    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:11.589335233 +0000 UTC m=+43.229890025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.589577 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:10.589384    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:11.589373986 +0000 UTC m=+43.229928761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.922264 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.922191    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-qp5vf"]
Sep 07 16:57:10.952527 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.952494    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-qp5vf"]
Sep 07 16:57:10.952703 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.952613    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:10.955656 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.955632    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 07 16:57:10.955656 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.955647    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 07 16:57:10.955818 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:10.955668    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9crcv\""
Sep 07 16:57:11.093834 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.093793    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d308b19-f8af-43ed-b344-2d49561ec367-nginx-conf\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:11.094020 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.093866    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:11.136619 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.136584    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2" event={"ID":"d8823593-2552-445d-9b1e-da8907bb9e77","Type":"ContainerStarted","Data":"33ac734d044f5fdcda8c38b4ed75d2bde3cd268ef3fb45c529040ca55967a1bc"}
Sep 07 16:57:11.153370 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.153338    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cnlmz"]
Sep 07 16:57:11.170503 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.170408    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cnlmz"]
Sep 07 16:57:11.170503 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.170500    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.173771 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.173277    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 07 16:57:11.173771 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.173604    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 07 16:57:11.173771 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.173629    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sjtwn\""
Sep 07 16:57:11.173996 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.173972    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 07 16:57:11.176062 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.176008    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 07 16:57:11.194639 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.194430    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d308b19-f8af-43ed-b344-2d49561ec367-nginx-conf\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:11.194639 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.194472    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:11.194843 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.194680    2545 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 16:57:11.194843 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.194733    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert podName:4d308b19-f8af-43ed-b344-2d49561ec367 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:11.694719559 +0000 UTC m=+43.335274334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-qp5vf" (UID: "4d308b19-f8af-43ed-b344-2d49561ec367") : secret "networking-console-plugin-cert" not found
Sep 07 16:57:11.195454 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.195425    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d308b19-f8af-43ed-b344-2d49561ec367-nginx-conf\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:11.294931 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.294889    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f6967634-781f-411e-a089-161a3d44ef9b-signing-key\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.294931 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.294939    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f6967634-781f-411e-a089-161a3d44ef9b-signing-cabundle\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.295142 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.295069    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6z6\" (UniqueName: \"kubernetes.io/projected/f6967634-781f-411e-a089-161a3d44ef9b-kube-api-access-tw6z6\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.395880 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.395840    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f6967634-781f-411e-a089-161a3d44ef9b-signing-cabundle\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.396046 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.396022    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6z6\" (UniqueName: \"kubernetes.io/projected/f6967634-781f-411e-a089-161a3d44ef9b-kube-api-access-tw6z6\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.396085 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.396048    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f6967634-781f-411e-a089-161a3d44ef9b-signing-key\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.396577 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.396532    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f6967634-781f-411e-a089-161a3d44ef9b-signing-cabundle\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.398330 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.398308    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f6967634-781f-411e-a089-161a3d44ef9b-signing-key\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.405672 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.405646    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6z6\" (UniqueName: \"kubernetes.io/projected/f6967634-781f-411e-a089-161a3d44ef9b-kube-api-access-tw6z6\") pod \"service-ca-75d99c484-cnlmz\" (UID: \"f6967634-781f-411e-a089-161a3d44ef9b\") " pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.481645 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.481556    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-cnlmz"
Sep 07 16:57:11.598160 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.598117    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:11.598626 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.598207    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:11.598626 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.598289    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 16:57:11.598626 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.598296    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:11.598626 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.598353    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.598334292 +0000 UTC m=+45.238889067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : configmap "kube-rbac-proxy" not found
Sep 07 16:57:11.598626 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.598373    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.598363109 +0000 UTC m=+45.238917884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:11.699356 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.699317    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:11.699523 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.699482    2545 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 16:57:11.699609 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:11.699572    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert podName:4d308b19-f8af-43ed-b344-2d49561ec367 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:12.699549581 +0000 UTC m=+44.340104367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-qp5vf" (UID: "4d308b19-f8af-43ed-b344-2d49561ec367") : secret "networking-console-plugin-cert" not found
Sep 07 16:57:11.778166 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.778139    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4j6sg_8a3e3dff-1419-40e4-be56-bf9a303ed82d/dns-node-resolver/0.log"
Sep 07 16:57:11.985343 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:11.985302    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-cnlmz"]
Sep 07 16:57:12.026094 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:12.026019    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6967634_781f_411e_a089_161a3d44ef9b.slice/crio-2cf9ba9e61f540092ad017f065494e78dcbfd66673445c0d71efcde23eceb8a6 WatchSource:0}: Error finding container 2cf9ba9e61f540092ad017f065494e78dcbfd66673445c0d71efcde23eceb8a6: Status 404 returned error can't find the container with id 2cf9ba9e61f540092ad017f065494e78dcbfd66673445c0d71efcde23eceb8a6
Sep 07 16:57:12.102451 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:12.102424    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:12.102590 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:12.102495    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:12.102637 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.102611    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:12.102637 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.102619    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:12.102710 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.102637    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689df9dc99-khnxm: secret "image-registry-tls" not found
Sep 07 16:57:12.102710 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.102675    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls podName:2ae057be-ab5b-4946-9d28-13a52462ef3a nodeName:}" failed. No retries permitted until 2026-09-07 16:57:20.102659169 +0000 UTC m=+51.743213948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls") pod "dns-default-gvgw9" (UID: "2ae057be-ab5b-4946-9d28-13a52462ef3a") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:12.102710 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.102689    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls podName:f92a1108-d020-49da-94fb-5d85ec513dcc nodeName:}" failed. No retries permitted until 2026-09-07 16:57:20.10268309 +0000 UTC m=+51.743237864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls") pod "image-registry-689df9dc99-khnxm" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc") : secret "image-registry-tls" not found
Sep 07 16:57:12.141272 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:12.141238    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-cnlmz" event={"ID":"f6967634-781f-411e-a089-161a3d44ef9b","Type":"ContainerStarted","Data":"2cf9ba9e61f540092ad017f065494e78dcbfd66673445c0d71efcde23eceb8a6"}
Sep 07 16:57:12.708785 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:12.708753    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:12.709196 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.708892    2545 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 16:57:12.709196 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:12.708977    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert podName:4d308b19-f8af-43ed-b344-2d49561ec367 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:14.708954466 +0000 UTC m=+46.349509241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-qp5vf" (UID: "4d308b19-f8af-43ed-b344-2d49561ec367") : secret "networking-console-plugin-cert" not found
Sep 07 16:57:12.977557 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:12.977465    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ctfcw_5e483962-770d-4578-b4b2-e770dff93296/node-ca/0.log"
Sep 07 16:57:13.145683 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.145649    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2" event={"ID":"d8823593-2552-445d-9b1e-da8907bb9e77","Type":"ContainerStarted","Data":"2d15f3fc25383bd39724364a216f00a03efaf60de123700a662656a0fe0a8175"}
Sep 07 16:57:13.145831 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.145701    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2" event={"ID":"d8823593-2552-445d-9b1e-da8907bb9e77","Type":"ContainerStarted","Data":"c0b024dbcad9f5039184e5dd136a7216466bb74a7dfbfbeee0aa5d40d4873a24"}
Sep 07 16:57:13.167779 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.167731    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2kpz2" podStartSLOduration=2.368825079 podStartE2EDuration="4.167714158s" totalImagesPullingTime="1.798889079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:13.166465747 +0000 UTC m=+44.807020564" watchObservedRunningTime="2026-09-07 16:57:13.167714158 +0000 UTC m=+44.808268954"
Sep 07 16:57:13.618634 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.618597    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:13.618839 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.618660    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:13.618839 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:13.618775    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:13.618944 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:13.618852    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:17.618830185 +0000 UTC m=+49.259384973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:13.619262 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.619229    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630180ce-c496-42cd-82ba-12657a097968-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:13.785756 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.785723    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hxb6x_5f67366e-3648-417f-9eac-c78536eea527/serve-healthcheck-canary/0.log"
Sep 07 16:57:13.983814 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:13.983740    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-2kpz2_d8823593-2552-445d-9b1e-da8907bb9e77/migrator/0.log"
Sep 07 16:57:14.184891 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:14.184865    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-2kpz2_d8823593-2552-445d-9b1e-da8907bb9e77/graceful-termination/0.log"
Sep 07 16:57:14.727193 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:14.727095    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:14.727340 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:14.727250    2545 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 16:57:14.727340 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:14.727323    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert podName:4d308b19-f8af-43ed-b344-2d49561ec367 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:18.72730511 +0000 UTC m=+50.367859883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-qp5vf" (UID: "4d308b19-f8af-43ed-b344-2d49561ec367") : secret "networking-console-plugin-cert" not found
Sep 07 16:57:15.151924 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:15.151885    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-cnlmz" event={"ID":"f6967634-781f-411e-a089-161a3d44ef9b","Type":"ContainerStarted","Data":"09f3055b797afd077479b2a6243f87b6c1422223f7c5d8c09ab27b59c5f0adeb"}
Sep 07 16:57:17.648499 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:17.648456    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:17.648902 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:17.648681    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:17.648902 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:17.648784    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls podName:630180ce-c496-42cd-82ba-12657a097968 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:25.648759908 +0000 UTC m=+57.289314688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvhqn" (UID: "630180ce-c496-42cd-82ba-12657a097968") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:18.757791 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:18.757750    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:18.758169 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:18.757865    2545 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 16:57:18.758169 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:18.757917    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert podName:4d308b19-f8af-43ed-b344-2d49561ec367 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:26.757903724 +0000 UTC m=+58.398458498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-qp5vf" (UID: "4d308b19-f8af-43ed-b344-2d49561ec367") : secret "networking-console-plugin-cert" not found
Sep 07 16:57:20.169282 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.169248    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:20.169824 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.169323    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:20.171763 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.171742    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ae057be-ab5b-4946-9d28-13a52462ef3a-metrics-tls\") pod \"dns-default-gvgw9\" (UID: \"2ae057be-ab5b-4946-9d28-13a52462ef3a\") " pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:20.171813 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.171799    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"image-registry-689df9dc99-khnxm\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") " pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:20.242942 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.242899    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:20.253114 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.253093    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:20.538162 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.538072    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-cnlmz" podStartSLOduration=7.275636082 podStartE2EDuration="9.53805312s" totalImagesPullingTime="2.262417038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:15.227767416 +0000 UTC m=+46.868322232" watchObservedRunningTime="2026-09-07 16:57:20.53805312 +0000 UTC m=+52.178607981"
Sep 07 16:57:20.538853 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.538831    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvgw9"]
Sep 07 16:57:20.541807 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:20.541784    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae057be_ab5b_4946_9d28_13a52462ef3a.slice/crio-7b9b27140885c5e3495942384f47ddfc83bf67498e639b16409da30fa0603de2 WatchSource:0}: Error finding container 7b9b27140885c5e3495942384f47ddfc83bf67498e639b16409da30fa0603de2: Status 404 returned error can't find the container with id 7b9b27140885c5e3495942384f47ddfc83bf67498e639b16409da30fa0603de2
Sep 07 16:57:20.566956 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:20.566865    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689df9dc99-khnxm"]
Sep 07 16:57:20.569179 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:20.569153    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92a1108_d020_49da_94fb_5d85ec513dcc.slice/crio-7a03764b891d2689346f4226987076b65c714fe4e3e7ab9c9dbee0951aca9798 WatchSource:0}: Error finding container 7a03764b891d2689346f4226987076b65c714fe4e3e7ab9c9dbee0951aca9798: Status 404 returned error can't find the container with id 7a03764b891d2689346f4226987076b65c714fe4e3e7ab9c9dbee0951aca9798
Sep 07 16:57:21.168020 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:21.167973    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvgw9" event={"ID":"2ae057be-ab5b-4946-9d28-13a52462ef3a","Type":"ContainerStarted","Data":"7b9b27140885c5e3495942384f47ddfc83bf67498e639b16409da30fa0603de2"}
Sep 07 16:57:21.169409 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:21.169379    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" event={"ID":"f92a1108-d020-49da-94fb-5d85ec513dcc","Type":"ContainerStarted","Data":"ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758"}
Sep 07 16:57:21.169764 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:21.169420    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" event={"ID":"f92a1108-d020-49da-94fb-5d85ec513dcc","Type":"ContainerStarted","Data":"7a03764b891d2689346f4226987076b65c714fe4e3e7ab9c9dbee0951aca9798"}
Sep 07 16:57:21.169764 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:21.169516    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:21.199073 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:21.199016    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" podStartSLOduration=30.198997732 podStartE2EDuration="30.198997732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:21.197486894 +0000 UTC m=+52.838041716" watchObservedRunningTime="2026-09-07 16:57:21.198997732 +0000 UTC m=+52.839552529"
Sep 07 16:57:23.177053 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:23.177016    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvgw9" event={"ID":"2ae057be-ab5b-4946-9d28-13a52462ef3a","Type":"ContainerStarted","Data":"53f7be9fd2f5a4d6ab81f8eaf8b4b5e60e283927bd4dfb7b649077c66ac56b2f"}
Sep 07 16:57:23.177603 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:23.177077    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvgw9" event={"ID":"2ae057be-ab5b-4946-9d28-13a52462ef3a","Type":"ContainerStarted","Data":"5257393dbfd2d2d0fef1cbae016d41d64c8cd250b5c9404e07f885b7af9a0b49"}
Sep 07 16:57:23.177603 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:23.177160    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:23.218952 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:23.218909    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvgw9" podStartSLOduration=17.422954344 podStartE2EDuration="19.218894338s" totalImagesPullingTime="1.795939994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:23.217316124 +0000 UTC m=+54.857870939" watchObservedRunningTime="2026-09-07 16:57:23.218894338 +0000 UTC m=+54.859449170"
Sep 07 16:57:25.711137 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:25.711096    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:25.713271 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:25.713242    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630180ce-c496-42cd-82ba-12657a097968-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvhqn\" (UID: \"630180ce-c496-42cd-82ba-12657a097968\") " pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:25.766456 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:25.766426    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xvhqn"
Sep 07 16:57:26.035996 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:26.035925    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xvhqn"]
Sep 07 16:57:26.038741 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:26.038713    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630180ce_c496_42cd_82ba_12657a097968.slice/crio-a891f00cf31e3e6dc2fd0998e0534b563b4ee97fa4ae6a334d99bf2b833ed724 WatchSource:0}: Error finding container a891f00cf31e3e6dc2fd0998e0534b563b4ee97fa4ae6a334d99bf2b833ed724: Status 404 returned error can't find the container with id a891f00cf31e3e6dc2fd0998e0534b563b4ee97fa4ae6a334d99bf2b833ed724
Sep 07 16:57:26.188806 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:26.188767    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvhqn" event={"ID":"630180ce-c496-42cd-82ba-12657a097968","Type":"ContainerStarted","Data":"6ca83a8475f569e4c516e8bfaa06017a9d9f4f5746e472b28dfdbb74c34f3eb0"}
Sep 07 16:57:26.188973 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:26.188834    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvhqn" event={"ID":"630180ce-c496-42cd-82ba-12657a097968","Type":"ContainerStarted","Data":"a891f00cf31e3e6dc2fd0998e0534b563b4ee97fa4ae6a334d99bf2b833ed724"}
Sep 07 16:57:26.819984 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:26.819413    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:26.822209 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:26.822170    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d308b19-f8af-43ed-b344-2d49561ec367-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-qp5vf\" (UID: \"4d308b19-f8af-43ed-b344-2d49561ec367\") " pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:26.861175 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:26.861145    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf"
Sep 07 16:57:27.150837 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:27.150764    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-qp5vf"]
Sep 07 16:57:27.221042 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:27.221010    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d308b19_f8af_43ed_b344_2d49561ec367.slice/crio-0e9b3362bb86e239e645f335d111118d3538445a41e465f4d5d21a9c19188591 WatchSource:0}: Error finding container 0e9b3362bb86e239e645f335d111118d3538445a41e465f4d5d21a9c19188591: Status 404 returned error can't find the container with id 0e9b3362bb86e239e645f335d111118d3538445a41e465f4d5d21a9c19188591
Sep 07 16:57:28.198443 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:28.198400    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvhqn" event={"ID":"630180ce-c496-42cd-82ba-12657a097968","Type":"ContainerStarted","Data":"c50e7389bd9949a2ebf609e92a89daa64faf06c57e4b3a36c872f829d8a00ae1"}
Sep 07 16:57:28.200058 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:28.200022    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf" event={"ID":"4d308b19-f8af-43ed-b344-2d49561ec367","Type":"ContainerStarted","Data":"0e9b3362bb86e239e645f335d111118d3538445a41e465f4d5d21a9c19188591"}
Sep 07 16:57:29.205122 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:29.205025    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvhqn" event={"ID":"630180ce-c496-42cd-82ba-12657a097968","Type":"ContainerStarted","Data":"93853e09030eff0cbd9f49e9acff70d17a638d62f5378cf085f8aa6685a4b021"}
Sep 07 16:57:29.206663 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:29.206636    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf" event={"ID":"4d308b19-f8af-43ed-b344-2d49561ec367","Type":"ContainerStarted","Data":"5ee79171d4f44c8c774438165a55adf609a5f3f6c3d89b42a16006bd251965cf"}
Sep 07 16:57:29.228227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:29.228179    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xvhqn" podStartSLOduration=17.577736123 podStartE2EDuration="20.228165134s" totalImagesPullingTime="2.650429011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:29.226653662 +0000 UTC m=+60.867208478" watchObservedRunningTime="2026-09-07 16:57:29.228165134 +0000 UTC m=+60.868719929"
Sep 07 16:57:29.246125 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:29.246081    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-qp5vf" podStartSLOduration=17.635016575 podStartE2EDuration="19.246068496s" totalImagesPullingTime="1.611051921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:29.244825434 +0000 UTC m=+60.885380242" watchObservedRunningTime="2026-09-07 16:57:29.246068496 +0000 UTC m=+60.886623291"
Sep 07 16:57:30.105327 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.105299    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mjkw"
Sep 07 16:57:30.313185 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.313153    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"]
Sep 07 16:57:30.315284 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.315265    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.317548 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.317510    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"]
Sep 07 16:57:30.318737 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.318722    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 16:57:30.319048 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.319034    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 16:57:30.319180 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.319164    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 16:57:30.319224 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.319212    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 07 16:57:30.319362 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.319348    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.319407 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.319359    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-llmkx\""
Sep 07 16:57:30.323416 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.323383    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 07 16:57:30.336214 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.336190    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"]
Sep 07 16:57:30.339089 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.339070    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"]
Sep 07 16:57:30.342971 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.342947    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvp6w\" (UniqueName: \"kubernetes.io/projected/50e76ccf-650c-4897-ac30-df6ae0abf8a3-kube-api-access-lvp6w\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.343079 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.342984    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50e76ccf-650c-4897-ac30-df6ae0abf8a3-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.343138 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.343067    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9clt\" (UniqueName: \"kubernetes.io/projected/105db448-c5de-4ea8-bf9d-bc51ed3bb7aa-kube-api-access-v9clt\") pod \"managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq\" (UID: \"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.343138 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.343106    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/105db448-c5de-4ea8-bf9d-bc51ed3bb7aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq\" (UID: \"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.343250 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.343227    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50e76ccf-650c-4897-ac30-df6ae0abf8a3-tmp\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.374769 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.374697    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-689df9dc99-khnxm"]
Sep 07 16:57:30.443868 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.443838    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50e76ccf-650c-4897-ac30-df6ae0abf8a3-tmp\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.444014 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.443874    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvp6w\" (UniqueName: \"kubernetes.io/projected/50e76ccf-650c-4897-ac30-df6ae0abf8a3-kube-api-access-lvp6w\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.444014 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.443895    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50e76ccf-650c-4897-ac30-df6ae0abf8a3-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.444083 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.444007    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9clt\" (UniqueName: \"kubernetes.io/projected/105db448-c5de-4ea8-bf9d-bc51ed3bb7aa-kube-api-access-v9clt\") pod \"managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq\" (UID: \"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.444083 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.444034    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/105db448-c5de-4ea8-bf9d-bc51ed3bb7aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq\" (UID: \"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.444292 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.444265    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50e76ccf-650c-4897-ac30-df6ae0abf8a3-tmp\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.446320 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.446290    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50e76ccf-650c-4897-ac30-df6ae0abf8a3-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.446488 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.446467    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/105db448-c5de-4ea8-bf9d-bc51ed3bb7aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq\" (UID: \"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.466867 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.466846    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5859566cbd-zhczw"]
Sep 07 16:57:30.468713 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.468698    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.494274 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.494247    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvp6w\" (UniqueName: \"kubernetes.io/projected/50e76ccf-650c-4897-ac30-df6ae0abf8a3-kube-api-access-lvp6w\") pod \"klusterlet-addon-workmgr-b8798655b-78bfx\" (UID: \"50e76ccf-650c-4897-ac30-df6ae0abf8a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.495260 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.495241    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9clt\" (UniqueName: \"kubernetes.io/projected/105db448-c5de-4ea8-bf9d-bc51ed3bb7aa-kube-api-access-v9clt\") pod \"managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq\" (UID: \"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.507327 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.507300    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5859566cbd-zhczw"]
Sep 07 16:57:30.545029 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.544997    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d507fd7-b41f-4429-8329-59be0e1aaaf3-installation-pull-secrets\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545029 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545031    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-bound-sa-token\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545055    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-registry-tls\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545100    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d507fd7-b41f-4429-8329-59be0e1aaaf3-image-registry-private-configuration\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545118    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzsvd\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-kube-api-access-rzsvd\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545134    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d507fd7-b41f-4429-8329-59be0e1aaaf3-trusted-ca\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545155    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d507fd7-b41f-4429-8329-59be0e1aaaf3-ca-trust-extracted\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.545227 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.545181    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d507fd7-b41f-4429-8329-59be0e1aaaf3-registry-certificates\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.641370 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.641283    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"
Sep 07 16:57:30.646264 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646239    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d507fd7-b41f-4429-8329-59be0e1aaaf3-registry-certificates\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646396 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646282    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d507fd7-b41f-4429-8329-59be0e1aaaf3-installation-pull-secrets\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646396 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646308    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-bound-sa-token\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646396 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646369    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-registry-tls\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646563 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646442    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d507fd7-b41f-4429-8329-59be0e1aaaf3-image-registry-private-configuration\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646563 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646466    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzsvd\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-kube-api-access-rzsvd\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646563 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646495    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d507fd7-b41f-4429-8329-59be0e1aaaf3-trusted-ca\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646563 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646547    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d507fd7-b41f-4429-8329-59be0e1aaaf3-ca-trust-extracted\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.646753 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646587    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:30.646914 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.646890    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d507fd7-b41f-4429-8329-59be0e1aaaf3-ca-trust-extracted\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.647163 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.647140    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d507fd7-b41f-4429-8329-59be0e1aaaf3-registry-certificates\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.647727 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.647684    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d507fd7-b41f-4429-8329-59be0e1aaaf3-trusted-ca\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.649234 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.649216    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d507fd7-b41f-4429-8329-59be0e1aaaf3-image-registry-private-configuration\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.649427 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.649402    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d507fd7-b41f-4429-8329-59be0e1aaaf3-installation-pull-secrets\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.649471 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.649410    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-registry-tls\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.668409 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.668368    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-bound-sa-token\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.669519 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.669491    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzsvd\" (UniqueName: \"kubernetes.io/projected/0d507fd7-b41f-4429-8329-59be0e1aaaf3-kube-api-access-rzsvd\") pod \"image-registry-5859566cbd-zhczw\" (UID: \"0d507fd7-b41f-4429-8329-59be0e1aaaf3\") " pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.777108 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.777074    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:30.918885 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.918815    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq"]
Sep 07 16:57:30.921709 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:30.921677    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod105db448_c5de_4ea8_bf9d_bc51ed3bb7aa.slice/crio-04f441616e27232ae67c66f63f6c29fd3f08a61b9c01cd20409ece0f23341b4f WatchSource:0}: Error finding container 04f441616e27232ae67c66f63f6c29fd3f08a61b9c01cd20409ece0f23341b4f: Status 404 returned error can't find the container with id 04f441616e27232ae67c66f63f6c29fd3f08a61b9c01cd20409ece0f23341b4f
Sep 07 16:57:30.938567 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:30.938530    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"]
Sep 07 16:57:30.940933 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:30.940911    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e76ccf_650c_4897_ac30_df6ae0abf8a3.slice/crio-2e94b6cc4e630db661bf0605d4687d2f96632656614684f2b06bfa8ea679df84 WatchSource:0}: Error finding container 2e94b6cc4e630db661bf0605d4687d2f96632656614684f2b06bfa8ea679df84: Status 404 returned error can't find the container with id 2e94b6cc4e630db661bf0605d4687d2f96632656614684f2b06bfa8ea679df84
Sep 07 16:57:31.058556 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.058509    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5859566cbd-zhczw"]
Sep 07 16:57:31.061392 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:31.061353    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d507fd7_b41f_4429_8329_59be0e1aaaf3.slice/crio-e39d4e023d5443797b388997e1a946d7e7ec0bd751af9713734f5d8367de79b6 WatchSource:0}: Error finding container e39d4e023d5443797b388997e1a946d7e7ec0bd751af9713734f5d8367de79b6: Status 404 returned error can't find the container with id e39d4e023d5443797b388997e1a946d7e7ec0bd751af9713734f5d8367de79b6
Sep 07 16:57:31.214704 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.214614    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5859566cbd-zhczw" event={"ID":"0d507fd7-b41f-4429-8329-59be0e1aaaf3","Type":"ContainerStarted","Data":"e4cb4aa983ae54b3b30b459dde75e4e2d63bd036406e7d8ddd6eaf834bd0df70"}
Sep 07 16:57:31.214704 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.214679    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5859566cbd-zhczw" event={"ID":"0d507fd7-b41f-4429-8329-59be0e1aaaf3","Type":"ContainerStarted","Data":"e39d4e023d5443797b388997e1a946d7e7ec0bd751af9713734f5d8367de79b6"}
Sep 07 16:57:31.214899 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.214711    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:31.215952 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.215915    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx" event={"ID":"50e76ccf-650c-4897-ac30-df6ae0abf8a3","Type":"ContainerStarted","Data":"2e94b6cc4e630db661bf0605d4687d2f96632656614684f2b06bfa8ea679df84"}
Sep 07 16:57:31.216973 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.216945    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq" event={"ID":"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa","Type":"ContainerStarted","Data":"04f441616e27232ae67c66f63f6c29fd3f08a61b9c01cd20409ece0f23341b4f"}
Sep 07 16:57:31.238103 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:31.238053    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5859566cbd-zhczw" podStartSLOduration=1.238037689 podStartE2EDuration="1.238037689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:31.236593157 +0000 UTC m=+62.877147971" watchObservedRunningTime="2026-09-07 16:57:31.238037689 +0000 UTC m=+62.878592527"
Sep 07 16:57:33.184190 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:33.184157    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvgw9"
Sep 07 16:57:34.686299 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.685283    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:34.686299 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.685344    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:34.688804 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.688778    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 16:57:34.689723 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.689705    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 16:57:34.698184 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.698159    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eada764a-cb73-4632-940a-c6741d20b9e9-original-pull-secret\") pod \"global-pull-secret-syncer-nffqs\" (UID: \"eada764a-cb73-4632-940a-c6741d20b9e9\") " pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:34.698275 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.698218    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/571814cc-9b65-4d71-b868-8cc002abb5bc-metrics-certs\") pod \"network-metrics-daemon-bzd4s\" (UID: \"571814cc-9b65-4d71-b868-8cc002abb5bc\") " pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:34.701122 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.701103    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nffqs"
Sep 07 16:57:34.709784 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.709759    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 16:57:34.718054 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.718034    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzd4s"
Sep 07 16:57:34.786190 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.786158    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:34.788973 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.788939    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 16:57:34.799688 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.799657    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 16:57:34.811393 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.810731    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfww\" (UniqueName: \"kubernetes.io/projected/79a4e303-057c-4908-9550-903fadd66770-kube-api-access-5vfww\") pod \"network-check-target-482vq\" (UID: \"79a4e303-057c-4908-9550-903fadd66770\") " pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:34.997517 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:34.997446    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 16:57:35.004850 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:35.004824    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:36.082981 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.082940    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bzd4s"]
Sep 07 16:57:36.085779 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:36.085745    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571814cc_9b65_4d71_b868_8cc002abb5bc.slice/crio-ed2eb5796ce67e81bc6b458dcb2bb90b032fa8aa022e2aa0109b1370955d7fb7 WatchSource:0}: Error finding container ed2eb5796ce67e81bc6b458dcb2bb90b032fa8aa022e2aa0109b1370955d7fb7: Status 404 returned error can't find the container with id ed2eb5796ce67e81bc6b458dcb2bb90b032fa8aa022e2aa0109b1370955d7fb7
Sep 07 16:57:36.086407 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.086382    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nffqs"]
Sep 07 16:57:36.087981 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.087878    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-482vq"]
Sep 07 16:57:36.089421 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:36.089395    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a4e303_057c_4908_9550_903fadd66770.slice/crio-da4ecab5b0452c6454a555df2a2bd13a42ffdbe6fe2ee8a6be2d7005f72d98f7 WatchSource:0}: Error finding container da4ecab5b0452c6454a555df2a2bd13a42ffdbe6fe2ee8a6be2d7005f72d98f7: Status 404 returned error can't find the container with id da4ecab5b0452c6454a555df2a2bd13a42ffdbe6fe2ee8a6be2d7005f72d98f7
Sep 07 16:57:36.090125 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:36.090098    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeada764a_cb73_4632_940a_c6741d20b9e9.slice/crio-d12242533d5318211cc4b589097e663a096164dca15b87008c90505370933dac WatchSource:0}: Error finding container d12242533d5318211cc4b589097e663a096164dca15b87008c90505370933dac: Status 404 returned error can't find the container with id d12242533d5318211cc4b589097e663a096164dca15b87008c90505370933dac
Sep 07 16:57:36.239381 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.239348    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx" event={"ID":"50e76ccf-650c-4897-ac30-df6ae0abf8a3","Type":"ContainerStarted","Data":"2470175c1f01b20f60b2930e4b4e0657261326aff5b567c5f3a69d5e5f9981ad"}
Sep 07 16:57:36.239619 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.239569    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:36.240894 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.240855    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nffqs" event={"ID":"eada764a-cb73-4632-940a-c6741d20b9e9","Type":"ContainerStarted","Data":"d12242533d5318211cc4b589097e663a096164dca15b87008c90505370933dac"}
Sep 07 16:57:36.241385 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.241363    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx"
Sep 07 16:57:36.242175 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.242153    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-482vq" event={"ID":"79a4e303-057c-4908-9550-903fadd66770","Type":"ContainerStarted","Data":"da4ecab5b0452c6454a555df2a2bd13a42ffdbe6fe2ee8a6be2d7005f72d98f7"}
Sep 07 16:57:36.243430 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.243404    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzd4s" event={"ID":"571814cc-9b65-4d71-b868-8cc002abb5bc","Type":"ContainerStarted","Data":"ed2eb5796ce67e81bc6b458dcb2bb90b032fa8aa022e2aa0109b1370955d7fb7"}
Sep 07 16:57:36.244722 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.244699    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq" event={"ID":"105db448-c5de-4ea8-bf9d-bc51ed3bb7aa","Type":"ContainerStarted","Data":"6150a4cfd7d81ab55b981924d69b168ed65ba9179e5f589a9da479afd65573d4"}
Sep 07 16:57:36.257987 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.257949    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8798655b-78bfx" podStartSLOduration=1.369850984 podStartE2EDuration="6.257937565s" totalImagesPullingTime="4.888086581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:36.256893436 +0000 UTC m=+67.897448251" watchObservedRunningTime="2026-09-07 16:57:36.257937565 +0000 UTC m=+67.898492352"
Sep 07 16:57:36.275884 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:36.275841    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9b78dd6d-9kzxq" podStartSLOduration=1.390264041 podStartE2EDuration="6.27582331s" totalImagesPullingTime="4.885559269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:36.275002196 +0000 UTC m=+67.915556991" watchObservedRunningTime="2026-09-07 16:57:36.27582331 +0000 UTC m=+67.916378105"
Sep 07 16:57:38.257738 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:38.257702    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzd4s" event={"ID":"571814cc-9b65-4d71-b868-8cc002abb5bc","Type":"ContainerStarted","Data":"cb8ce916a098d905abcd733227c11743fdb2767a2226f57d88f753850bce8b78"}
Sep 07 16:57:38.258198 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:38.257764    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzd4s" event={"ID":"571814cc-9b65-4d71-b868-8cc002abb5bc","Type":"ContainerStarted","Data":"5b501e53239eae96120b54beb4814b82f4abfced255fdd9e1715b043aec72ec8"}
Sep 07 16:57:38.298209 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:38.298146    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bzd4s" podStartSLOduration=68.06860088 podStartE2EDuration="1m9.298127237s" totalImagesPullingTime="1.229526357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.295566609 +0000 UTC m=+69.936121428" watchObservedRunningTime="2026-09-07 16:57:38.298127237 +0000 UTC m=+69.938682036"
Sep 07 16:57:40.379980 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:40.379943    2545 patch_prober.go:28] interesting pod/image-registry-689df9dc99-khnxm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 07 16:57:40.380390 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:40.380007    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" podUID="f92a1108-d020-49da-94fb-5d85ec513dcc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 16:57:41.272342 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:41.272301    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nffqs" event={"ID":"eada764a-cb73-4632-940a-c6741d20b9e9","Type":"ContainerStarted","Data":"5cde894fcb9697a8b8f2635db0c02a3c48985e93757b7fff620aae7baccfc97b"}
Sep 07 16:57:41.273758 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:41.273730    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-482vq" event={"ID":"79a4e303-057c-4908-9550-903fadd66770","Type":"ContainerStarted","Data":"959babb2b6dae7e4ddfc9b0045cf3b11ce6f216b35434be403430e6765a89d63"}
Sep 07 16:57:41.273877 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:41.273862    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:57:41.296816 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:41.296766    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nffqs" podStartSLOduration=67.628140343 podStartE2EDuration="1m12.296750891s" totalImagesPullingTime="4.668610548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:41.295864235 +0000 UTC m=+72.936419032" watchObservedRunningTime="2026-09-07 16:57:41.296750891 +0000 UTC m=+72.937305711"
Sep 07 16:57:47.798367 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.798304    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-482vq" podStartSLOduration=74.132849376 podStartE2EDuration="1m18.798287159s" totalImagesPullingTime="4.665437783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:41.318292426 +0000 UTC m=+72.958847245" watchObservedRunningTime="2026-09-07 16:57:47.798287159 +0000 UTC m=+79.438841994"
Sep 07 16:57:47.799477 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.799454    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8627g"]
Sep 07 16:57:47.802166 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.802150    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.806134 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.806111    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 16:57:47.806134 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.806122    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 16:57:47.806605 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.806588    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 16:57:47.806697 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.806587    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 16:57:47.806962 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.806946    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 16:57:47.807032 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.807000    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 16:57:47.807080 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.807035    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\""
Sep 07 16:57:47.890989 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.890953    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.890989 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.890993    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-textfile\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891184 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891015    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-metrics-client-ca\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891184 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891091    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-tls\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891184 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891163    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm7kq\" (UniqueName: \"kubernetes.io/projected/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-kube-api-access-sm7kq\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891282 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891209    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-accelerators-collector-config\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891282 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891233    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-root\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891282 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891250    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-sys\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.891282 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.891267    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-wtmp\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992168 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992134    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-metrics-client-ca\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992168 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992172    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-tls\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992192    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm7kq\" (UniqueName: \"kubernetes.io/projected/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-kube-api-access-sm7kq\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992219    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-accelerators-collector-config\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992246    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-root\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992269    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-sys\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992290    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-wtmp\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992328    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992328    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-root\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992362    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-textfile\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992380    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-sys\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992842 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992469    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-wtmp\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992842 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992727    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-textfile\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992908 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992861    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-metrics-client-ca\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.992954 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.992939    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-accelerators-collector-config\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.994940 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.994921    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-tls\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:47.995082 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:47.995064    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:48.007715 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:48.007691    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm7kq\" (UniqueName: \"kubernetes.io/projected/a7ec2fd0-dcbc-4283-8853-3a83f78d0233-kube-api-access-sm7kq\") pod \"node-exporter-8627g\" (UID: \"a7ec2fd0-dcbc-4283-8853-3a83f78d0233\") " pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:48.111685 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:48.111656    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8627g"
Sep 07 16:57:48.123490 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:57:48.123462    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ec2fd0_dcbc_4283_8853_3a83f78d0233.slice/crio-0c26d1c59764b757265d18afd1fcd8d6a3d143193ee6f5604e51ab9d40f80bf4 WatchSource:0}: Error finding container 0c26d1c59764b757265d18afd1fcd8d6a3d143193ee6f5604e51ab9d40f80bf4: Status 404 returned error can't find the container with id 0c26d1c59764b757265d18afd1fcd8d6a3d143193ee6f5604e51ab9d40f80bf4
Sep 07 16:57:48.299261 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:48.299231    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8627g" event={"ID":"a7ec2fd0-dcbc-4283-8853-3a83f78d0233","Type":"ContainerStarted","Data":"0c26d1c59764b757265d18afd1fcd8d6a3d143193ee6f5604e51ab9d40f80bf4"}
Sep 07 16:57:49.305013 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:49.304975    2545 generic.go:356] "Generic (PLEG): container finished" podID="a7ec2fd0-dcbc-4283-8853-3a83f78d0233" containerID="f4e6313d66b5d756fa61d67971cb02e24d08ea22da0af13027abd11c8dd016b1" exitCode=0
Sep 07 16:57:49.305367 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:49.305032    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8627g" event={"ID":"a7ec2fd0-dcbc-4283-8853-3a83f78d0233","Type":"ContainerDied","Data":"f4e6313d66b5d756fa61d67971cb02e24d08ea22da0af13027abd11c8dd016b1"}
Sep 07 16:57:50.311310 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:50.311271    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8627g" event={"ID":"a7ec2fd0-dcbc-4283-8853-3a83f78d0233","Type":"ContainerStarted","Data":"49191204d53f9fb2f477085accd6c73f3ed328da89a3e544e1b0f28531ce24bc"}
Sep 07 16:57:50.311731 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:50.311330    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8627g" event={"ID":"a7ec2fd0-dcbc-4283-8853-3a83f78d0233","Type":"ContainerStarted","Data":"a5434a4858ae188f8d4b0b9d82106a1a93e2a45b5e22de1ead5a10563db6bced"}
Sep 07 16:57:50.335624 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:50.335574    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8627g" podStartSLOduration=2.318303127 podStartE2EDuration="3.335558491s" totalImagesPullingTime="956.395762ms" totalInitContainerRuntime="60.859602ms" isStatefulPod=true podCreationTimestamp="2026-09-07 16:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:50.335178719 +0000 UTC m=+81.975733515" watchObservedRunningTime="2026-09-07 16:57:50.335558491 +0000 UTC m=+81.976113284"
Sep 07 16:57:50.380896 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:50.380866    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:52.228851 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:52.228742    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5859566cbd-zhczw"
Sep 07 16:57:55.393083 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.393039    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" podUID="f92a1108-d020-49da-94fb-5d85ec513dcc" containerName="registry" containerID="cri-o://ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758" gracePeriod=30
Sep 07 16:57:55.645275 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.645222    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:55.756111 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756069    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-image-registry-private-configuration\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756111 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756113    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-bound-sa-token\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756347 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756133    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f92a1108-d020-49da-94fb-5d85ec513dcc-ca-trust-extracted\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756347 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756176    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-trusted-ca\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756347 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756205    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-certificates\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756347 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756244    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-installation-pull-secrets\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756576 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756436    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756576 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756480    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llnsw\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-kube-api-access-llnsw\") pod \"f92a1108-d020-49da-94fb-5d85ec513dcc\" (UID: \"f92a1108-d020-49da-94fb-5d85ec513dcc\") "
Sep 07 16:57:55.756724 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756698    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:57:55.756786 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756754    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:57:55.756852 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756833    2545 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-certificates\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.756898 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.756858    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f92a1108-d020-49da-94fb-5d85ec513dcc-trusted-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.758930 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.758900    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-kube-api-access-llnsw" (OuterVolumeSpecName: "kube-api-access-llnsw") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "kube-api-access-llnsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:57:55.759058 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.759034    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:57:55.759129 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.759060    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:57:55.759129 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.759102    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:57:55.759197 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.759127    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:57:55.764871 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.764849    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f92a1108-d020-49da-94fb-5d85ec513dcc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f92a1108-d020-49da-94fb-5d85ec513dcc" (UID: "f92a1108-d020-49da-94fb-5d85ec513dcc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 16:57:55.857833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.857793    2545 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-installation-pull-secrets\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.857833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.857825    2545 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-registry-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.857833 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.857838    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llnsw\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-kube-api-access-llnsw\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.858063 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.857852    2545 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f92a1108-d020-49da-94fb-5d85ec513dcc-image-registry-private-configuration\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.858063 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.857866    2545 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f92a1108-d020-49da-94fb-5d85ec513dcc-bound-sa-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:55.858063 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:55.857878    2545 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f92a1108-d020-49da-94fb-5d85ec513dcc-ca-trust-extracted\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:57:56.332418 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.332383    2545 generic.go:356] "Generic (PLEG): container finished" podID="f92a1108-d020-49da-94fb-5d85ec513dcc" containerID="ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758" exitCode=0
Sep 07 16:57:56.332613 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.332427    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689df9dc99-khnxm"
Sep 07 16:57:56.332613 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.332454    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" event={"ID":"f92a1108-d020-49da-94fb-5d85ec513dcc","Type":"ContainerDied","Data":"ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758"}
Sep 07 16:57:56.332613 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.332496    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689df9dc99-khnxm" event={"ID":"f92a1108-d020-49da-94fb-5d85ec513dcc","Type":"ContainerDied","Data":"7a03764b891d2689346f4226987076b65c714fe4e3e7ab9c9dbee0951aca9798"}
Sep 07 16:57:56.332613 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.332515    2545 scope.go:117] "RemoveContainer" containerID="ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758"
Sep 07 16:57:56.340987 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.340970    2545 scope.go:117] "RemoveContainer" containerID="ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758"
Sep 07 16:57:56.341270 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:57:56.341254    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758\": container with ID starting with ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758 not found: ID does not exist" containerID="ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758"
Sep 07 16:57:56.341316 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.341276    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758"} err="failed to get container status \"ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758\": rpc error: code = NotFound desc = could not find container \"ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758\": container with ID starting with ed4da90b7893c6259281263d547dbfbc8df14ac7f01f371293577fd00f63b758 not found: ID does not exist"
Sep 07 16:57:56.364331 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.364304    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-689df9dc99-khnxm"]
Sep 07 16:57:56.366608 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.366584    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-689df9dc99-khnxm"]
Sep 07 16:57:56.886850 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:57:56.886818    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92a1108-d020-49da-94fb-5d85ec513dcc" path="/var/lib/kubelet/pods/f92a1108-d020-49da-94fb-5d85ec513dcc/volumes"
Sep 07 16:58:12.279147 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.279116    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-482vq"
Sep 07 16:58:12.674310 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.674275    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d9bdf77b4-fkmcj"]
Sep 07 16:58:12.674522 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.674509    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92a1108-d020-49da-94fb-5d85ec513dcc" containerName="registry"
Sep 07 16:58:12.674522 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.674522    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92a1108-d020-49da-94fb-5d85ec513dcc" containerName="registry"
Sep 07 16:58:12.674639 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.674580    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92a1108-d020-49da-94fb-5d85ec513dcc" containerName="registry"
Sep 07 16:58:12.749954 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.749913    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d9bdf77b4-fkmcj"]
Sep 07 16:58:12.750109 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.750010    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.755412 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.755384    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 16:58:12.755412 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.755407    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzx8d\""
Sep 07 16:58:12.755713 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.755694    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 16:58:12.755817 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.755797    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 16:58:12.756092 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.756071    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 16:58:12.756092 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.756085    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 16:58:12.756615 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.756281    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 16:58:12.756689 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.756653    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 16:58:12.760162 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.760138    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 16:58:12.878495 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878459    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-trusted-ca-bundle\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.878495 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878497    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-serving-cert\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.878717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878525    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-oauth-serving-cert\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.878717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878601    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-oauth-config\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.878717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878671    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-service-ca\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.878717 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878705    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-console-config\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.878864 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.878738    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl56m\" (UniqueName: \"kubernetes.io/projected/528863bc-471e-4033-876b-1df14f52e0a6-kube-api-access-cl56m\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.979772 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.979686    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-trusted-ca-bundle\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.979772 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.979730    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-serving-cert\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.979772 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.979757    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-oauth-serving-cert\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.979993 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.979886    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-oauth-config\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.979993 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.979959    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-service-ca\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.980071 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.980012    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-console-config\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.980123 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.980067    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl56m\" (UniqueName: \"kubernetes.io/projected/528863bc-471e-4033-876b-1df14f52e0a6-kube-api-access-cl56m\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.980637 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.980611    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-oauth-serving-cert\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.980759 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.980672    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-service-ca\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.980858 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.980835    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-trusted-ca-bundle\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.980972 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.980958    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-console-config\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.982679 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.982662    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-oauth-config\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.982877 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.982857    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-serving-cert\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:12.990638 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:12.990609    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl56m\" (UniqueName: \"kubernetes.io/projected/528863bc-471e-4033-876b-1df14f52e0a6-kube-api-access-cl56m\") pod \"console-d9bdf77b4-fkmcj\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") " pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:13.059435 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:13.059397    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:13.369854 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:13.369819    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d9bdf77b4-fkmcj"]
Sep 07 16:58:13.374172 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:58:13.374143    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528863bc_471e_4033_876b_1df14f52e0a6.slice/crio-4130f59ab8186289af4bbfac9072dfabbafd12f41fdc88f890c32bfae8b08e5a WatchSource:0}: Error finding container 4130f59ab8186289af4bbfac9072dfabbafd12f41fdc88f890c32bfae8b08e5a: Status 404 returned error can't find the container with id 4130f59ab8186289af4bbfac9072dfabbafd12f41fdc88f890c32bfae8b08e5a
Sep 07 16:58:13.392965 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:13.392939    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdf77b4-fkmcj" event={"ID":"528863bc-471e-4033-876b-1df14f52e0a6","Type":"ContainerStarted","Data":"4130f59ab8186289af4bbfac9072dfabbafd12f41fdc88f890c32bfae8b08e5a"}
Sep 07 16:58:16.406824 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:16.406786    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdf77b4-fkmcj" event={"ID":"528863bc-471e-4033-876b-1df14f52e0a6","Type":"ContainerStarted","Data":"76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e"}
Sep 07 16:58:16.425978 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:16.425927    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d9bdf77b4-fkmcj" podStartSLOduration=1.5324469170000001 podStartE2EDuration="4.425912998s" totalImagesPullingTime="2.893466081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:58:16.425610788 +0000 UTC m=+108.066165610" watchObservedRunningTime="2026-09-07 16:58:16.425912998 +0000 UTC m=+108.066467793"
Sep 07 16:58:23.059978 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:23.059921    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:23.060494 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:23.060009    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:23.064808 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:23.064786    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:58:23.435136 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:58:23.435109    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:59:22.442110 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.442033    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8486467bb6-wrtjn"]
Sep 07 16:59:22.445097 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.445075    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.455663 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.455641    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8486467bb6-wrtjn"]
Sep 07 16:59:22.479428 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479400    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f58gm\" (UniqueName: \"kubernetes.io/projected/b0021543-0957-4c35-8bd8-dfb284312f92-kube-api-access-f58gm\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.479571 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479436    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-oauth-config\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.479571 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479464    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-console-config\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.479661 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479563    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-serving-cert\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.479661 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479595    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-trusted-ca-bundle\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.479661 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479624    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-oauth-serving-cert\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.479769 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.479690    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-service-ca\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.580867 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.580829    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-serving-cert\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.580867 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.580868    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-trusted-ca-bundle\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581112 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.580898    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-oauth-serving-cert\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581112 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.580945    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-service-ca\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581112 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.580970    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f58gm\" (UniqueName: \"kubernetes.io/projected/b0021543-0957-4c35-8bd8-dfb284312f92-kube-api-access-f58gm\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581112 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.580997    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-oauth-config\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581112 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.581035    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-console-config\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581778 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.581748    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-service-ca\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.581958 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.581842    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-console-config\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.582063 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.581894    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-oauth-serving-cert\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.582063 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.581936    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-trusted-ca-bundle\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.583679 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.583653    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-serving-cert\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.583778 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.583705    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-oauth-config\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.589080 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.589053    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f58gm\" (UniqueName: \"kubernetes.io/projected/b0021543-0957-4c35-8bd8-dfb284312f92-kube-api-access-f58gm\") pod \"console-8486467bb6-wrtjn\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") " pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:22.753126 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:22.753035    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:23.025411 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:23.025384    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8486467bb6-wrtjn"]
Sep 07 16:59:23.027873 ip-10-0-128-63 kubenswrapper[2545]: W0907 16:59:23.027834    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0021543_0957_4c35_8bd8_dfb284312f92.slice/crio-6430d6a5b7f72d8ceddc2202d651cc3200dcffa9aa5a65f986bf90007ed64776 WatchSource:0}: Error finding container 6430d6a5b7f72d8ceddc2202d651cc3200dcffa9aa5a65f986bf90007ed64776: Status 404 returned error can't find the container with id 6430d6a5b7f72d8ceddc2202d651cc3200dcffa9aa5a65f986bf90007ed64776
Sep 07 16:59:23.637898 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:23.637857    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486467bb6-wrtjn" event={"ID":"b0021543-0957-4c35-8bd8-dfb284312f92","Type":"ContainerStarted","Data":"7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca"}
Sep 07 16:59:23.638265 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:23.637915    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486467bb6-wrtjn" event={"ID":"b0021543-0957-4c35-8bd8-dfb284312f92","Type":"ContainerStarted","Data":"6430d6a5b7f72d8ceddc2202d651cc3200dcffa9aa5a65f986bf90007ed64776"}
Sep 07 16:59:23.655753 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:23.655702    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8486467bb6-wrtjn" podStartSLOduration=1.6556863750000002 podStartE2EDuration="1.655686375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:59:23.65498968 +0000 UTC m=+175.295544496" watchObservedRunningTime="2026-09-07 16:59:23.655686375 +0000 UTC m=+175.296241171"
Sep 07 16:59:32.753642 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:32.753593    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:32.754037 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:32.753692    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:32.758741 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:32.758710    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:33.673527 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:33.673491    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 16:59:33.749346 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:33.749311    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d9bdf77b4-fkmcj"]
Sep 07 16:59:58.769695 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:58.769654    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d9bdf77b4-fkmcj" podUID="528863bc-471e-4033-876b-1df14f52e0a6" containerName="console" containerID="cri-o://76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e" gracePeriod=15
Sep 07 16:59:59.002919 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.002893    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:59:59.151822 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.151782    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-serving-cert\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.151822 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.151821    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-service-ca\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.152026 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.151846    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-console-config\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.152026 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.151890    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-oauth-serving-cert\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.152026 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.151969    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-oauth-config\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.152026 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.152022    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-trusted-ca-bundle\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.152206 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.152080    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl56m\" (UniqueName: \"kubernetes.io/projected/528863bc-471e-4033-876b-1df14f52e0a6-kube-api-access-cl56m\") pod \"528863bc-471e-4033-876b-1df14f52e0a6\" (UID: \"528863bc-471e-4033-876b-1df14f52e0a6\") "
Sep 07 16:59:59.152278 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.152256    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-console-config" (OuterVolumeSpecName: "console-config") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:59.152339 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.152275    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:59.152614 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.152582    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:59.152745 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.152639    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:59:59.154151 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.154128    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:59.154233 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.154171    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528863bc-471e-4033-876b-1df14f52e0a6-kube-api-access-cl56m" (OuterVolumeSpecName: "kube-api-access-cl56m") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "kube-api-access-cl56m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:59:59.154285 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.154231    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "528863bc-471e-4033-876b-1df14f52e0a6" (UID: "528863bc-471e-4033-876b-1df14f52e0a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:59:59.253057 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253007    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl56m\" (UniqueName: \"kubernetes.io/projected/528863bc-471e-4033-876b-1df14f52e0a6-kube-api-access-cl56m\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.253057 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253054    2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.253057 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253069    2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.253308 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253083    2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-console-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.253308 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253095    2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-oauth-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.253308 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253106    2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528863bc-471e-4033-876b-1df14f52e0a6-console-oauth-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.253308 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.253116    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528863bc-471e-4033-876b-1df14f52e0a6-trusted-ca-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 16:59:59.761984 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.761950    2545 generic.go:356] "Generic (PLEG): container finished" podID="528863bc-471e-4033-876b-1df14f52e0a6" containerID="76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e" exitCode=0
Sep 07 16:59:59.762133 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.761992    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdf77b4-fkmcj" event={"ID":"528863bc-471e-4033-876b-1df14f52e0a6","Type":"ContainerDied","Data":"76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e"}
Sep 07 16:59:59.762133 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.761997    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdf77b4-fkmcj"
Sep 07 16:59:59.762133 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.762029    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdf77b4-fkmcj" event={"ID":"528863bc-471e-4033-876b-1df14f52e0a6","Type":"ContainerDied","Data":"4130f59ab8186289af4bbfac9072dfabbafd12f41fdc88f890c32bfae8b08e5a"}
Sep 07 16:59:59.762133 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.762051    2545 scope.go:117] "RemoveContainer" containerID="76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e"
Sep 07 16:59:59.769933 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.769823    2545 scope.go:117] "RemoveContainer" containerID="76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e"
Sep 07 16:59:59.770250 ip-10-0-128-63 kubenswrapper[2545]: E0907 16:59:59.770142    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e\": container with ID starting with 76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e not found: ID does not exist" containerID="76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e"
Sep 07 16:59:59.770250 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.770169    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e"} err="failed to get container status \"76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e\": rpc error: code = NotFound desc = could not find container \"76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e\": container with ID starting with 76b6f88def4adbf78e4af181a483404d2640dd85b813ecc826622c375f7c513e not found: ID does not exist"
Sep 07 16:59:59.782490 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.782466    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d9bdf77b4-fkmcj"]
Sep 07 16:59:59.789524 ip-10-0-128-63 kubenswrapper[2545]: I0907 16:59:59.789498    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d9bdf77b4-fkmcj"]
Sep 07 17:00:00.886630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:00.886588    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528863bc-471e-4033-876b-1df14f52e0a6" path="/var/lib/kubelet/pods/528863bc-471e-4033-876b-1df14f52e0a6/volumes"
Sep 07 17:00:16.487403 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.487364    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"]
Sep 07 17:00:16.487808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.487634    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528863bc-471e-4033-876b-1df14f52e0a6" containerName="console"
Sep 07 17:00:16.487808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.487648    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="528863bc-471e-4033-876b-1df14f52e0a6" containerName="console"
Sep 07 17:00:16.487808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.487696    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="528863bc-471e-4033-876b-1df14f52e0a6" containerName="console"
Sep 07 17:00:16.491899 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.491882    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.494495 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.494466    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rfw57\""
Sep 07 17:00:16.494495 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.494482    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 17:00:16.495437 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.495418    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 17:00:16.501383 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.501360    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"]
Sep 07 17:00:16.569132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.569101    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.569308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.569155    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2htj\" (UniqueName: \"kubernetes.io/projected/738833d2-e423-4511-9e74-ff2291c5218e-kube-api-access-t2htj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.569308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.569178    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.669939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.669910    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.670080 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.669962    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2htj\" (UniqueName: \"kubernetes.io/projected/738833d2-e423-4511-9e74-ff2291c5218e-kube-api-access-t2htj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.670080 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.669989    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.670343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.670320    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.670400 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.670364    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.678456 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.678436    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2htj\" (UniqueName: \"kubernetes.io/projected/738833d2-e423-4511-9e74-ff2291c5218e-kube-api-access-t2htj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:16.800340 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:16.800266    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:17.072618 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:17.072588    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"]
Sep 07 17:00:17.075927 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:00:17.075897    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738833d2_e423_4511_9e74_ff2291c5218e.slice/crio-cffa34858b603c30b6395b682be6e4a37c4444adb7abff7a402a09a8c5df582f WatchSource:0}: Error finding container cffa34858b603c30b6395b682be6e4a37c4444adb7abff7a402a09a8c5df582f: Status 404 returned error can't find the container with id cffa34858b603c30b6395b682be6e4a37c4444adb7abff7a402a09a8c5df582f
Sep 07 17:00:17.827705 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:17.827666    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph" event={"ID":"738833d2-e423-4511-9e74-ff2291c5218e","Type":"ContainerStarted","Data":"cffa34858b603c30b6395b682be6e4a37c4444adb7abff7a402a09a8c5df582f"}
Sep 07 17:00:23.850396 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:23.850357    2545 generic.go:356] "Generic (PLEG): container finished" podID="738833d2-e423-4511-9e74-ff2291c5218e" containerID="35f4440c9262e371e75e8c2e0fa26267b671c1080a11824581b12ae80eb4d090" exitCode=0
Sep 07 17:00:23.850791 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:23.850448    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph" event={"ID":"738833d2-e423-4511-9e74-ff2291c5218e","Type":"ContainerDied","Data":"35f4440c9262e371e75e8c2e0fa26267b671c1080a11824581b12ae80eb4d090"}
Sep 07 17:00:26.863552 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:26.863506    2545 generic.go:356] "Generic (PLEG): container finished" podID="738833d2-e423-4511-9e74-ff2291c5218e" containerID="1d9e390440d103c492a227ac2bd1a9894286f04196a6826e1ba274dab77ffe75" exitCode=0
Sep 07 17:00:26.863998 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:26.863569    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph" event={"ID":"738833d2-e423-4511-9e74-ff2291c5218e","Type":"ContainerDied","Data":"1d9e390440d103c492a227ac2bd1a9894286f04196a6826e1ba274dab77ffe75"}
Sep 07 17:00:33.894273 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:33.894234    2545 generic.go:356] "Generic (PLEG): container finished" podID="738833d2-e423-4511-9e74-ff2291c5218e" containerID="4674fc466cec0e0f425b086f76b30682dd87714d09d33c2e0bc24f1d8b14fd14" exitCode=0
Sep 07 17:00:33.894702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:33.894280    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph" event={"ID":"738833d2-e423-4511-9e74-ff2291c5218e","Type":"ContainerDied","Data":"4674fc466cec0e0f425b086f76b30682dd87714d09d33c2e0bc24f1d8b14fd14"}
Sep 07 17:00:35.019425 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.019399    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:35.128381 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.128345    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-util\") pod \"738833d2-e423-4511-9e74-ff2291c5218e\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") "
Sep 07 17:00:35.128381 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.128388    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-bundle\") pod \"738833d2-e423-4511-9e74-ff2291c5218e\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") "
Sep 07 17:00:35.128604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.128434    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2htj\" (UniqueName: \"kubernetes.io/projected/738833d2-e423-4511-9e74-ff2291c5218e-kube-api-access-t2htj\") pod \"738833d2-e423-4511-9e74-ff2291c5218e\" (UID: \"738833d2-e423-4511-9e74-ff2291c5218e\") "
Sep 07 17:00:35.129153 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.129120    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-bundle" (OuterVolumeSpecName: "bundle") pod "738833d2-e423-4511-9e74-ff2291c5218e" (UID: "738833d2-e423-4511-9e74-ff2291c5218e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:00:35.130585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.130561    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738833d2-e423-4511-9e74-ff2291c5218e-kube-api-access-t2htj" (OuterVolumeSpecName: "kube-api-access-t2htj") pod "738833d2-e423-4511-9e74-ff2291c5218e" (UID: "738833d2-e423-4511-9e74-ff2291c5218e"). InnerVolumeSpecName "kube-api-access-t2htj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:00:35.132980 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.132950    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-util" (OuterVolumeSpecName: "util") pod "738833d2-e423-4511-9e74-ff2291c5218e" (UID: "738833d2-e423-4511-9e74-ff2291c5218e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:00:35.229745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.229659    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:00:35.229745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.229697    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/738833d2-e423-4511-9e74-ff2291c5218e-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:00:35.229745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.229707    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2htj\" (UniqueName: \"kubernetes.io/projected/738833d2-e423-4511-9e74-ff2291c5218e-kube-api-access-t2htj\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:00:35.902519 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.902486    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph" event={"ID":"738833d2-e423-4511-9e74-ff2291c5218e","Type":"ContainerDied","Data":"cffa34858b603c30b6395b682be6e4a37c4444adb7abff7a402a09a8c5df582f"}
Sep 07 17:00:35.902519 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.902501    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vzhph"
Sep 07 17:00:35.902731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:35.902529    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cffa34858b603c30b6395b682be6e4a37c4444adb7abff7a402a09a8c5df582f"
Sep 07 17:00:39.685859 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.685820    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"]
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686072    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="util"
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686083    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="util"
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686095    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="pull"
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686100    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="pull"
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686114    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="extract"
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686120    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="extract"
Sep 07 17:00:39.686199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.686159    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="738833d2-e423-4511-9e74-ff2291c5218e" containerName="extract"
Sep 07 17:00:39.689470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.689451    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.692228 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.692208    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hj4v4\""
Sep 07 17:00:39.692331 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.692234    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 07 17:00:39.692697 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.692684    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:00:39.701367 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.701343    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"]
Sep 07 17:00:39.762483 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.762445    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72vg\" (UniqueName: \"kubernetes.io/projected/e2bff97d-344e-4ffd-80d6-92abe73879f4-kube-api-access-x72vg\") pod \"cert-manager-operator-controller-manager-55c444bf86-phgfp\" (UID: \"e2bff97d-344e-4ffd-80d6-92abe73879f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.762657 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.762501    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bff97d-344e-4ffd-80d6-92abe73879f4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-phgfp\" (UID: \"e2bff97d-344e-4ffd-80d6-92abe73879f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.863404 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.863360    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bff97d-344e-4ffd-80d6-92abe73879f4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-phgfp\" (UID: \"e2bff97d-344e-4ffd-80d6-92abe73879f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.863513 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.863424    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72vg\" (UniqueName: \"kubernetes.io/projected/e2bff97d-344e-4ffd-80d6-92abe73879f4-kube-api-access-x72vg\") pod \"cert-manager-operator-controller-manager-55c444bf86-phgfp\" (UID: \"e2bff97d-344e-4ffd-80d6-92abe73879f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.863761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.863740    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bff97d-344e-4ffd-80d6-92abe73879f4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-phgfp\" (UID: \"e2bff97d-344e-4ffd-80d6-92abe73879f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.872406 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.872387    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72vg\" (UniqueName: \"kubernetes.io/projected/e2bff97d-344e-4ffd-80d6-92abe73879f4-kube-api-access-x72vg\") pod \"cert-manager-operator-controller-manager-55c444bf86-phgfp\" (UID: \"e2bff97d-344e-4ffd-80d6-92abe73879f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:39.998498 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:39.998424    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"
Sep 07 17:00:40.271052 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:40.270976    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp"]
Sep 07 17:00:40.276298 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:00:40.276268    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bff97d_344e_4ffd_80d6_92abe73879f4.slice/crio-2888c7da5312dfd771c7cee714c77c800a7a2d2be7b87e0f7c50043cee63f6b8 WatchSource:0}: Error finding container 2888c7da5312dfd771c7cee714c77c800a7a2d2be7b87e0f7c50043cee63f6b8: Status 404 returned error can't find the container with id 2888c7da5312dfd771c7cee714c77c800a7a2d2be7b87e0f7c50043cee63f6b8
Sep 07 17:00:40.920589 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:40.920554    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp" event={"ID":"e2bff97d-344e-4ffd-80d6-92abe73879f4","Type":"ContainerStarted","Data":"2888c7da5312dfd771c7cee714c77c800a7a2d2be7b87e0f7c50043cee63f6b8"}
Sep 07 17:00:42.930119 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:42.930086    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp" event={"ID":"e2bff97d-344e-4ffd-80d6-92abe73879f4","Type":"ContainerStarted","Data":"b91177f2f44bbe628ff621457e96361025bdbe6ffb6e08f9c49afcf11c7414b2"}
Sep 07 17:00:42.952732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:42.952679    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-phgfp" podStartSLOduration=2.214748343 podStartE2EDuration="3.95266621s" totalImagesPullingTime="1.737917867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:00:42.950529126 +0000 UTC m=+254.591083942" watchObservedRunningTime="2026-09-07 17:00:42.95266621 +0000 UTC m=+254.593221006"
Sep 07 17:00:44.219044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.219008    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"]
Sep 07 17:00:44.225823 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.225792    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.229176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.229155    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 17:00:44.229176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.229165    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rfw57\""
Sep 07 17:00:44.230137 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.230122    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 17:00:44.236968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.236935    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"]
Sep 07 17:00:44.299521 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.299490    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.299693 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.299569    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p8fg\" (UniqueName: \"kubernetes.io/projected/46ea1235-1d35-4a77-ba82-bdb9c350b485-kube-api-access-8p8fg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.299693 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.299603    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.400832 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.400795    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p8fg\" (UniqueName: \"kubernetes.io/projected/46ea1235-1d35-4a77-ba82-bdb9c350b485-kube-api-access-8p8fg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.400969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.400843    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.400969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.400875    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.401216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.401200    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.401264 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.401246    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.410133 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.410108    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p8fg\" (UniqueName: \"kubernetes.io/projected/46ea1235-1d35-4a77-ba82-bdb9c350b485-kube-api-access-8p8fg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.534901 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.534825    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:44.802621 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.802532    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"]
Sep 07 17:00:44.805522 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:00:44.805496    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ea1235_1d35_4a77_ba82_bdb9c350b485.slice/crio-89c72d4075ef3bcbf430b858d6bd8a411136af71d7abc527183a9d80c78e4287 WatchSource:0}: Error finding container 89c72d4075ef3bcbf430b858d6bd8a411136af71d7abc527183a9d80c78e4287: Status 404 returned error can't find the container with id 89c72d4075ef3bcbf430b858d6bd8a411136af71d7abc527183a9d80c78e4287
Sep 07 17:00:44.938935 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.938904    2545 generic.go:356] "Generic (PLEG): container finished" podID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerID="82d8792ffe69cf28da67d8fad70cafcc68b4c573492d80cff3e41f06e72083e5" exitCode=0
Sep 07 17:00:44.939047 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.938976    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg" event={"ID":"46ea1235-1d35-4a77-ba82-bdb9c350b485","Type":"ContainerDied","Data":"82d8792ffe69cf28da67d8fad70cafcc68b4c573492d80cff3e41f06e72083e5"}
Sep 07 17:00:44.939047 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:44.939023    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg" event={"ID":"46ea1235-1d35-4a77-ba82-bdb9c350b485","Type":"ContainerStarted","Data":"89c72d4075ef3bcbf430b858d6bd8a411136af71d7abc527183a9d80c78e4287"}
Sep 07 17:00:47.953132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:47.953099    2545 generic.go:356] "Generic (PLEG): container finished" podID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerID="28823491bd06be177fd2c8d2e0be635f1542b17fc6c2303691a763d32ac47e91" exitCode=0
Sep 07 17:00:47.953563 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:47.953140    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg" event={"ID":"46ea1235-1d35-4a77-ba82-bdb9c350b485","Type":"ContainerDied","Data":"28823491bd06be177fd2c8d2e0be635f1542b17fc6c2303691a763d32ac47e91"}
Sep 07 17:00:48.959092 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:48.959058    2545 generic.go:356] "Generic (PLEG): container finished" podID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerID="d6ee04bf90d937126602644ef64905a156c05b8b51f685c00450febb310e3273" exitCode=0
Sep 07 17:00:48.959480 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:48.959107    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg" event={"ID":"46ea1235-1d35-4a77-ba82-bdb9c350b485","Type":"ContainerDied","Data":"d6ee04bf90d937126602644ef64905a156c05b8b51f685c00450febb310e3273"}
Sep 07 17:00:50.082015 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.081991    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:50.250522 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.250442    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-util\") pod \"46ea1235-1d35-4a77-ba82-bdb9c350b485\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") "
Sep 07 17:00:50.250522 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.250491    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-bundle\") pod \"46ea1235-1d35-4a77-ba82-bdb9c350b485\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") "
Sep 07 17:00:50.250727 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.250597    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p8fg\" (UniqueName: \"kubernetes.io/projected/46ea1235-1d35-4a77-ba82-bdb9c350b485-kube-api-access-8p8fg\") pod \"46ea1235-1d35-4a77-ba82-bdb9c350b485\" (UID: \"46ea1235-1d35-4a77-ba82-bdb9c350b485\") "
Sep 07 17:00:50.250899 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.250875    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-bundle" (OuterVolumeSpecName: "bundle") pod "46ea1235-1d35-4a77-ba82-bdb9c350b485" (UID: "46ea1235-1d35-4a77-ba82-bdb9c350b485"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:00:50.252567 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.252518    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46ea1235-1d35-4a77-ba82-bdb9c350b485-kube-api-access-8p8fg" (OuterVolumeSpecName: "kube-api-access-8p8fg") pod "46ea1235-1d35-4a77-ba82-bdb9c350b485" (UID: "46ea1235-1d35-4a77-ba82-bdb9c350b485"). InnerVolumeSpecName "kube-api-access-8p8fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:00:50.255301 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.255267    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-util" (OuterVolumeSpecName: "util") pod "46ea1235-1d35-4a77-ba82-bdb9c350b485" (UID: "46ea1235-1d35-4a77-ba82-bdb9c350b485"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:00:50.351396 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.351364    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:00:50.351396 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.351388    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p8fg\" (UniqueName: \"kubernetes.io/projected/46ea1235-1d35-4a77-ba82-bdb9c350b485-kube-api-access-8p8fg\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:00:50.351396 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.351399    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46ea1235-1d35-4a77-ba82-bdb9c350b485-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:00:50.969106 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.969077    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg"
Sep 07 17:00:50.969106 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.969096    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvdcg" event={"ID":"46ea1235-1d35-4a77-ba82-bdb9c350b485","Type":"ContainerDied","Data":"89c72d4075ef3bcbf430b858d6bd8a411136af71d7abc527183a9d80c78e4287"}
Sep 07 17:00:50.969285 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:50.969138    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89c72d4075ef3bcbf430b858d6bd8a411136af71d7abc527183a9d80c78e4287"
Sep 07 17:00:54.147029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147000    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9dhj9"]
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147274    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="pull"
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147285    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="pull"
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147294    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="util"
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147303    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="util"
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147317    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="extract"
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147323    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="extract"
Sep 07 17:00:54.147398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.147365    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ea1235-1d35-4a77-ba82-bdb9c350b485" containerName="extract"
Sep 07 17:00:54.150069 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.150053    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.152780 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.152756    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 17:00:54.152894 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.152802    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 17:00:54.153836 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.153819    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jbgld\""
Sep 07 17:00:54.162117 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.162096    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9dhj9"]
Sep 07 17:00:54.277875 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.277833    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a19340e0-8e9b-4f45-9816-35c73008ca48-bound-sa-token\") pod \"cert-manager-55b4d954d5-9dhj9\" (UID: \"a19340e0-8e9b-4f45-9816-35c73008ca48\") " pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.278052 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.277888    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbz9b\" (UniqueName: \"kubernetes.io/projected/a19340e0-8e9b-4f45-9816-35c73008ca48-kube-api-access-zbz9b\") pod \"cert-manager-55b4d954d5-9dhj9\" (UID: \"a19340e0-8e9b-4f45-9816-35c73008ca48\") " pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.378913 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.378878    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbz9b\" (UniqueName: \"kubernetes.io/projected/a19340e0-8e9b-4f45-9816-35c73008ca48-kube-api-access-zbz9b\") pod \"cert-manager-55b4d954d5-9dhj9\" (UID: \"a19340e0-8e9b-4f45-9816-35c73008ca48\") " pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.379047 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.378933    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a19340e0-8e9b-4f45-9816-35c73008ca48-bound-sa-token\") pod \"cert-manager-55b4d954d5-9dhj9\" (UID: \"a19340e0-8e9b-4f45-9816-35c73008ca48\") " pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.388372 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.388344    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a19340e0-8e9b-4f45-9816-35c73008ca48-bound-sa-token\") pod \"cert-manager-55b4d954d5-9dhj9\" (UID: \"a19340e0-8e9b-4f45-9816-35c73008ca48\") " pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.388497 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.388407    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbz9b\" (UniqueName: \"kubernetes.io/projected/a19340e0-8e9b-4f45-9816-35c73008ca48-kube-api-access-zbz9b\") pod \"cert-manager-55b4d954d5-9dhj9\" (UID: \"a19340e0-8e9b-4f45-9816-35c73008ca48\") " pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.459415 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.459346    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9dhj9"
Sep 07 17:00:54.730745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.730719    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9dhj9"]
Sep 07 17:00:54.733047 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:00:54.733018    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda19340e0_8e9b_4f45_9816_35c73008ca48.slice/crio-f98a3f23e75df8322e8627cbd414bba2d6e045909186e899ef2ec98f083d3ce9 WatchSource:0}: Error finding container f98a3f23e75df8322e8627cbd414bba2d6e045909186e899ef2ec98f083d3ce9: Status 404 returned error can't find the container with id f98a3f23e75df8322e8627cbd414bba2d6e045909186e899ef2ec98f083d3ce9
Sep 07 17:00:54.985400 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:54.985317    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9dhj9" event={"ID":"a19340e0-8e9b-4f45-9816-35c73008ca48","Type":"ContainerStarted","Data":"f98a3f23e75df8322e8627cbd414bba2d6e045909186e899ef2ec98f083d3ce9"}
Sep 07 17:00:56.769336 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.769299    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"]
Sep 07 17:00:56.772556 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.772512    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:56.775063 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.775039    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 07 17:00:56.776097 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.776052    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bkm6l\""
Sep 07 17:00:56.776097 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.776065    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:00:56.783640 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.783615    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"]
Sep 07 17:00:56.898920 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.898882    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skcm\" (UniqueName: \"kubernetes.io/projected/be1a58dc-b90c-4a2b-9cc3-a100121b2fb5-kube-api-access-6skcm\") pod \"openshift-lws-operator-fd8ccff4c-lkz5v\" (UID: \"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:56.899096 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.898970    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be1a58dc-b90c-4a2b-9cc3-a100121b2fb5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkz5v\" (UID: \"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:56.999857 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.999820    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6skcm\" (UniqueName: \"kubernetes.io/projected/be1a58dc-b90c-4a2b-9cc3-a100121b2fb5-kube-api-access-6skcm\") pod \"openshift-lws-operator-fd8ccff4c-lkz5v\" (UID: \"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:57.000010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:56.999884    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be1a58dc-b90c-4a2b-9cc3-a100121b2fb5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkz5v\" (UID: \"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:57.000262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:57.000240    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be1a58dc-b90c-4a2b-9cc3-a100121b2fb5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkz5v\" (UID: \"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:57.008505 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:57.008474    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skcm\" (UniqueName: \"kubernetes.io/projected/be1a58dc-b90c-4a2b-9cc3-a100121b2fb5-kube-api-access-6skcm\") pod \"openshift-lws-operator-fd8ccff4c-lkz5v\" (UID: \"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:57.084616 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:57.084575    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"
Sep 07 17:00:58.000073 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:58.000038    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9dhj9" event={"ID":"a19340e0-8e9b-4f45-9816-35c73008ca48","Type":"ContainerStarted","Data":"600ec0541074b565d2f3a74a5c8c22e64417ecf7846b301b6141c8fc7d2dcc6a"}
Sep 07 17:00:58.018016 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:58.017968    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9dhj9" podStartSLOduration=0.852480627 podStartE2EDuration="4.017952421s" totalImagesPullingTime="3.165471794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:00:58.016841384 +0000 UTC m=+269.657396190" watchObservedRunningTime="2026-09-07 17:00:58.017952421 +0000 UTC m=+269.658507217"
Sep 07 17:00:58.106802 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:58.106727    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v"]
Sep 07 17:00:58.109405 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:00:58.109372    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe1a58dc_b90c_4a2b_9cc3_a100121b2fb5.slice/crio-15b77fc634318caf6d494152e74cdad63eda0b3196cc87d2e69eed2fe592d05e WatchSource:0}: Error finding container 15b77fc634318caf6d494152e74cdad63eda0b3196cc87d2e69eed2fe592d05e: Status 404 returned error can't find the container with id 15b77fc634318caf6d494152e74cdad63eda0b3196cc87d2e69eed2fe592d05e
Sep 07 17:00:59.005607 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:00:59.005566    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v" event={"ID":"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5","Type":"ContainerStarted","Data":"15b77fc634318caf6d494152e74cdad63eda0b3196cc87d2e69eed2fe592d05e"}
Sep 07 17:01:09.050200 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:09.050102    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v" event={"ID":"be1a58dc-b90c-4a2b-9cc3-a100121b2fb5","Type":"ContainerStarted","Data":"e36f22847ea259d8d2d6c62d5f5df941b57f91db0efc187236ce18a7a2ca3f31"}
Sep 07 17:01:09.068523 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:09.068475    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkz5v" podStartSLOduration=2.439730743 podStartE2EDuration="13.068459989s" totalImagesPullingTime="10.628729246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:09.067632076 +0000 UTC m=+280.708186873" watchObservedRunningTime="2026-09-07 17:01:09.068459989 +0000 UTC m=+280.709014784"
Sep 07 17:01:11.429337 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.429301    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"]
Sep 07 17:01:11.431563 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.431527    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.434354 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.434321    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rfw57\""
Sep 07 17:01:11.434476 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.434372    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 17:01:11.435110 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.435092    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 17:01:11.440570 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.440530    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"]
Sep 07 17:01:11.614592 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.614521    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cwpm\" (UniqueName: \"kubernetes.io/projected/04e2cebd-238d-47f9-a4d0-00213758ae2b-kube-api-access-5cwpm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.614762 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.614635    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.614762 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.614687    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.715588 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.715495    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.715588 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.715576    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.715761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.715612    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cwpm\" (UniqueName: \"kubernetes.io/projected/04e2cebd-238d-47f9-a4d0-00213758ae2b-kube-api-access-5cwpm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.715991 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.715962    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.715991 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.715985    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.724686 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.724662    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cwpm\" (UniqueName: \"kubernetes.io/projected/04e2cebd-238d-47f9-a4d0-00213758ae2b-kube-api-access-5cwpm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:11.741422 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:11.741397    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:12.015139 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:12.014984    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"]
Sep 07 17:01:12.017594 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:01:12.017564    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e2cebd_238d_47f9_a4d0_00213758ae2b.slice/crio-1fd83c23150570d1e5d012d6cffbac74fb4abba8f5c7e7ae7740879607988f99 WatchSource:0}: Error finding container 1fd83c23150570d1e5d012d6cffbac74fb4abba8f5c7e7ae7740879607988f99: Status 404 returned error can't find the container with id 1fd83c23150570d1e5d012d6cffbac74fb4abba8f5c7e7ae7740879607988f99
Sep 07 17:01:12.062910 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:12.062887    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz" event={"ID":"04e2cebd-238d-47f9-a4d0-00213758ae2b","Type":"ContainerStarted","Data":"1fd83c23150570d1e5d012d6cffbac74fb4abba8f5c7e7ae7740879607988f99"}
Sep 07 17:01:13.072105 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:13.072068    2545 generic.go:356] "Generic (PLEG): container finished" podID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerID="64d5c4abbcc878711bc9e7c45f41eba47ad3b81903651ec62a094f119c097c6f" exitCode=0
Sep 07 17:01:13.072484 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:13.072144    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz" event={"ID":"04e2cebd-238d-47f9-a4d0-00213758ae2b","Type":"ContainerDied","Data":"64d5c4abbcc878711bc9e7c45f41eba47ad3b81903651ec62a094f119c097c6f"}
Sep 07 17:01:14.078528 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:14.078488    2545 generic.go:356] "Generic (PLEG): container finished" podID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerID="d9bb4c591a0fad2eedebeaced80d0c9422265279761170322e87632db856c841" exitCode=0
Sep 07 17:01:14.079009 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:14.078576    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz" event={"ID":"04e2cebd-238d-47f9-a4d0-00213758ae2b","Type":"ContainerDied","Data":"d9bb4c591a0fad2eedebeaced80d0c9422265279761170322e87632db856c841"}
Sep 07 17:01:15.084675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:15.084635    2545 generic.go:356] "Generic (PLEG): container finished" podID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerID="1cc81c686c1ec48d254cd99ad260eafe6ed6c3acdcf2cfb142a19842358ec893" exitCode=0
Sep 07 17:01:15.085084 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:15.084698    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz" event={"ID":"04e2cebd-238d-47f9-a4d0-00213758ae2b","Type":"ContainerDied","Data":"1cc81c686c1ec48d254cd99ad260eafe6ed6c3acdcf2cfb142a19842358ec893"}
Sep 07 17:01:16.215157 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.215132    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:16.246524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.246499    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-util\") pod \"04e2cebd-238d-47f9-a4d0-00213758ae2b\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") "
Sep 07 17:01:16.246676 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.246545    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-bundle\") pod \"04e2cebd-238d-47f9-a4d0-00213758ae2b\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") "
Sep 07 17:01:16.246676 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.246582    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cwpm\" (UniqueName: \"kubernetes.io/projected/04e2cebd-238d-47f9-a4d0-00213758ae2b-kube-api-access-5cwpm\") pod \"04e2cebd-238d-47f9-a4d0-00213758ae2b\" (UID: \"04e2cebd-238d-47f9-a4d0-00213758ae2b\") "
Sep 07 17:01:16.247249 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.247221    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-bundle" (OuterVolumeSpecName: "bundle") pod "04e2cebd-238d-47f9-a4d0-00213758ae2b" (UID: "04e2cebd-238d-47f9-a4d0-00213758ae2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:01:16.248766 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.248736    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e2cebd-238d-47f9-a4d0-00213758ae2b-kube-api-access-5cwpm" (OuterVolumeSpecName: "kube-api-access-5cwpm") pod "04e2cebd-238d-47f9-a4d0-00213758ae2b" (UID: "04e2cebd-238d-47f9-a4d0-00213758ae2b"). InnerVolumeSpecName "kube-api-access-5cwpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:01:16.251935 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.251915    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-util" (OuterVolumeSpecName: "util") pod "04e2cebd-238d-47f9-a4d0-00213758ae2b" (UID: "04e2cebd-238d-47f9-a4d0-00213758ae2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:01:16.347266 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.347182    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:01:16.347266 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.347215    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e2cebd-238d-47f9-a4d0-00213758ae2b-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:01:16.347266 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:16.347224    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cwpm\" (UniqueName: \"kubernetes.io/projected/04e2cebd-238d-47f9-a4d0-00213758ae2b-kube-api-access-5cwpm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:01:17.095597 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:17.095560    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz" event={"ID":"04e2cebd-238d-47f9-a4d0-00213758ae2b","Type":"ContainerDied","Data":"1fd83c23150570d1e5d012d6cffbac74fb4abba8f5c7e7ae7740879607988f99"}
Sep 07 17:01:17.095597 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:17.095588    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4tcfz"
Sep 07 17:01:17.095774 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:17.095618    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fd83c23150570d1e5d012d6cffbac74fb4abba8f5c7e7ae7740879607988f99"
Sep 07 17:01:25.833422 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833387    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"]
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833660    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="pull"
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833672    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="pull"
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833680    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="extract"
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833686    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="extract"
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833703    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="util"
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833709    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="util"
Sep 07 17:01:25.833808 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.833751    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e2cebd-238d-47f9-a4d0-00213758ae2b" containerName="extract"
Sep 07 17:01:25.836661 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.836635    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:25.851244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.851219    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 17:01:25.851371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.851245    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rfw57\""
Sep 07 17:01:25.851441 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.851427    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 17:01:25.859965 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.859942    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"]
Sep 07 17:01:25.915935 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.915905    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:25.916090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.915966    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:25.916090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:25.916022    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9j9q\" (UniqueName: \"kubernetes.io/projected/21e97656-6f20-437b-a53b-96bee6af91f1-kube-api-access-t9j9q\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.017289 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.017245    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.017460 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.017300    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9j9q\" (UniqueName: \"kubernetes.io/projected/21e97656-6f20-437b-a53b-96bee6af91f1-kube-api-access-t9j9q\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.017460 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.017334    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.017743 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.017725    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.017786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.017724    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.033029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.032998    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9j9q\" (UniqueName: \"kubernetes.io/projected/21e97656-6f20-437b-a53b-96bee6af91f1-kube-api-access-t9j9q\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.144734 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.144633    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:26.451696 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.451669    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"]
Sep 07 17:01:26.454218 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:01:26.454192    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e97656_6f20_437b_a53b_96bee6af91f1.slice/crio-440e2e0037c04ac104875813b181395b01ccd9b5c31bd942c78aca7574a10226 WatchSource:0}: Error finding container 440e2e0037c04ac104875813b181395b01ccd9b5c31bd942c78aca7574a10226: Status 404 returned error can't find the container with id 440e2e0037c04ac104875813b181395b01ccd9b5c31bd942c78aca7574a10226
Sep 07 17:01:26.518401 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.518365    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"]
Sep 07 17:01:26.522142 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.522118    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.525855 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.525836    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5bmt\""
Sep 07 17:01:26.526365 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.526347    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 07 17:01:26.526448 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.526430    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 07 17:01:26.527394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.527372    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 07 17:01:26.550955 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.550924    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"]
Sep 07 17:01:26.622795 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.622766    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-metrics-cert\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.622973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.622816    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-cert\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.622973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.622837    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-manager-config\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.622973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.622926    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fxsg\" (UniqueName: \"kubernetes.io/projected/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-kube-api-access-9fxsg\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.723862 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.723777    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-cert\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.723862 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.723814    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-manager-config\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.723862 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.723838    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fxsg\" (UniqueName: \"kubernetes.io/projected/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-kube-api-access-9fxsg\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.724111 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.723970    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-metrics-cert\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.724499 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.724470    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-manager-config\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.726277 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.726242    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-cert\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.726277 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.726264    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-metrics-cert\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.737902 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.737883    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fxsg\" (UniqueName: \"kubernetes.io/projected/2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f-kube-api-access-9fxsg\") pod \"lws-controller-manager-74c754dcfc-xbb6l\" (UID: \"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f\") " pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:26.831731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:26.831697    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:27.115457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:27.115427    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"]
Sep 07 17:01:27.119020 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:01:27.118990    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2167b5a0_d9d9_4a4a_b8c5_031f3cdb407f.slice/crio-4ade7daf978050b301fa431aced111e38550bfa14e34848103bb88dd613a3294 WatchSource:0}: Error finding container 4ade7daf978050b301fa431aced111e38550bfa14e34848103bb88dd613a3294: Status 404 returned error can't find the container with id 4ade7daf978050b301fa431aced111e38550bfa14e34848103bb88dd613a3294
Sep 07 17:01:27.136438 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:27.136413    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l" event={"ID":"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f","Type":"ContainerStarted","Data":"4ade7daf978050b301fa431aced111e38550bfa14e34848103bb88dd613a3294"}
Sep 07 17:01:27.137822 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:27.137801    2545 generic.go:356] "Generic (PLEG): container finished" podID="21e97656-6f20-437b-a53b-96bee6af91f1" containerID="497ebc15afcdc6f8ad20eaebb06b7ef8dcd0b03c9f16a5a46107dc023153d879" exitCode=0
Sep 07 17:01:27.137930 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:27.137894    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2" event={"ID":"21e97656-6f20-437b-a53b-96bee6af91f1","Type":"ContainerDied","Data":"497ebc15afcdc6f8ad20eaebb06b7ef8dcd0b03c9f16a5a46107dc023153d879"}
Sep 07 17:01:27.137979 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:27.137939    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2" event={"ID":"21e97656-6f20-437b-a53b-96bee6af91f1","Type":"ContainerStarted","Data":"440e2e0037c04ac104875813b181395b01ccd9b5c31bd942c78aca7574a10226"}
Sep 07 17:01:28.022280 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.022240    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"]
Sep 07 17:01:28.025693 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.025670    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.029291 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.029259    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 17:01:28.029425 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.029405    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 17:01:28.029694 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.029676    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\""
Sep 07 17:01:28.029785 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.029699    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 17:01:28.029842 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.029804    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 17:01:28.076779 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.076745    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"]
Sep 07 17:01:28.136037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.135954    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0f248fd-499a-4ecc-a6f0-710b90e8c972-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.136506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.136030    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0f248fd-499a-4ecc-a6f0-710b90e8c972-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.136506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.136070    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0f248fd-499a-4ecc-a6f0-710b90e8c972-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.136506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.136101    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0f248fd-499a-4ecc-a6f0-710b90e8c972-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.136506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.136122    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjt6\" (UniqueName: \"kubernetes.io/projected/b0f248fd-499a-4ecc-a6f0-710b90e8c972-kube-api-access-8fjt6\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.145965 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.145933    2545 generic.go:356] "Generic (PLEG): container finished" podID="21e97656-6f20-437b-a53b-96bee6af91f1" containerID="8411d22b3d7450562a08eca8ea13dbedfb08f0f163885e636e4431b20f4dd111" exitCode=0
Sep 07 17:01:28.146128 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.146012    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2" event={"ID":"21e97656-6f20-437b-a53b-96bee6af91f1","Type":"ContainerDied","Data":"8411d22b3d7450562a08eca8ea13dbedfb08f0f163885e636e4431b20f4dd111"}
Sep 07 17:01:28.236811 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.236775    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0f248fd-499a-4ecc-a6f0-710b90e8c972-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.236985 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.236846    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0f248fd-499a-4ecc-a6f0-710b90e8c972-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.236985 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.236926    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0f248fd-499a-4ecc-a6f0-710b90e8c972-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.236985 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.236947    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0f248fd-499a-4ecc-a6f0-710b90e8c972-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.236985 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.236972    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjt6\" (UniqueName: \"kubernetes.io/projected/b0f248fd-499a-4ecc-a6f0-710b90e8c972-kube-api-access-8fjt6\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.237634 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.237566    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0f248fd-499a-4ecc-a6f0-710b90e8c972-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.239451 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.239428    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0f248fd-499a-4ecc-a6f0-710b90e8c972-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.240132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.240106    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0f248fd-499a-4ecc-a6f0-710b90e8c972-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.240216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.240196    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0f248fd-499a-4ecc-a6f0-710b90e8c972-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.248292 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.248264    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjt6\" (UniqueName: \"kubernetes.io/projected/b0f248fd-499a-4ecc-a6f0-710b90e8c972-kube-api-access-8fjt6\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-qq962\" (UID: \"b0f248fd-499a-4ecc-a6f0-710b90e8c972\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.335144 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.335111    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:28.634261 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.634234    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"]
Sep 07 17:01:28.962133 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:01:28.961978    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f248fd_499a_4ecc_a6f0_710b90e8c972.slice/crio-2a9949eb640cb6ba6993c575b3a44f004cb26c037fc162a2ce6afad62ccca729 WatchSource:0}: Error finding container 2a9949eb640cb6ba6993c575b3a44f004cb26c037fc162a2ce6afad62ccca729: Status 404 returned error can't find the container with id 2a9949eb640cb6ba6993c575b3a44f004cb26c037fc162a2ce6afad62ccca729
Sep 07 17:01:28.989205 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:28.989185    2545 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 17:01:29.152089 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:29.152039    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l" event={"ID":"2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f","Type":"ContainerStarted","Data":"03a9d6b6a2dd3939a259db9838fad486e6f356a25f0b72c2e1308316c6b33014"}
Sep 07 17:01:29.152565 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:29.152202    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:29.154158 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:29.154129    2545 generic.go:356] "Generic (PLEG): container finished" podID="21e97656-6f20-437b-a53b-96bee6af91f1" containerID="ffdd328136b5a228dabd72de3eccb39c2c45e67f91713b26b15ddb88e9f49d96" exitCode=0
Sep 07 17:01:29.154312 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:29.154206    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2" event={"ID":"21e97656-6f20-437b-a53b-96bee6af91f1","Type":"ContainerDied","Data":"ffdd328136b5a228dabd72de3eccb39c2c45e67f91713b26b15ddb88e9f49d96"}
Sep 07 17:01:29.155397 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:29.155373    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962" event={"ID":"b0f248fd-499a-4ecc-a6f0-710b90e8c972","Type":"ContainerStarted","Data":"2a9949eb640cb6ba6993c575b3a44f004cb26c037fc162a2ce6afad62ccca729"}
Sep 07 17:01:29.180222 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:29.180159    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l" podStartSLOduration=1.278636147 podStartE2EDuration="3.180140944s" totalImagesPullingTime="1.901504797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:29.178618214 +0000 UTC m=+300.819173037" watchObservedRunningTime="2026-09-07 17:01:29.180140944 +0000 UTC m=+300.820695741"
Sep 07 17:01:31.772607 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.772580    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:31.869893 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.869871    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-bundle\") pod \"21e97656-6f20-437b-a53b-96bee6af91f1\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") "
Sep 07 17:01:31.869990 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.869935    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9j9q\" (UniqueName: \"kubernetes.io/projected/21e97656-6f20-437b-a53b-96bee6af91f1-kube-api-access-t9j9q\") pod \"21e97656-6f20-437b-a53b-96bee6af91f1\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") "
Sep 07 17:01:31.869990 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.869969    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-util\") pod \"21e97656-6f20-437b-a53b-96bee6af91f1\" (UID: \"21e97656-6f20-437b-a53b-96bee6af91f1\") "
Sep 07 17:01:31.870648 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.870623    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-bundle" (OuterVolumeSpecName: "bundle") pod "21e97656-6f20-437b-a53b-96bee6af91f1" (UID: "21e97656-6f20-437b-a53b-96bee6af91f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:01:31.871936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.871903    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e97656-6f20-437b-a53b-96bee6af91f1-kube-api-access-t9j9q" (OuterVolumeSpecName: "kube-api-access-t9j9q") pod "21e97656-6f20-437b-a53b-96bee6af91f1" (UID: "21e97656-6f20-437b-a53b-96bee6af91f1"). InnerVolumeSpecName "kube-api-access-t9j9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:01:31.875116 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.875078    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-util" (OuterVolumeSpecName: "util") pod "21e97656-6f20-437b-a53b-96bee6af91f1" (UID: "21e97656-6f20-437b-a53b-96bee6af91f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:01:31.971207 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.971173    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:01:31.971207 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.971199    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e97656-6f20-437b-a53b-96bee6af91f1-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:01:31.971207 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:31.971208    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9j9q\" (UniqueName: \"kubernetes.io/projected/21e97656-6f20-437b-a53b-96bee6af91f1-kube-api-access-t9j9q\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:01:32.172425 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:32.172384    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962" event={"ID":"b0f248fd-499a-4ecc-a6f0-710b90e8c972","Type":"ContainerStarted","Data":"c3e42821a495a89149fc1bdb823d9660a4acdc753fdc02ce7218ca9f30022948"}
Sep 07 17:01:32.174344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:32.174315    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2" event={"ID":"21e97656-6f20-437b-a53b-96bee6af91f1","Type":"ContainerDied","Data":"440e2e0037c04ac104875813b181395b01ccd9b5c31bd942c78aca7574a10226"}
Sep 07 17:01:32.174344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:32.174340    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0stpt2"
Sep 07 17:01:32.174502 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:32.174359    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="440e2e0037c04ac104875813b181395b01ccd9b5c31bd942c78aca7574a10226"
Sep 07 17:01:33.180340 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:33.180296    2545 generic.go:356] "Generic (PLEG): container finished" podID="b0f248fd-499a-4ecc-a6f0-710b90e8c972" containerID="c3e42821a495a89149fc1bdb823d9660a4acdc753fdc02ce7218ca9f30022948" exitCode=0
Sep 07 17:01:33.180773 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:33.180404    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962" event={"ID":"b0f248fd-499a-4ecc-a6f0-710b90e8c972","Type":"ContainerDied","Data":"c3e42821a495a89149fc1bdb823d9660a4acdc753fdc02ce7218ca9f30022948"}
Sep 07 17:01:33.180821 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:33.180809    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:01:34.187318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:34.187280    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962" event={"ID":"b0f248fd-499a-4ecc-a6f0-710b90e8c972","Type":"ContainerStarted","Data":"275a0b32fa197a0b8ee7f72abd0109a4d349c353827db8b6ba3ebd1ab7f417c5"}
Sep 07 17:01:34.187814 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:34.187404    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:34.213416 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:34.213357    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962" podStartSLOduration=2.854897564 podStartE2EDuration="7.213341143s" totalImagesPullingTime="3.287895153s" totalInitContainerRuntime="1.070548426s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:34.21218479 +0000 UTC m=+305.852739586" watchObservedRunningTime="2026-09-07 17:01:34.213341143 +0000 UTC m=+305.853896018"
Sep 07 17:01:40.164245 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:40.164213    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74c754dcfc-xbb6l"
Sep 07 17:01:45.193765 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:45.193729    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-qq962"
Sep 07 17:01:59.434410 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434376    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qxmb"]
Sep 07 17:01:59.434792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434682    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="util"
Sep 07 17:01:59.434792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434695    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="util"
Sep 07 17:01:59.434792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434722    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="extract"
Sep 07 17:01:59.434792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434728    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="extract"
Sep 07 17:01:59.434792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434743    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="pull"
Sep 07 17:01:59.434792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434748    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="pull"
Sep 07 17:01:59.434979 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.434798    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e97656-6f20-437b-a53b-96bee6af91f1" containerName="extract"
Sep 07 17:01:59.437709 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.437689    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:01:59.439996 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.439976    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 07 17:01:59.447991 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.447966    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qxmb"]
Sep 07 17:01:59.588334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.588296    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwpl\" (UniqueName: \"kubernetes.io/projected/8e4868c5-3b08-4c75-961e-0a85785ca09b-kube-api-access-sxwpl\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:01:59.588334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.588346    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4868c5-3b08-4c75-961e-0a85785ca09b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:01:59.689013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.688920    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwpl\" (UniqueName: \"kubernetes.io/projected/8e4868c5-3b08-4c75-961e-0a85785ca09b-kube-api-access-sxwpl\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:01:59.689013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.688963    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4868c5-3b08-4c75-961e-0a85785ca09b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:01:59.689198 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:01:59.689063    2545 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 07 17:01:59.689198 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:01:59.689118    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4868c5-3b08-4c75-961e-0a85785ca09b-tls-certs podName:8e4868c5-3b08-4c75-961e-0a85785ca09b nodeName:}" failed. No retries permitted until 2026-09-07 17:02:00.189104693 +0000 UTC m=+331.829659471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8e4868c5-3b08-4c75-961e-0a85785ca09b-tls-certs") pod "model-serving-api-54d89bd5fc-5qxmb" (UID: "8e4868c5-3b08-4c75-961e-0a85785ca09b") : secret "model-serving-api-tls" not found
Sep 07 17:01:59.697895 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:01:59.697866    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwpl\" (UniqueName: \"kubernetes.io/projected/8e4868c5-3b08-4c75-961e-0a85785ca09b-kube-api-access-sxwpl\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:02:00.192797 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:00.192759    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4868c5-3b08-4c75-961e-0a85785ca09b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:02:00.195330 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:00.195308    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4868c5-3b08-4c75-961e-0a85785ca09b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qxmb\" (UID: \"8e4868c5-3b08-4c75-961e-0a85785ca09b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:02:00.350610 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:00.350567    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:02:00.626045 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:00.626010    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qxmb"]
Sep 07 17:02:00.629624 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:02:00.629599    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4868c5_3b08_4c75_961e_0a85785ca09b.slice/crio-ef046d0a0dbb0b50b60b9da11618178a0d98b53ab0ed5febac14fa655a93c05d WatchSource:0}: Error finding container ef046d0a0dbb0b50b60b9da11618178a0d98b53ab0ed5febac14fa655a93c05d: Status 404 returned error can't find the container with id ef046d0a0dbb0b50b60b9da11618178a0d98b53ab0ed5febac14fa655a93c05d
Sep 07 17:02:01.305264 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:01.305225    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb" event={"ID":"8e4868c5-3b08-4c75-961e-0a85785ca09b","Type":"ContainerStarted","Data":"ef046d0a0dbb0b50b60b9da11618178a0d98b53ab0ed5febac14fa655a93c05d"}
Sep 07 17:02:04.321973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:04.321936    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb" event={"ID":"8e4868c5-3b08-4c75-961e-0a85785ca09b","Type":"ContainerStarted","Data":"afdd67192a7b76fc5f1e2a9d4eb60cec808753ff6d62d8de5a60c83d07bfc650"}
Sep 07 17:02:04.322365 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:04.322072    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:02:04.374877 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:04.374815    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb" podStartSLOduration=2.600436041 podStartE2EDuration="5.374794926s" totalImagesPullingTime="2.774358885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:04.374081249 +0000 UTC m=+336.014636046" watchObservedRunningTime="2026-09-07 17:02:04.374794926 +0000 UTC m=+336.015349724"
Sep 07 17:02:07.985001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:07.984923    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"]
Sep 07 17:02:07.987042 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:07.987024    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:07.989713 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.989684    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret"
Sep 07 17:02:07.990606 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.990564    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 07 17:02:07.990887 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.990862    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-openshift-gateway-dockercfg-zbwww\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zbwww\"" type="*v1.Secret"
Sep 07 17:02:07.990887 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.990871    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap"
Sep 07 17:02:07.990988 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.990953    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-tls\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret"
Sep 07 17:02:07.991023 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.991008    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 07 17:02:07.991450 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.991427    2545 status_manager.go:1018] "Failed to get status for pod" err="pods \"istiod-openshift-gateway-5677ccb49b-f56qm\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" podUID="7b150a20-eebe-49fe-8931-54c747d1ee34" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:07.994766 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:07.994746    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret"
Sep 07 17:02:08.020096 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.020061    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"]
Sep 07 17:02:08.158185 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158145    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.158380 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158199    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.158380 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158265    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.158380 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158311    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.158503 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158382    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.158503 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158428    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b150a20-eebe-49fe-8931-54c747d1ee34-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.158503 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.158452    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmwnm\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-kube-api-access-rmwnm\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259667    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259715    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259741    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259850    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259905    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259951    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b150a20-eebe-49fe-8931-54c747d1ee34-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.259994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.259970    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwnm\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-kube-api-access-rmwnm\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.262148 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.262123    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b150a20-eebe-49fe-8931-54c747d1ee34-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.271409 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.271385    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:08.845417 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.845385    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 17:02:08.851383 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:08.851356    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.239819 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.239735    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 17:02:09.260334 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.260302    2545 secret.go:189] Couldn't get secret openshift-ingress/istiod-tls: failed to sync secret cache: timed out waiting for the condition
Sep 07 17:02:09.260502 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.260373    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-dns-cert podName:7b150a20-eebe-49fe-8931-54c747d1ee34 nodeName:}" failed. No retries permitted until 2026-09-07 17:02:09.760357277 +0000 UTC m=+341.400912051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-csr-dns-cert" (UniqueName: "kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-dns-cert") pod "istiod-openshift-gateway-5677ccb49b-f56qm" (UID: "7b150a20-eebe-49fe-8931-54c747d1ee34") : failed to sync secret cache: timed out waiting for the condition
Sep 07 17:02:09.260502 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.260303    2545 secret.go:189] Couldn't get secret openshift-ingress/cacerts: failed to sync secret cache: timed out waiting for the condition
Sep 07 17:02:09.260502 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.260447    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-cacerts podName:7b150a20-eebe-49fe-8931-54c747d1ee34 nodeName:}" failed. No retries permitted until 2026-09-07 17:02:09.760433304 +0000 UTC m=+341.400988082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cacerts" (UniqueName: "kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-cacerts") pod "istiod-openshift-gateway-5677ccb49b-f56qm" (UID: "7b150a20-eebe-49fe-8931-54c747d1ee34") : failed to sync secret cache: timed out waiting for the condition
Sep 07 17:02:09.260502 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.260308    2545 secret.go:189] Couldn't get secret openshift-ingress/istio-kubeconfig: failed to sync secret cache: timed out waiting for the condition
Sep 07 17:02:09.260502 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.260492    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-kubeconfig podName:7b150a20-eebe-49fe-8931-54c747d1ee34 nodeName:}" failed. No retries permitted until 2026-09-07 17:02:09.760483773 +0000 UTC m=+341.401038546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-kubeconfig" (UniqueName: "kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-kubeconfig") pod "istiod-openshift-gateway-5677ccb49b-f56qm" (UID: "7b150a20-eebe-49fe-8931-54c747d1ee34") : failed to sync secret cache: timed out waiting for the condition
Sep 07 17:02:09.269444 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.269416    2545 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 07 17:02:09.269590 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.269460    2545 projected.go:196] Error preparing data for projected volume kube-api-access-rmwnm for pod openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm: failed to sync configmap cache: timed out waiting for the condition
Sep 07 17:02:09.269590 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:02:09.269523    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-kube-api-access-rmwnm podName:7b150a20-eebe-49fe-8931-54c747d1ee34 nodeName:}" failed. No retries permitted until 2026-09-07 17:02:09.769505076 +0000 UTC m=+341.410059858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rmwnm" (UniqueName: "kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-kube-api-access-rmwnm") pod "istiod-openshift-gateway-5677ccb49b-f56qm" (UID: "7b150a20-eebe-49fe-8931-54c747d1ee34") : failed to sync configmap cache: timed out waiting for the condition
Sep 07 17:02:09.330020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.329985    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 17:02:09.374497 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.374465    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 07 17:02:09.375824 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.375806    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 07 17:02:09.527221 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.527133    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 07 17:02:09.527371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.527237    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zbwww\""
Sep 07 17:02:09.772906 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.772853    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.773115 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.772945    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwnm\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-kube-api-access-rmwnm\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.773115 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.772978    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.773115 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.773008    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.775409 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.775369    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.775702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.775505    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.775702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.775578    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7b150a20-eebe-49fe-8931-54c747d1ee34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.775702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.775672    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmwnm\" (UniqueName: \"kubernetes.io/projected/7b150a20-eebe-49fe-8931-54c747d1ee34-kube-api-access-rmwnm\") pod \"istiod-openshift-gateway-5677ccb49b-f56qm\" (UID: \"7b150a20-eebe-49fe-8931-54c747d1ee34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:09.795595 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:09.795515    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:10.172333 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:02:10.172304    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b150a20_eebe_49fe_8931_54c747d1ee34.slice/crio-c89b62564e1c566d149145a1c142d56ce432aa1c57b0349abf80a6d9aeba8844 WatchSource:0}: Error finding container c89b62564e1c566d149145a1c142d56ce432aa1c57b0349abf80a6d9aeba8844: Status 404 returned error can't find the container with id c89b62564e1c566d149145a1c142d56ce432aa1c57b0349abf80a6d9aeba8844
Sep 07 17:02:10.172434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:10.172330    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"]
Sep 07 17:02:10.349711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:10.349675    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm" event={"ID":"7b150a20-eebe-49fe-8931-54c747d1ee34","Type":"ContainerStarted","Data":"c89b62564e1c566d149145a1c142d56ce432aa1c57b0349abf80a6d9aeba8844"}
Sep 07 17:02:12.446501 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:12.446459    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:12.446823 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:12.446545    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:13.365685 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:13.365641    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm" event={"ID":"7b150a20-eebe-49fe-8931-54c747d1ee34","Type":"ContainerStarted","Data":"d9e40269d5c5d6cf298b9032092f8bd6f8bab89e1e4c6eef08a722afcf0c471d"}
Sep 07 17:02:13.365887 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:13.365864    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:13.367638 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:13.367615    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm"
Sep 07 17:02:13.455232 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:13.455170    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm" podStartSLOduration=4.183310506 podStartE2EDuration="6.455153032s" totalImagesPullingTime="2.271842526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:13.41947977 +0000 UTC m=+345.060034570" watchObservedRunningTime="2026-09-07 17:02:13.455153032 +0000 UTC m=+345.095707827"
Sep 07 17:02:15.329923 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:02:15.329892    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5qxmb"
Sep 07 17:03:34.898615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:34.898580    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8486467bb6-wrtjn"]
Sep 07 17:03:44.135698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.135661    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"]
Sep 07 17:03:44.138961 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.138941    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.141716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.141694    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 17:03:44.141838 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.141758    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rfw57\""
Sep 07 17:03:44.142678 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.142662    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 17:03:44.152183 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.152161    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"]
Sep 07 17:03:44.226280 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.226243    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkxn\" (UniqueName: \"kubernetes.io/projected/485b39ec-4ff0-4786-862f-5efe5518b4c7-kube-api-access-nzkxn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.226450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.226301    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.226450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.226402    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.227793 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.227771    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"]
Sep 07 17:03:44.230995 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.230980    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.239739 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.239713    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"]
Sep 07 17:03:44.326771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.326735    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.326936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.326783    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.326936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.326807    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.326936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.326828    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mwzm\" (UniqueName: \"kubernetes.io/projected/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-kube-api-access-2mwzm\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.326936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.326869    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.326936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.326892    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkxn\" (UniqueName: \"kubernetes.io/projected/485b39ec-4ff0-4786-862f-5efe5518b4c7-kube-api-access-nzkxn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.327166 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.327102    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.327166 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.327140    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.331122 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.331093    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"]
Sep 07 17:03:44.334308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.334294    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.339197 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.339170    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkxn\" (UniqueName: \"kubernetes.io/projected/485b39ec-4ff0-4786-862f-5efe5518b4c7-kube-api-access-nzkxn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.342626 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.342604    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"]
Sep 07 17:03:44.427405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427326    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.427405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427366    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfc9z\" (UniqueName: \"kubernetes.io/projected/a4f132de-50d5-42a5-9637-f7b0fda3ea57-kube-api-access-mfc9z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.427405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427390    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mwzm\" (UniqueName: \"kubernetes.io/projected/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-kube-api-access-2mwzm\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.427675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427447    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.427675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427518    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.427675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427587    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.427772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427756    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.427807 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.427784    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.430844 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.430822    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"]
Sep 07 17:03:44.434165 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.434152    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.436490 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.436470    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mwzm\" (UniqueName: \"kubernetes.io/projected/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-kube-api-access-2mwzm\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.444166 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.444141    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"]
Sep 07 17:03:44.447453 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.447433    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:44.528065 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528034    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.528202 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528082    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.528202 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528102    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.528202 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528121    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfc9z\" (UniqueName: \"kubernetes.io/projected/a4f132de-50d5-42a5-9637-f7b0fda3ea57-kube-api-access-mfc9z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.528347 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528224    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqh2n\" (UniqueName: \"kubernetes.io/projected/71ac3f87-810f-42da-84fd-df404ac8f8ac-kube-api-access-gqh2n\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.528347 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528289    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.528466 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528412    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.528668 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.528649    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.535801 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.535779    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfc9z\" (UniqueName: \"kubernetes.io/projected/a4f132de-50d5-42a5-9637-f7b0fda3ea57-kube-api-access-mfc9z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.540616 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.540596    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:44.629121 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.629083    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqh2n\" (UniqueName: \"kubernetes.io/projected/71ac3f87-810f-42da-84fd-df404ac8f8ac-kube-api-access-gqh2n\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.629269 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.629162    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.629269 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.629189    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.629653 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.629631    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.629696 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.629637    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.637707 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.637683    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqh2n\" (UniqueName: \"kubernetes.io/projected/71ac3f87-810f-42da-84fd-df404ac8f8ac-kube-api-access-gqh2n\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.651482 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.651460    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:44.723160 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.723130    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"]
Sep 07 17:03:44.726060 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:03:44.726020    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485b39ec_4ff0_4786_862f_5efe5518b4c7.slice/crio-1cfdf978b544812920c5a89a818704fd4e94cdecfe267d47662efd95f4e96c0e WatchSource:0}: Error finding container 1cfdf978b544812920c5a89a818704fd4e94cdecfe267d47662efd95f4e96c0e: Status 404 returned error can't find the container with id 1cfdf978b544812920c5a89a818704fd4e94cdecfe267d47662efd95f4e96c0e
Sep 07 17:03:44.750451 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.750429    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:44.756139 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.756116    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6" event={"ID":"485b39ec-4ff0-4786-862f-5efe5518b4c7","Type":"ContainerStarted","Data":"1cfdf978b544812920c5a89a818704fd4e94cdecfe267d47662efd95f4e96c0e"}
Sep 07 17:03:44.813713 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.813681    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"]
Sep 07 17:03:44.815911 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:03:44.815866    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fd8a1b_b221_416f_88d4_a67cdb0305e7.slice/crio-7f62b1448a76d7b03be922a6c5c5024ab513211d92c4057dac12eed33e700b3c WatchSource:0}: Error finding container 7f62b1448a76d7b03be922a6c5c5024ab513211d92c4057dac12eed33e700b3c: Status 404 returned error can't find the container with id 7f62b1448a76d7b03be922a6c5c5024ab513211d92c4057dac12eed33e700b3c
Sep 07 17:03:44.936941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:44.936918    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"]
Sep 07 17:03:44.939089 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:03:44.939007    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f132de_50d5_42a5_9637_f7b0fda3ea57.slice/crio-19c458e814b968fdf19de2ba34c3abbc6a52359de27437bd8e83775387dd5113 WatchSource:0}: Error finding container 19c458e814b968fdf19de2ba34c3abbc6a52359de27437bd8e83775387dd5113: Status 404 returned error can't find the container with id 19c458e814b968fdf19de2ba34c3abbc6a52359de27437bd8e83775387dd5113
Sep 07 17:03:45.047187 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.047077    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"]
Sep 07 17:03:45.079405 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:03:45.079370    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ac3f87_810f_42da_84fd_df404ac8f8ac.slice/crio-0cf45bae8a7b524ec15d12cc60f2495a3c42f755e0006aac89a33fc57fa71e14 WatchSource:0}: Error finding container 0cf45bae8a7b524ec15d12cc60f2495a3c42f755e0006aac89a33fc57fa71e14: Status 404 returned error can't find the container with id 0cf45bae8a7b524ec15d12cc60f2495a3c42f755e0006aac89a33fc57fa71e14
Sep 07 17:03:45.762355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.762318    2545 generic.go:356] "Generic (PLEG): container finished" podID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerID="29df101abef08c172031107dbc828294fe1a6b8512aae61fbfc077ef3eb15a75" exitCode=0
Sep 07 17:03:45.762843 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.762402    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8" event={"ID":"f2fd8a1b-b221-416f-88d4-a67cdb0305e7","Type":"ContainerDied","Data":"29df101abef08c172031107dbc828294fe1a6b8512aae61fbfc077ef3eb15a75"}
Sep 07 17:03:45.762843 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.762451    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8" event={"ID":"f2fd8a1b-b221-416f-88d4-a67cdb0305e7","Type":"ContainerStarted","Data":"7f62b1448a76d7b03be922a6c5c5024ab513211d92c4057dac12eed33e700b3c"}
Sep 07 17:03:45.764004 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.763990    2545 generic.go:356] "Generic (PLEG): container finished" podID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerID="cd759e6dfcb9631fedcb45e8af9c2d071d5f7fad272acd92f44b9ed91da5dea3" exitCode=0
Sep 07 17:03:45.764082 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.764065    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc" event={"ID":"71ac3f87-810f-42da-84fd-df404ac8f8ac","Type":"ContainerDied","Data":"cd759e6dfcb9631fedcb45e8af9c2d071d5f7fad272acd92f44b9ed91da5dea3"}
Sep 07 17:03:45.764144 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.764103    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc" event={"ID":"71ac3f87-810f-42da-84fd-df404ac8f8ac","Type":"ContainerStarted","Data":"0cf45bae8a7b524ec15d12cc60f2495a3c42f755e0006aac89a33fc57fa71e14"}
Sep 07 17:03:45.765712 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.765690    2545 generic.go:356] "Generic (PLEG): container finished" podID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerID="b84e52d15566ca768d8775f2300446ba689285a8029790ffb38c9ad1877cc325" exitCode=0
Sep 07 17:03:45.765803 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.765756    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6" event={"ID":"485b39ec-4ff0-4786-862f-5efe5518b4c7","Type":"ContainerDied","Data":"b84e52d15566ca768d8775f2300446ba689285a8029790ffb38c9ad1877cc325"}
Sep 07 17:03:45.767462 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.767439    2545 generic.go:356] "Generic (PLEG): container finished" podID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerID="a601529bcfec4e504c2df50d8b898baee49b24c0b1cb48c05e5c015b99b449fb" exitCode=0
Sep 07 17:03:45.767529 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.767477    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk" event={"ID":"a4f132de-50d5-42a5-9637-f7b0fda3ea57","Type":"ContainerDied","Data":"a601529bcfec4e504c2df50d8b898baee49b24c0b1cb48c05e5c015b99b449fb"}
Sep 07 17:03:45.767529 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:45.767507    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk" event={"ID":"a4f132de-50d5-42a5-9637-f7b0fda3ea57","Type":"ContainerStarted","Data":"19c458e814b968fdf19de2ba34c3abbc6a52359de27437bd8e83775387dd5113"}
Sep 07 17:03:46.774367 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:46.774329    2545 generic.go:356] "Generic (PLEG): container finished" podID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerID="c9392e497c8c5bb8baf5a2bc6d04edab0f77df1bfae9702bed9928123ab0d562" exitCode=0
Sep 07 17:03:46.774786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:46.774378    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6" event={"ID":"485b39ec-4ff0-4786-862f-5efe5518b4c7","Type":"ContainerDied","Data":"c9392e497c8c5bb8baf5a2bc6d04edab0f77df1bfae9702bed9928123ab0d562"}
Sep 07 17:03:47.781828 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.781740    2545 generic.go:356] "Generic (PLEG): container finished" podID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerID="73340f97e71110fe9cc0b8d4b7f89b8ffac6dad5db32df947850034b30196e5e" exitCode=0
Sep 07 17:03:47.782228 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.781822    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8" event={"ID":"f2fd8a1b-b221-416f-88d4-a67cdb0305e7","Type":"ContainerDied","Data":"73340f97e71110fe9cc0b8d4b7f89b8ffac6dad5db32df947850034b30196e5e"}
Sep 07 17:03:47.783759 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.783737    2545 generic.go:356] "Generic (PLEG): container finished" podID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerID="83071293de5a15c337bdfd11d892d997de3c5add79ef3af3f29f6a542af77bda" exitCode=0
Sep 07 17:03:47.783853 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.783817    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc" event={"ID":"71ac3f87-810f-42da-84fd-df404ac8f8ac","Type":"ContainerDied","Data":"83071293de5a15c337bdfd11d892d997de3c5add79ef3af3f29f6a542af77bda"}
Sep 07 17:03:47.786024 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.786001    2545 generic.go:356] "Generic (PLEG): container finished" podID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerID="f5810f109b33aa3831756137ffd5caa43be95783a139471399ff6eac1147f656" exitCode=0
Sep 07 17:03:47.786102 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.786080    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6" event={"ID":"485b39ec-4ff0-4786-862f-5efe5518b4c7","Type":"ContainerDied","Data":"f5810f109b33aa3831756137ffd5caa43be95783a139471399ff6eac1147f656"}
Sep 07 17:03:47.787834 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.787812    2545 generic.go:356] "Generic (PLEG): container finished" podID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerID="5f8c2fb8a4785c88a36e90edb8cde8044088abe6b8e50c6be235606d41dd2bf9" exitCode=0
Sep 07 17:03:47.787914 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:47.787844    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk" event={"ID":"a4f132de-50d5-42a5-9637-f7b0fda3ea57","Type":"ContainerDied","Data":"5f8c2fb8a4785c88a36e90edb8cde8044088abe6b8e50c6be235606d41dd2bf9"}
Sep 07 17:03:48.794659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.794564    2545 generic.go:356] "Generic (PLEG): container finished" podID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerID="8aba21e1ebd54f327ea99c151ca13f2a585f75bc8c57d5b3e6d099c325271daf" exitCode=0
Sep 07 17:03:48.794659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.794635    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8" event={"ID":"f2fd8a1b-b221-416f-88d4-a67cdb0305e7","Type":"ContainerDied","Data":"8aba21e1ebd54f327ea99c151ca13f2a585f75bc8c57d5b3e6d099c325271daf"}
Sep 07 17:03:48.796778 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.796755    2545 generic.go:356] "Generic (PLEG): container finished" podID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerID="843c081204b965f13b90127f9dc5593b3fccb783f9db28f94ffd5b35e77feb24" exitCode=0
Sep 07 17:03:48.796882 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.796838    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc" event={"ID":"71ac3f87-810f-42da-84fd-df404ac8f8ac","Type":"ContainerDied","Data":"843c081204b965f13b90127f9dc5593b3fccb783f9db28f94ffd5b35e77feb24"}
Sep 07 17:03:48.798809 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.798785    2545 generic.go:356] "Generic (PLEG): container finished" podID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerID="a404013c316ba25b398f84abf01fa185d962c00be5df7ed3691891d2a24c173a" exitCode=0
Sep 07 17:03:48.798914 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.798865    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk" event={"ID":"a4f132de-50d5-42a5-9637-f7b0fda3ea57","Type":"ContainerDied","Data":"a404013c316ba25b398f84abf01fa185d962c00be5df7ed3691891d2a24c173a"}
Sep 07 17:03:48.926379 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.926353    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:48.962175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.962147    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-util\") pod \"485b39ec-4ff0-4786-862f-5efe5518b4c7\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") "
Sep 07 17:03:48.962301 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.962205    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzkxn\" (UniqueName: \"kubernetes.io/projected/485b39ec-4ff0-4786-862f-5efe5518b4c7-kube-api-access-nzkxn\") pod \"485b39ec-4ff0-4786-862f-5efe5518b4c7\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") "
Sep 07 17:03:48.962301 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.962259    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-bundle\") pod \"485b39ec-4ff0-4786-862f-5efe5518b4c7\" (UID: \"485b39ec-4ff0-4786-862f-5efe5518b4c7\") "
Sep 07 17:03:48.962893 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.962862    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-bundle" (OuterVolumeSpecName: "bundle") pod "485b39ec-4ff0-4786-862f-5efe5518b4c7" (UID: "485b39ec-4ff0-4786-862f-5efe5518b4c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:48.964257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.964234    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485b39ec-4ff0-4786-862f-5efe5518b4c7-kube-api-access-nzkxn" (OuterVolumeSpecName: "kube-api-access-nzkxn") pod "485b39ec-4ff0-4786-862f-5efe5518b4c7" (UID: "485b39ec-4ff0-4786-862f-5efe5518b4c7"). InnerVolumeSpecName "kube-api-access-nzkxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:03:48.969700 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:48.969660    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-util" (OuterVolumeSpecName: "util") pod "485b39ec-4ff0-4786-862f-5efe5518b4c7" (UID: "485b39ec-4ff0-4786-862f-5efe5518b4c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:49.062827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.062795    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzkxn\" (UniqueName: \"kubernetes.io/projected/485b39ec-4ff0-4786-862f-5efe5518b4c7-kube-api-access-nzkxn\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:49.062827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.062828    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:49.062987 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.062838    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/485b39ec-4ff0-4786-862f-5efe5518b4c7-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:49.806059 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.806031    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6"
Sep 07 17:03:49.806450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.806078    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbt5fx6" event={"ID":"485b39ec-4ff0-4786-862f-5efe5518b4c7","Type":"ContainerDied","Data":"1cfdf978b544812920c5a89a818704fd4e94cdecfe267d47662efd95f4e96c0e"}
Sep 07 17:03:49.806450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.806123    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cfdf978b544812920c5a89a818704fd4e94cdecfe267d47662efd95f4e96c0e"
Sep 07 17:03:49.953369 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.953347    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:49.969685 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.969658    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-bundle\") pod \"71ac3f87-810f-42da-84fd-df404ac8f8ac\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") "
Sep 07 17:03:49.969813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.969699    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-util\") pod \"71ac3f87-810f-42da-84fd-df404ac8f8ac\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") "
Sep 07 17:03:49.969813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.969765    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqh2n\" (UniqueName: \"kubernetes.io/projected/71ac3f87-810f-42da-84fd-df404ac8f8ac-kube-api-access-gqh2n\") pod \"71ac3f87-810f-42da-84fd-df404ac8f8ac\" (UID: \"71ac3f87-810f-42da-84fd-df404ac8f8ac\") "
Sep 07 17:03:49.972372 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.970173    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-bundle" (OuterVolumeSpecName: "bundle") pod "71ac3f87-810f-42da-84fd-df404ac8f8ac" (UID: "71ac3f87-810f-42da-84fd-df404ac8f8ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:49.975226 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.975197    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ac3f87-810f-42da-84fd-df404ac8f8ac-kube-api-access-gqh2n" (OuterVolumeSpecName: "kube-api-access-gqh2n") pod "71ac3f87-810f-42da-84fd-df404ac8f8ac" (UID: "71ac3f87-810f-42da-84fd-df404ac8f8ac"). InnerVolumeSpecName "kube-api-access-gqh2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:03:49.977675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.977643    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-util" (OuterVolumeSpecName: "util") pod "71ac3f87-810f-42da-84fd-df404ac8f8ac" (UID: "71ac3f87-810f-42da-84fd-df404ac8f8ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:49.991094 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.991071    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:49.994648 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:49.994623    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:50.070672 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.070638    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfc9z\" (UniqueName: \"kubernetes.io/projected/a4f132de-50d5-42a5-9637-f7b0fda3ea57-kube-api-access-mfc9z\") pod \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") "
Sep 07 17:03:50.070850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.070684    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-bundle\") pod \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") "
Sep 07 17:03:50.070850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.070717    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-bundle\") pod \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") "
Sep 07 17:03:50.070850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.070808    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-util\") pod \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") "
Sep 07 17:03:50.070850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.070831    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-util\") pod \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\" (UID: \"a4f132de-50d5-42a5-9637-f7b0fda3ea57\") "
Sep 07 17:03:50.071044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.070875    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mwzm\" (UniqueName: \"kubernetes.io/projected/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-kube-api-access-2mwzm\") pod \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\" (UID: \"f2fd8a1b-b221-416f-88d4-a67cdb0305e7\") "
Sep 07 17:03:50.071104 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.071088    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.071155 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.071109    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ac3f87-810f-42da-84fd-df404ac8f8ac-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.071155 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.071123    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqh2n\" (UniqueName: \"kubernetes.io/projected/71ac3f87-810f-42da-84fd-df404ac8f8ac-kube-api-access-gqh2n\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.071409 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.071374    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-bundle" (OuterVolumeSpecName: "bundle") pod "f2fd8a1b-b221-416f-88d4-a67cdb0305e7" (UID: "f2fd8a1b-b221-416f-88d4-a67cdb0305e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:50.071596 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.071571    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-bundle" (OuterVolumeSpecName: "bundle") pod "a4f132de-50d5-42a5-9637-f7b0fda3ea57" (UID: "a4f132de-50d5-42a5-9637-f7b0fda3ea57"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:50.072973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.072940    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-kube-api-access-2mwzm" (OuterVolumeSpecName: "kube-api-access-2mwzm") pod "f2fd8a1b-b221-416f-88d4-a67cdb0305e7" (UID: "f2fd8a1b-b221-416f-88d4-a67cdb0305e7"). InnerVolumeSpecName "kube-api-access-2mwzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:03:50.073049 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.073034    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f132de-50d5-42a5-9637-f7b0fda3ea57-kube-api-access-mfc9z" (OuterVolumeSpecName: "kube-api-access-mfc9z") pod "a4f132de-50d5-42a5-9637-f7b0fda3ea57" (UID: "a4f132de-50d5-42a5-9637-f7b0fda3ea57"). InnerVolumeSpecName "kube-api-access-mfc9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:03:50.076844 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.076824    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-util" (OuterVolumeSpecName: "util") pod "f2fd8a1b-b221-416f-88d4-a67cdb0305e7" (UID: "f2fd8a1b-b221-416f-88d4-a67cdb0305e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:50.079689 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.079665    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-util" (OuterVolumeSpecName: "util") pod "a4f132de-50d5-42a5-9637-f7b0fda3ea57" (UID: "a4f132de-50d5-42a5-9637-f7b0fda3ea57"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:03:50.172421 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.172387    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mwzm\" (UniqueName: \"kubernetes.io/projected/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-kube-api-access-2mwzm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.172421 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.172414    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfc9z\" (UniqueName: \"kubernetes.io/projected/a4f132de-50d5-42a5-9637-f7b0fda3ea57-kube-api-access-mfc9z\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.172421 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.172424    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.172709 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.172439    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.172709 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.172450    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2fd8a1b-b221-416f-88d4-a67cdb0305e7-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.172709 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.172457    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f132de-50d5-42a5-9637-f7b0fda3ea57-util\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:03:50.812884 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.812855    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8"
Sep 07 17:03:50.813303 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.812885    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jdg8" event={"ID":"f2fd8a1b-b221-416f-88d4-a67cdb0305e7","Type":"ContainerDied","Data":"7f62b1448a76d7b03be922a6c5c5024ab513211d92c4057dac12eed33e700b3c"}
Sep 07 17:03:50.813303 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.812932    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f62b1448a76d7b03be922a6c5c5024ab513211d92c4057dac12eed33e700b3c"
Sep 07 17:03:50.814860 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.814841    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc"
Sep 07 17:03:50.814966 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.814857    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0glknc" event={"ID":"71ac3f87-810f-42da-84fd-df404ac8f8ac","Type":"ContainerDied","Data":"0cf45bae8a7b524ec15d12cc60f2495a3c42f755e0006aac89a33fc57fa71e14"}
Sep 07 17:03:50.814966 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.814896    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cf45bae8a7b524ec15d12cc60f2495a3c42f755e0006aac89a33fc57fa71e14"
Sep 07 17:03:50.816885 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.816861    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk" event={"ID":"a4f132de-50d5-42a5-9637-f7b0fda3ea57","Type":"ContainerDied","Data":"19c458e814b968fdf19de2ba34c3abbc6a52359de27437bd8e83775387dd5113"}
Sep 07 17:03:50.816967 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.816904    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19c458e814b968fdf19de2ba34c3abbc6a52359de27437bd8e83775387dd5113"
Sep 07 17:03:50.816967 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:50.816914    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539plkk"
Sep 07 17:03:59.917687 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:03:59.917622    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8486467bb6-wrtjn" podUID="b0021543-0957-4c35-8bd8-dfb284312f92" containerName="console" containerID="cri-o://7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca" gracePeriod=15
Sep 07 17:04:00.160283 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.160258    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 17:04:00.255056 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.254960    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-serving-cert\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255056 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255011    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-service-ca\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255056 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255035    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-trusted-ca-bundle\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255101    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-console-config\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255156    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f58gm\" (UniqueName: \"kubernetes.io/projected/b0021543-0957-4c35-8bd8-dfb284312f92-kube-api-access-f58gm\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255178    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-oauth-serving-cert\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255212    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-oauth-config\") pod \"b0021543-0957-4c35-8bd8-dfb284312f92\" (UID: \"b0021543-0957-4c35-8bd8-dfb284312f92\") "
Sep 07 17:04:00.255553 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255506    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:04:00.255630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255556    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:04:00.255630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255606    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-console-config" (OuterVolumeSpecName: "console-config") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:04:00.255630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.255618    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:04:00.257198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.257167    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:04:00.257290 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.257211    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0021543-0957-4c35-8bd8-dfb284312f92-kube-api-access-f58gm" (OuterVolumeSpecName: "kube-api-access-f58gm") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "kube-api-access-f58gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:04:00.257290 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.257253    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0021543-0957-4c35-8bd8-dfb284312f92" (UID: "b0021543-0957-4c35-8bd8-dfb284312f92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:04:00.356764 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356733    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f58gm\" (UniqueName: \"kubernetes.io/projected/b0021543-0957-4c35-8bd8-dfb284312f92-kube-api-access-f58gm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.356764 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356760    2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-oauth-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.356764 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356771    2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-oauth-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.356975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356780    2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0021543-0957-4c35-8bd8-dfb284312f92-console-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.356975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356789    2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.356975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356797    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-trusted-ca-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.356975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.356805    2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0021543-0957-4c35-8bd8-dfb284312f92-console-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:04:00.865278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.865237    2545 generic.go:356] "Generic (PLEG): container finished" podID="b0021543-0957-4c35-8bd8-dfb284312f92" containerID="7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca" exitCode=0
Sep 07 17:04:00.865278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.865275    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486467bb6-wrtjn"
Sep 07 17:04:00.865486 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.865333    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486467bb6-wrtjn" event={"ID":"b0021543-0957-4c35-8bd8-dfb284312f92","Type":"ContainerDied","Data":"7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca"}
Sep 07 17:04:00.865486 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.865381    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486467bb6-wrtjn" event={"ID":"b0021543-0957-4c35-8bd8-dfb284312f92","Type":"ContainerDied","Data":"6430d6a5b7f72d8ceddc2202d651cc3200dcffa9aa5a65f986bf90007ed64776"}
Sep 07 17:04:00.865486 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.865403    2545 scope.go:117] "RemoveContainer" containerID="7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca"
Sep 07 17:04:00.874276 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.874251    2545 scope.go:117] "RemoveContainer" containerID="7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca"
Sep 07 17:04:00.874577 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:04:00.874532    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca\": container with ID starting with 7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca not found: ID does not exist" containerID="7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca"
Sep 07 17:04:00.874627 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.874590    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca"} err="failed to get container status \"7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca\": rpc error: code = NotFound desc = could not find container \"7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca\": container with ID starting with 7e8a16cdaea1cd2696098f9664fc024931e582df621fcdfcd6f2f75cbd31d6ca not found: ID does not exist"
Sep 07 17:04:00.899113 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.899082    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8486467bb6-wrtjn"]
Sep 07 17:04:00.903124 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:00.903098    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8486467bb6-wrtjn"]
Sep 07 17:04:02.887324 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:02.887283    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0021543-0957-4c35-8bd8-dfb284312f92" path="/var/lib/kubelet/pods/b0021543-0957-4c35-8bd8-dfb284312f92/volumes"
Sep 07 17:04:58.639395 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639351    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639768    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639788    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639800    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639809    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639821    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0021543-0957-4c35-8bd8-dfb284312f92" containerName="console"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639830    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0021543-0957-4c35-8bd8-dfb284312f92" containerName="console"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639840    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639848    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639857    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="pull"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639866    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="pull"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639874    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639881    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639897    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639904    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639912    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="pull"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639921    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="pull"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639936    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639944    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639961    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="pull"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639971    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="pull"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639983    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.639991    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="extract"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640000    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="util"
Sep 07 17:04:58.639994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640008    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="util"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640016    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="pull"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640023    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="pull"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640098    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0021543-0957-4c35-8bd8-dfb284312f92" containerName="console"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640109    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2fd8a1b-b221-416f-88d4-a67cdb0305e7" containerName="extract"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640118    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="485b39ec-4ff0-4786-862f-5efe5518b4c7" containerName="extract"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640125    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ac3f87-810f-42da-84fd-df404ac8f8ac" containerName="extract"
Sep 07 17:04:58.641108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.640135    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f132de-50d5-42a5-9637-f7b0fda3ea57" containerName="extract"
Sep 07 17:04:58.643011 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.642989    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.645643 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.645619    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 17:04:58.645939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.645922    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qm5ll\""
Sep 07 17:04:58.646619 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.646600    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 17:04:58.646706 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.646674    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 17:04:58.657658 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.657639    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:04:58.672780 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.672755    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:04:58.718162 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.718125    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhdm7\" (UniqueName: \"kubernetes.io/projected/f7edb08d-7a57-4850-bbb1-e5f60f80eac9-kube-api-access-hhdm7\") pod \"limitador-limitador-85d9db4d5d-6dsjq\" (UID: \"f7edb08d-7a57-4850-bbb1-e5f60f80eac9\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.718162 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.718165    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7edb08d-7a57-4850-bbb1-e5f60f80eac9-config-file\") pod \"limitador-limitador-85d9db4d5d-6dsjq\" (UID: \"f7edb08d-7a57-4850-bbb1-e5f60f80eac9\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.819112 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.819080    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7edb08d-7a57-4850-bbb1-e5f60f80eac9-config-file\") pod \"limitador-limitador-85d9db4d5d-6dsjq\" (UID: \"f7edb08d-7a57-4850-bbb1-e5f60f80eac9\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.819295 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.819147    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhdm7\" (UniqueName: \"kubernetes.io/projected/f7edb08d-7a57-4850-bbb1-e5f60f80eac9-kube-api-access-hhdm7\") pod \"limitador-limitador-85d9db4d5d-6dsjq\" (UID: \"f7edb08d-7a57-4850-bbb1-e5f60f80eac9\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.819802 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.819780    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7edb08d-7a57-4850-bbb1-e5f60f80eac9-config-file\") pod \"limitador-limitador-85d9db4d5d-6dsjq\" (UID: \"f7edb08d-7a57-4850-bbb1-e5f60f80eac9\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.830266 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.830233    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhdm7\" (UniqueName: \"kubernetes.io/projected/f7edb08d-7a57-4850-bbb1-e5f60f80eac9-kube-api-access-hhdm7\") pod \"limitador-limitador-85d9db4d5d-6dsjq\" (UID: \"f7edb08d-7a57-4850-bbb1-e5f60f80eac9\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:58.952518 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:58.952440    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:04:59.238668 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:04:59.238643    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:04:59.240613 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:04:59.240586    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7edb08d_7a57_4850_bbb1_e5f60f80eac9.slice/crio-3e27c8b9a337b614f9b365c7b5ff4af8d60ae368d855699787a59a15ca9095e0 WatchSource:0}: Error finding container 3e27c8b9a337b614f9b365c7b5ff4af8d60ae368d855699787a59a15ca9095e0: Status 404 returned error can't find the container with id 3e27c8b9a337b614f9b365c7b5ff4af8d60ae368d855699787a59a15ca9095e0
Sep 07 17:05:00.137153 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:05:00.137117    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq" event={"ID":"f7edb08d-7a57-4850-bbb1-e5f60f80eac9","Type":"ContainerStarted","Data":"3e27c8b9a337b614f9b365c7b5ff4af8d60ae368d855699787a59a15ca9095e0"}
Sep 07 17:05:02.149532 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:05:02.149493    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq" event={"ID":"f7edb08d-7a57-4850-bbb1-e5f60f80eac9","Type":"ContainerStarted","Data":"9204b845dec13922df2d1724f6f0857edc6738376663a71bbed778a7585392b5"}
Sep 07 17:05:02.150021 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:05:02.149620    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:05:02.167746 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:05:02.167691    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq" podStartSLOduration=1.814731307 podStartE2EDuration="4.167676539s" totalImagesPullingTime="2.352945232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:02.165423908 +0000 UTC m=+513.805978728" watchObservedRunningTime="2026-09-07 17:05:02.167676539 +0000 UTC m=+513.808231334"
Sep 07 17:05:13.155898 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:05:13.155852    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"
Sep 07 17:06:12.564953 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:06:12.564912    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:06:37.936843 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:06:37.936806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:06:47.852112 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:06:47.852071    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:07:03.135205 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:03.135116    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:07:07.410968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.410932    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"]
Sep 07 17:07:07.414210 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.414187    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.417710 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.417689    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\""
Sep 07 17:07:07.418484 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.418460    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 07 17:07:07.418641 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.418504    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 17:07:07.418641 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.418504    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 17:07:07.424894 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.424869    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"]
Sep 07 17:07:07.509342 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.509306    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.509520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.509376    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.509520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.509398    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt65m\" (UniqueName: \"kubernetes.io/projected/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-kube-api-access-gt65m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.509520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.509423    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.509520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.509449    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.509520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.509491    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.610669 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.610625    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.610861 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.610674    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt65m\" (UniqueName: \"kubernetes.io/projected/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-kube-api-access-gt65m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.610861 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.610716    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.610861 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.610755    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.610861 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.610776    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.610861 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.610816    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.611148 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.611111    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.611204 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.611154    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.611204 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.611176    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.613061 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.613030    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.613274 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.613254    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.619666 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.619643    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt65m\" (UniqueName: \"kubernetes.io/projected/ff8228f7-38ac-4f36-b625-17e0cf4e4b3f-kube-api-access-gt65m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7tqpg\" (UID: \"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.725043 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.725000    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:07.996368 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.996343    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"]
Sep 07 17:07:07.998085 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:07:07.998057    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8228f7_38ac_4f36_b625_17e0cf4e4b3f.slice/crio-a817d8f58ece2ab4d1c27ebe06680e8322988c22851b836f0747d8e9df2952d0 WatchSource:0}: Error finding container a817d8f58ece2ab4d1c27ebe06680e8322988c22851b836f0747d8e9df2952d0: Status 404 returned error can't find the container with id a817d8f58ece2ab4d1c27ebe06680e8322988c22851b836f0747d8e9df2952d0
Sep 07 17:07:07.999526 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:07.999510    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:07:08.756040 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:08.755997    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg" event={"ID":"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f","Type":"ContainerStarted","Data":"a817d8f58ece2ab4d1c27ebe06680e8322988c22851b836f0747d8e9df2952d0"}
Sep 07 17:07:08.843746 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:08.843708    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:07:09.761920 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:09.761878    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg" event={"ID":"ff8228f7-38ac-4f36-b625-17e0cf4e4b3f","Type":"ContainerStarted","Data":"443ac50fbc16c42440230e9da2322481d106a0fc49ab0ab38cc7b9b65e6768ed"}
Sep 07 17:07:09.784349 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:09.784289    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg" podStartSLOduration=1.8349035200000001 podStartE2EDuration="2.784270445s" totalImagesPullingTime="949.366925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:07:09.783978851 +0000 UTC m=+641.424533677" watchObservedRunningTime="2026-09-07 17:07:09.784270445 +0000 UTC m=+641.424825243"
Sep 07 17:07:17.725860 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:17.725803    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:17.726324 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:17.725888    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:17.738334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:17.738307    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:17.810359 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:17.810319    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7tqpg"
Sep 07 17:07:19.943603 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:19.943566    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:07:26.741939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:26.741901    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:07:40.440302 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:07:40.440263    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:09:48.265483 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.265449    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"]
Sep 07 17:09:48.268742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.268724    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.274102 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.274077    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9fa102-openshift-default-dockercfg-xbc2f\""
Sep 07 17:09:48.286625 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.286600    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"]
Sep 07 17:09:48.324349 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324305    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-socket\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324372    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-data\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324401    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-istio-token\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324485    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-credential-socket\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324521    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn9v2\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-kube-api-access-vn9v2\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324556    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-envoy\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324624    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/731c285c-a2e4-4088-9e13-c92dd9601574-istio-podinfo\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324682    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-certs\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.324717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.324711    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/731c285c-a2e4-4088-9e13-c92dd9601574-istiod-ca-cert\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425465 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425415    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/731c285c-a2e4-4088-9e13-c92dd9601574-istio-podinfo\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425465 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425472    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-certs\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425494    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/731c285c-a2e4-4088-9e13-c92dd9601574-istiod-ca-cert\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425646    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-socket\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425817 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425724    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-data\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425817 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425752    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-istio-token\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425816    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-credential-socket\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425841    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn9v2\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-kube-api-access-vn9v2\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.425922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425877    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-envoy\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.426075 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425969    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-certs\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.426075 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.425989    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-socket\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.426199 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.426177    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-data\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.426263 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.426219    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-credential-socket\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.426502 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.426482    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/731c285c-a2e4-4088-9e13-c92dd9601574-istiod-ca-cert\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.428073 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.428052    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/731c285c-a2e4-4088-9e13-c92dd9601574-istio-podinfo\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.428342 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.428321    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-envoy\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.435590 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.435570    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-istio-token\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.435774 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.435756    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn9v2\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-kube-api-access-vn9v2\") pod \"e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") " pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.578470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.578439    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:48.864832 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:48.864806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"]
Sep 07 17:09:48.865924 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:09:48.865891    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731c285c_a2e4_4088_9e13_c92dd9601574.slice/crio-957b1c2c9fea825b2c5c8ec006d22672ec42559e6237c5eee2151b6c0853b514 WatchSource:0}: Error finding container 957b1c2c9fea825b2c5c8ec006d22672ec42559e6237c5eee2151b6c0853b514: Status 404 returned error can't find the container with id 957b1c2c9fea825b2c5c8ec006d22672ec42559e6237c5eee2151b6c0853b514
Sep 07 17:09:49.511509 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:49.511472    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" event={"ID":"731c285c-a2e4-4088-9e13-c92dd9601574","Type":"ContainerStarted","Data":"957b1c2c9fea825b2c5c8ec006d22672ec42559e6237c5eee2151b6c0853b514"}
Sep 07 17:09:51.203320 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.203242    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"]
Sep 07 17:09:51.206378 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.206354    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.209660 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.209634    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-2b812a80-kserve-self-signed-certs\""
Sep 07 17:09:51.217687 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.217659    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"]
Sep 07 17:09:51.351792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.351755    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-home\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.351972 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.351806    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041e2e58-cd71-4a66-b637-f7425d6a69af-tls-certs\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.351972 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.351889    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvbsr\" (UniqueName: \"kubernetes.io/projected/041e2e58-cd71-4a66-b637-f7425d6a69af-kube-api-access-dvbsr\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.352057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.351974    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-dshm\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.352057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.352005    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-tmp-dir\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.352057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.352023    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-model-cache\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.452489 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.452450    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-home\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.452695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.452505    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041e2e58-cd71-4a66-b637-f7425d6a69af-tls-certs\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.452695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.452567    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvbsr\" (UniqueName: \"kubernetes.io/projected/041e2e58-cd71-4a66-b637-f7425d6a69af-kube-api-access-dvbsr\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.452695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.452642    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-dshm\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.452695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.452668    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-tmp-dir\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.452919 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.452697    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-model-cache\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.453054 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.453020    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-home\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.453184 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.453128    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-tmp-dir\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.453184 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.453172    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-model-cache\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.455095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.455031    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-dshm\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.455662 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.455642    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041e2e58-cd71-4a66-b637-f7425d6a69af-tls-certs\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.465036 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.465013    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvbsr\" (UniqueName: \"kubernetes.io/projected/041e2e58-cd71-4a66-b637-f7425d6a69af-kube-api-access-dvbsr\") pod \"e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") " pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.517911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.517652    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:09:51.800455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.800370    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"]
Sep 07 17:09:51.803105 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:09:51.803079    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod041e2e58_cd71_4a66_b637_f7425d6a69af.slice/crio-4c5300fcce4a7388cd59d9e7b3314c605d399f22ef065da3e5be19f76df42a38 WatchSource:0}: Error finding container 4c5300fcce4a7388cd59d9e7b3314c605d399f22ef065da3e5be19f76df42a38: Status 404 returned error can't find the container with id 4c5300fcce4a7388cd59d9e7b3314c605d399f22ef065da3e5be19f76df42a38
Sep 07 17:09:51.854175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:51.854141    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:09:52.540964 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:52.540919    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5" event={"ID":"041e2e58-cd71-4a66-b637-f7425d6a69af","Type":"ContainerStarted","Data":"568979f16672aecf0ddf8e2b778a2e1013377d9382a7c4c53531a2b3e28cff77"}
Sep 07 17:09:52.541428 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:52.540977    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5" event={"ID":"041e2e58-cd71-4a66-b637-f7425d6a69af","Type":"ContainerStarted","Data":"4c5300fcce4a7388cd59d9e7b3314c605d399f22ef065da3e5be19f76df42a38"}
Sep 07 17:09:52.563123 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:52.563071    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5" podStartSLOduration=1.563055244 podStartE2EDuration="1.563055244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:52.560127864 +0000 UTC m=+804.200682657" watchObservedRunningTime="2026-09-07 17:09:52.563055244 +0000 UTC m=+804.203610040"
Sep 07 17:09:54.185391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:54.185354    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:54.185736 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:54.185437    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:54.185736 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:54.185477    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:54.554455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:54.554362    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" event={"ID":"731c285c-a2e4-4088-9e13-c92dd9601574","Type":"ContainerStarted","Data":"a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"}
Sep 07 17:09:54.579119 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:54.579081    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:54.579926 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:54.579884    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podStartSLOduration=1.2627926839999999 podStartE2EDuration="6.579870758s" totalImagesPullingTime="5.317078074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:54.577478414 +0000 UTC m=+806.218033229" watchObservedRunningTime="2026-09-07 17:09:54.579870758 +0000 UTC m=+806.220425554"
Sep 07 17:09:55.584841 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:55.584802    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:56.566698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:56.566651    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:09:56.567759 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:09:56.567737    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:10:01.518209 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:01.518149    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:10:01.518209 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:01.518214    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:10:01.530645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:01.530615    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:10:01.603355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:01.603326    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:10:02.726592 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.726526    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"]
Sep 07 17:10:02.730596 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.730566    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.733364 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.733339    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-3f5660-serving-cert\""
Sep 07 17:10:02.733585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.733563    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:10:02.733690 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.733493    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:10:02.734413 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.734393    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:10:02.734568 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.734421    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:10:02.749869 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.749837    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"]
Sep 07 17:10:02.847947 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.847901    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-maas-api-tls\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.848129 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.847961    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-metrics-certs\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.848129 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.848043    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4855c0b3-8730-4157-930b-33fb303cfd9d-openshift-service-ca\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.848129 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.848116    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspk7\" (UniqueName: \"kubernetes.io/projected/4855c0b3-8730-4157-930b-33fb303cfd9d-kube-api-access-jspk7\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.948798 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.948756    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-metrics-certs\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.948968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.948814    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4855c0b3-8730-4157-930b-33fb303cfd9d-openshift-service-ca\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.948968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.948856    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspk7\" (UniqueName: \"kubernetes.io/projected/4855c0b3-8730-4157-930b-33fb303cfd9d-kube-api-access-jspk7\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.948968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.948924    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-maas-api-tls\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.949683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.949656    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4855c0b3-8730-4157-930b-33fb303cfd9d-openshift-service-ca\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.951328 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.951304    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-metrics-certs\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.951421 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.951310    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-maas-api-tls\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:02.958549 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:02.958509    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspk7\" (UniqueName: \"kubernetes.io/projected/4855c0b3-8730-4157-930b-33fb303cfd9d-kube-api-access-jspk7\") pod \"maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:03.043761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:03.043667    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:03.329348 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:03.329317    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"]
Sep 07 17:10:03.331728 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:10:03.331697    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4855c0b3_8730_4157_930b_33fb303cfd9d.slice/crio-93046f1dfc7cb79cbc567dd9cda075b0fcccc753a8883ef7c488ab59c894ccb2 WatchSource:0}: Error finding container 93046f1dfc7cb79cbc567dd9cda075b0fcccc753a8883ef7c488ab59c894ccb2: Status 404 returned error can't find the container with id 93046f1dfc7cb79cbc567dd9cda075b0fcccc753a8883ef7c488ab59c894ccb2
Sep 07 17:10:03.604640 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:03.604527    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p" event={"ID":"4855c0b3-8730-4157-930b-33fb303cfd9d","Type":"ContainerStarted","Data":"93046f1dfc7cb79cbc567dd9cda075b0fcccc753a8883ef7c488ab59c894ccb2"}
Sep 07 17:10:05.617612 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:05.617571    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p" event={"ID":"4855c0b3-8730-4157-930b-33fb303cfd9d","Type":"ContainerStarted","Data":"9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b"}
Sep 07 17:10:05.617994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:05.617656    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:05.639906 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:05.639850    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p" podStartSLOduration=1.430616191 podStartE2EDuration="3.639833227s" totalImagesPullingTime="2.209217036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:05.63645268 +0000 UTC m=+817.277007477" watchObservedRunningTime="2026-09-07 17:10:05.639833227 +0000 UTC m=+817.280388023"
Sep 07 17:10:06.641673 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:06.641631    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:10:11.628344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:11.628312    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:10:17.685662 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:17.685622    2545 generic.go:356] "Generic (PLEG): container finished" podID="731c285c-a2e4-4088-9e13-c92dd9601574" containerID="a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027" exitCode=0
Sep 07 17:10:17.686061 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:17.685666    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" event={"ID":"731c285c-a2e4-4088-9e13-c92dd9601574","Type":"ContainerDied","Data":"a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"}
Sep 07 17:10:17.686105 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:17.686083    2545 scope.go:117] "RemoveContainer" containerID="a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"
Sep 07 17:10:17.687147 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:17.687116    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:17.687194 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:17.687186    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:17.687235 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:17.687215    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:18.692253 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:18.692215    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" event={"ID":"731c285c-a2e4-4088-9e13-c92dd9601574","Type":"ContainerStarted","Data":"e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4"}
Sep 07 17:10:19.579294 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:19.579247    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:10:19.579498 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:19.579472    2545 patch_prober.go:28] interesting pod/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 07 17:10:19.579577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:19.579530    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 07 17:10:20.579317 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:20.579274    2545 patch_prober.go:28] interesting pod/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 07 17:10:20.579729 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:20.579335    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 07 17:10:21.579232 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:21.579189    2545 patch_prober.go:28] interesting pod/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 07 17:10:21.579413 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:21.579250    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 07 17:10:22.309886 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.309847    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:10:22.389025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.388990    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"]
Sep 07 17:10:22.392620 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.392595    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.395854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.395834    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3f5460-openshift-default-dockercfg-9jbd5\""
Sep 07 17:10:22.407530 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.407505    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"]
Sep 07 17:10:22.431638 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431604    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-certs\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.431806 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431645    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxkj5\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-kube-api-access-wxkj5\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.431806 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431663    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-podinfo\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.431806 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431772    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-data\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.431931 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431894    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-token\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.431968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431935    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-envoy\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.432024 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.431999    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-credential-socket\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.432078 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.432029    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ea1dc11-f587-4890-91c3-ac18419c2f25-istiod-ca-cert\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.432078 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.432063    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-socket\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532691 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532654    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-token\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532691 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532692    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-envoy\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532716    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-credential-socket\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532740    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ea1dc11-f587-4890-91c3-ac18419c2f25-istiod-ca-cert\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532767    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-socket\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532804    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-certs\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532836    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxkj5\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-kube-api-access-wxkj5\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532860    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-podinfo\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.532960 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.532908    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-data\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.533313 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.533189    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-credential-socket\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.533313 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.533256    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-socket\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.533313 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.533310    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-data\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.533446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.533411    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-certs\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.533596 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.533577    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ea1dc11-f587-4890-91c3-ac18419c2f25-istiod-ca-cert\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.535399 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.535375    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-envoy\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.535524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.535485    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-podinfo\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.545772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.545745    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-token\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.555571 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.554552    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxkj5\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-kube-api-access-wxkj5\") pod \"e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") " pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:22.579364 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.579330    2545 patch_prober.go:28] interesting pod/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 07 17:10:22.579566 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.579395    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 07 17:10:22.704787 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:22.704740    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:23.022958 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.022933    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"]
Sep 07 17:10:23.028474 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:10:23.028444    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea1dc11_f587_4890_91c3_ac18419c2f25.slice/crio-65c07bca5fa23230f4f469d6e78da5570b08a7bbf8dd6fe8ef3d77e123ae8e7c WatchSource:0}: Error finding container 65c07bca5fa23230f4f469d6e78da5570b08a7bbf8dd6fe8ef3d77e123ae8e7c: Status 404 returned error can't find the container with id 65c07bca5fa23230f4f469d6e78da5570b08a7bbf8dd6fe8ef3d77e123ae8e7c
Sep 07 17:10:23.030738 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.030703    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:23.030820 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.030772    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:23.030820 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.030806    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:23.579879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.579834    2545 patch_prober.go:28] interesting pod/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 07 17:10:23.580343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.579901    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 07 17:10:23.720917 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.720862    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" event={"ID":"6ea1dc11-f587-4890-91c3-ac18419c2f25","Type":"ContainerStarted","Data":"a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"}
Sep 07 17:10:23.721131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.720936    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" event={"ID":"6ea1dc11-f587-4890-91c3-ac18419c2f25","Type":"ContainerStarted","Data":"65c07bca5fa23230f4f469d6e78da5570b08a7bbf8dd6fe8ef3d77e123ae8e7c"}
Sep 07 17:10:23.748573 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:23.748499    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podStartSLOduration=1.7484806370000001 podStartE2EDuration="1.748480637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:23.745521698 +0000 UTC m=+835.386076513" watchObservedRunningTime="2026-09-07 17:10:23.748480637 +0000 UTC m=+835.389035423"
Sep 07 17:10:24.583212 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.583177    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:10:24.583601 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.583469    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:10:24.584243 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.584226    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:10:24.705422 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.705383    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:24.710437 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.710410    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:24.726641 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.726609    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:24.727408 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.727391    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:24.825028 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.824990    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"]
Sep 07 17:10:24.844654 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.844576    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"]
Sep 07 17:10:24.844799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.844697    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:24.847620 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.847595    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:10:24.962740 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:24.962700    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/313448cb-9caf-4132-99f3-221a117601ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4\" (UID: \"313448cb-9caf-4132-99f3-221a117601ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:25.063809 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:25.063764    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/313448cb-9caf-4132-99f3-221a117601ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4\" (UID: \"313448cb-9caf-4132-99f3-221a117601ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:25.064479 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:25.064454    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/313448cb-9caf-4132-99f3-221a117601ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4\" (UID: \"313448cb-9caf-4132-99f3-221a117601ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:25.158657 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:25.158561    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:25.436742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:25.436662    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"]
Sep 07 17:10:25.439442 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:10:25.439413    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313448cb_9caf_4132_99f3_221a117601ff.slice/crio-8e43622f25e5fdd17679a867fdcb592465d922eac2585561ed486127bd258366 WatchSource:0}: Error finding container 8e43622f25e5fdd17679a867fdcb592465d922eac2585561ed486127bd258366: Status 404 returned error can't find the container with id 8e43622f25e5fdd17679a867fdcb592465d922eac2585561ed486127bd258366
Sep 07 17:10:25.732664 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:25.732578    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4" event={"ID":"313448cb-9caf-4132-99f3-221a117601ff","Type":"ContainerStarted","Data":"8e43622f25e5fdd17679a867fdcb592465d922eac2585561ed486127bd258366"}
Sep 07 17:10:28.751384 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:28.751347    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4" event={"ID":"313448cb-9caf-4132-99f3-221a117601ff","Type":"ContainerStarted","Data":"f0d5774ebf468135beb3dc6a7f892bb8d47cc81dc96f180b81786b9ce28f0cf4"}
Sep 07 17:10:28.773660 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:28.773592    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4" podStartSLOduration=1.9575297310000002 podStartE2EDuration="4.773572323s" totalImagesPullingTime="2.816042592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:28.772461711 +0000 UTC m=+840.413016508" watchObservedRunningTime="2026-09-07 17:10:28.773572323 +0000 UTC m=+840.414127120"
Sep 07 17:10:29.757671 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:29.757630    2545 generic.go:356] "Generic (PLEG): container finished" podID="313448cb-9caf-4132-99f3-221a117601ff" containerID="f0d5774ebf468135beb3dc6a7f892bb8d47cc81dc96f180b81786b9ce28f0cf4" exitCode=0
Sep 07 17:10:29.758045 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:29.757688    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4" event={"ID":"313448cb-9caf-4132-99f3-221a117601ff","Type":"ContainerDied","Data":"f0d5774ebf468135beb3dc6a7f892bb8d47cc81dc96f180b81786b9ce28f0cf4"}
Sep 07 17:10:30.888248 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:30.888222    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:31.017026 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:31.016928    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/313448cb-9caf-4132-99f3-221a117601ff-maas-api-service-ca\") pod \"313448cb-9caf-4132-99f3-221a117601ff\" (UID: \"313448cb-9caf-4132-99f3-221a117601ff\") "
Sep 07 17:10:31.017269 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:31.017245    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/313448cb-9caf-4132-99f3-221a117601ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "313448cb-9caf-4132-99f3-221a117601ff" (UID: "313448cb-9caf-4132-99f3-221a117601ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:31.118604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:31.118568    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/313448cb-9caf-4132-99f3-221a117601ff-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:10:31.768469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:31.768436    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"
Sep 07 17:10:31.768666 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:31.768477    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4" event={"ID":"313448cb-9caf-4132-99f3-221a117601ff","Type":"ContainerDied","Data":"8e43622f25e5fdd17679a867fdcb592465d922eac2585561ed486127bd258366"}
Sep 07 17:10:31.768666 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:31.768524    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e43622f25e5fdd17679a867fdcb592465d922eac2585561ed486127bd258366"
Sep 07 17:10:36.283609 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:36.283567    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:10:41.857510 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:41.857471    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"]
Sep 07 17:10:41.875088 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:41.875047    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-26ca81aa-ftrz4"]
Sep 07 17:10:42.889072 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:42.889036    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="313448cb-9caf-4132-99f3-221a117601ff" path="/var/lib/kubelet/pods/313448cb-9caf-4132-99f3-221a117601ff/volumes"
Sep 07 17:10:43.314055 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.314015    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"]
Sep 07 17:10:43.314385 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.314369    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="313448cb-9caf-4132-99f3-221a117601ff" containerName="revoke-keys"
Sep 07 17:10:43.314385 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.314385    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="313448cb-9caf-4132-99f3-221a117601ff" containerName="revoke-keys"
Sep 07 17:10:43.314521 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.314457    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="313448cb-9caf-4132-99f3-221a117601ff" containerName="revoke-keys"
Sep 07 17:10:43.316645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.316622    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.319647 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.319626    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f85216b6-gw-openshift-default-dockercfg-8dv6w\""
Sep 07 17:10:43.356559 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.343416    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"]
Sep 07 17:10:43.426262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426219    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-credential-socket\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426259    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-podinfo\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426388    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-data\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426429    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-certs\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426568 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426479    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-socket\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426568 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426524    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-envoy\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426660 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426599    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istiod-ca-cert\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426660 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426639    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqzl8\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-kube-api-access-xqzl8\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.426660 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.426655    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-token\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527109 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527068    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istiod-ca-cert\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527123    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqzl8\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-kube-api-access-xqzl8\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527144    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-token\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527168    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-credential-socket\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527184    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-podinfo\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527219    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-data\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527244    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-certs\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527272    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-socket\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527304    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-envoy\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527770 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527723    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-certs\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527770 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527743    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-data\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.527989 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.527959    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istiod-ca-cert\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.528100 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.528079    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-credential-socket\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.528281 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.528253    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-socket\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.529732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.529715    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-podinfo\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.529977 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.529962    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-envoy\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.537037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.537010    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqzl8\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-kube-api-access-xqzl8\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.545233 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.545194    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-token\") pod \"e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") " pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.628161 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.628069    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:43.955303 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.955188    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"]
Sep 07 17:10:43.959185 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:10:43.959130    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa9e9fe_f6a8_4dec_80d2_f88662e93f3f.slice/crio-d549fd029c64b542c527e4f9d726b0bdad03c6039db05f84a2e92aa2c9ec30e9 WatchSource:0}: Error finding container d549fd029c64b542c527e4f9d726b0bdad03c6039db05f84a2e92aa2c9ec30e9: Status 404 returned error can't find the container with id d549fd029c64b542c527e4f9d726b0bdad03c6039db05f84a2e92aa2c9ec30e9
Sep 07 17:10:43.962242 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.962195    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:43.962355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.962294    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:43.962355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:43.962338    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:44.837118 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:44.837074    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" event={"ID":"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f","Type":"ContainerStarted","Data":"01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"}
Sep 07 17:10:44.837314 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:44.837134    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" event={"ID":"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f","Type":"ContainerStarted","Data":"d549fd029c64b542c527e4f9d726b0bdad03c6039db05f84a2e92aa2c9ec30e9"}
Sep 07 17:10:44.880060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:44.880001    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podStartSLOduration=1.8799841069999998 podStartE2EDuration="1.879984107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:44.879802889 +0000 UTC m=+856.520357706" watchObservedRunningTime="2026-09-07 17:10:44.879984107 +0000 UTC m=+856.520538903"
Sep 07 17:10:45.628406 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:45.628363    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:45.634402 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:45.634370    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:45.842206 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:45.842170    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:45.843093 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:45.843074    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:10:47.854256 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:47.854221    2545 generic.go:356] "Generic (PLEG): container finished" podID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerID="a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a" exitCode=0
Sep 07 17:10:47.854734 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:47.854294    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" event={"ID":"6ea1dc11-f587-4890-91c3-ac18419c2f25","Type":"ContainerDied","Data":"a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"}
Sep 07 17:10:47.854848 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:47.854832    2545 scope.go:117] "RemoveContainer" containerID="a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"
Sep 07 17:10:47.856075 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:47.856038    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:47.856196 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:47.856134    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:47.856268 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:47.856182    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:48.865398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:48.865361    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" event={"ID":"6ea1dc11-f587-4890-91c3-ac18419c2f25","Type":"ContainerStarted","Data":"91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f"}
Sep 07 17:10:49.705074 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:49.705035    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:49.705316 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:49.705292    2545 patch_prober.go:28] interesting pod/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 07 17:10:49.705404 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:49.705361    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 07 17:10:50.705449 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:50.705404    2545 patch_prober.go:28] interesting pod/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 07 17:10:50.705838 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:50.705480    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 07 17:10:51.705797 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:51.705759    2545 patch_prober.go:28] interesting pod/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 07 17:10:51.706186 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:51.705835    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 07 17:10:52.466281 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:52.466241    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:10:52.705790 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:52.705754    2545 patch_prober.go:28] interesting pod/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 07 17:10:52.705962 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:52.705820    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 07 17:10:53.705509 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:53.705470    2545 patch_prober.go:28] interesting pod/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 07 17:10:53.705705 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:53.705525    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 07 17:10:54.710309 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:54.710277    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:54.710694 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:54.710634    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:10:54.711267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:10:54.711244    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:11:01.884732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.884686    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 17:11:01.891858 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.884763    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:11:01.932049 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.932018    2545 generic.go:356] "Generic (PLEG): container finished" podID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerID="01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff" exitCode=0
Sep 07 17:11:01.932192 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.932088    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" event={"ID":"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f","Type":"ContainerDied","Data":"01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"}
Sep 07 17:11:01.932487 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.932469    2545 scope.go:117] "RemoveContainer" containerID="01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"
Sep 07 17:11:01.933501 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.933474    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:01.933682 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.933657    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:01.933773 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:01.933712    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:02.953192 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:02.953129    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" event={"ID":"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f","Type":"ContainerStarted","Data":"bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600"}
Sep 07 17:11:03.628625 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:03.628578    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:11:03.628879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:03.628855    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 07 17:11:03.628950 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:03.628930    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 07 17:11:04.629283 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:04.629246    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 07 17:11:04.629698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:04.629313    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 07 17:11:05.629247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:05.629206    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 07 17:11:05.629418 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:05.629291    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 07 17:11:06.230881 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.230848    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"]
Sep 07 17:11:06.233273 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.233254    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.236855 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.236831    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-2b812a80-kserve-self-signed-certs\""
Sep 07 17:11:06.261559 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.256018    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"]
Sep 07 17:11:06.355044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.354997    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrznr\" (UniqueName: \"kubernetes.io/projected/a974d31f-4041-46ae-90ad-1b52f0745162-kube-api-access-zrznr\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.355247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.355070    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-tmp-dir\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.355247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.355117    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-dshm\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.355247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.355140    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-home\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.355247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.355160    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-model-cache\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.355247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.355223    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a974d31f-4041-46ae-90ad-1b52f0745162-tls-certs\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.455966 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.455918    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrznr\" (UniqueName: \"kubernetes.io/projected/a974d31f-4041-46ae-90ad-1b52f0745162-kube-api-access-zrznr\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.456262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.456240    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-tmp-dir\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.456436 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.456418    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-dshm\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.456574 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.456559    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-home\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.456690 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.456675    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-model-cache\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.456853 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.456838    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a974d31f-4041-46ae-90ad-1b52f0745162-tls-certs\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.456988 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.456870    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-tmp-dir\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.457155 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.457128    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-home\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.457233 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.457203    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-model-cache\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.462917 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.462893    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-dshm\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.463497 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.463470    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a974d31f-4041-46ae-90ad-1b52f0745162-tls-certs\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.465847 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.465819    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrznr\" (UniqueName: \"kubernetes.io/projected/a974d31f-4041-46ae-90ad-1b52f0745162-kube-api-access-zrznr\") pod \"e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") " pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.563562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.563504    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:06.628653 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.628608    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 07 17:11:06.628794 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.628672    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 07 17:11:06.846371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.846336    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"]
Sep 07 17:11:06.849174 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:11:06.849126    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda974d31f_4041_46ae_90ad_1b52f0745162.slice/crio-47a64d81f24b0da3fb42f1e0551f0e5cfa7847ca8ab860c2314a4e89178994c5 WatchSource:0}: Error finding container 47a64d81f24b0da3fb42f1e0551f0e5cfa7847ca8ab860c2314a4e89178994c5: Status 404 returned error can't find the container with id 47a64d81f24b0da3fb42f1e0551f0e5cfa7847ca8ab860c2314a4e89178994c5
Sep 07 17:11:06.978251 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.978216    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn" event={"ID":"a974d31f-4041-46ae-90ad-1b52f0745162","Type":"ContainerStarted","Data":"752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75"}
Sep 07 17:11:06.978251 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:06.978256    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn" event={"ID":"a974d31f-4041-46ae-90ad-1b52f0745162","Type":"ContainerStarted","Data":"47a64d81f24b0da3fb42f1e0551f0e5cfa7847ca8ab860c2314a4e89178994c5"}
Sep 07 17:11:07.001762 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:07.001706    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn" podStartSLOduration=1.001687028 podStartE2EDuration="1.001687028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:06.998752473 +0000 UTC m=+878.639307292" watchObservedRunningTime="2026-09-07 17:11:07.001687028 +0000 UTC m=+878.642241892"
Sep 07 17:11:07.629421 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:07.629381    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 07 17:11:07.629659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:07.629452    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 07 17:11:08.632365 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:08.632326    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:11:08.632755 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:08.632630    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:11:08.633348 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:08.633332    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:11:09.660839 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:09.660803    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:11:11.372479 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.372444    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"]
Sep 07 17:11:11.374900 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.374883    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:11.378340 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.378320    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:11:11.405348 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.405304    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e028d9-c075-4628-a68d-851511044fa9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf\" (UID: \"e0e028d9-c075-4628-a68d-851511044fa9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:11.424308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.424236    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"]
Sep 07 17:11:11.506501 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.506460    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e028d9-c075-4628-a68d-851511044fa9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf\" (UID: \"e0e028d9-c075-4628-a68d-851511044fa9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:11.507142 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.507117    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e028d9-c075-4628-a68d-851511044fa9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf\" (UID: \"e0e028d9-c075-4628-a68d-851511044fa9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:11.685643 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.685527    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:11.955106 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:11.955077    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"]
Sep 07 17:11:11.956864 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:11:11.956835    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e028d9_c075_4628_a68d_851511044fa9.slice/crio-2ada8a03a9d6f327caa32e325c278c227f8a0e4c6be0aece2d7c1863357b87ed WatchSource:0}: Error finding container 2ada8a03a9d6f327caa32e325c278c227f8a0e4c6be0aece2d7c1863357b87ed: Status 404 returned error can't find the container with id 2ada8a03a9d6f327caa32e325c278c227f8a0e4c6be0aece2d7c1863357b87ed
Sep 07 17:11:12.007784 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:12.007749    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf" event={"ID":"e0e028d9-c075-4628-a68d-851511044fa9","Type":"ContainerStarted","Data":"2ada8a03a9d6f327caa32e325c278c227f8a0e4c6be0aece2d7c1863357b87ed"}
Sep 07 17:11:13.014950 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:13.014852    2545 generic.go:356] "Generic (PLEG): container finished" podID="e0e028d9-c075-4628-a68d-851511044fa9" containerID="54ba27c799e9f71ea0fea16bfd5c6525710ab476209b03c6297b0c204c156cd4" exitCode=0
Sep 07 17:11:13.014950 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:13.014903    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf" event={"ID":"e0e028d9-c075-4628-a68d-851511044fa9","Type":"ContainerDied","Data":"54ba27c799e9f71ea0fea16bfd5c6525710ab476209b03c6297b0c204c156cd4"}
Sep 07 17:11:14.150014 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:14.149986    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:14.233719 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:14.233680    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e028d9-c075-4628-a68d-851511044fa9-maas-api-service-ca\") pod \"e0e028d9-c075-4628-a68d-851511044fa9\" (UID: \"e0e028d9-c075-4628-a68d-851511044fa9\") "
Sep 07 17:11:14.234108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:14.234081    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e028d9-c075-4628-a68d-851511044fa9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0e028d9-c075-4628-a68d-851511044fa9" (UID: "e0e028d9-c075-4628-a68d-851511044fa9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:14.335084 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:14.335051    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e028d9-c075-4628-a68d-851511044fa9-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:15.026603 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:15.026566    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"
Sep 07 17:11:15.026603 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:15.026592    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf" event={"ID":"e0e028d9-c075-4628-a68d-851511044fa9","Type":"ContainerDied","Data":"2ada8a03a9d6f327caa32e325c278c227f8a0e4c6be0aece2d7c1863357b87ed"}
Sep 07 17:11:15.026806 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:15.026650    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ada8a03a9d6f327caa32e325c278c227f8a0e4c6be0aece2d7c1863357b87ed"
Sep 07 17:11:16.564627 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:16.564567    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:16.564627 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:16.564639    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:16.577420 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:16.577390    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:17.048810 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:17.048720    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:18.388693 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:18.388644    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"]
Sep 07 17:11:18.391008 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:18.390982    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f85216b6-s6klf"]
Sep 07 17:11:18.519688 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:18.519640    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"]
Sep 07 17:11:18.519879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:18.519848    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" containerID="cri-o://bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600" gracePeriod=30
Sep 07 17:11:18.889568 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:18.889515    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e028d9-c075-4628-a68d-851511044fa9" path="/var/lib/kubelet/pods/e0e028d9-c075-4628-a68d-851511044fa9/volumes"
Sep 07 17:11:19.320039 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.320003    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"]
Sep 07 17:11:19.320354 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.320341    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e028d9-c075-4628-a68d-851511044fa9" containerName="revoke-keys"
Sep 07 17:11:19.320401 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.320355    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e028d9-c075-4628-a68d-851511044fa9" containerName="revoke-keys"
Sep 07 17:11:19.320437 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.320433    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e028d9-c075-4628-a68d-851511044fa9" containerName="revoke-keys"
Sep 07 17:11:19.323245 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.323226    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.334853 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.334821    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d53e4343-openshift-default-dockercfg-f6xtm\""
Sep 07 17:11:19.349854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.349825    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"]
Sep 07 17:11:19.382695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382666    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-socket\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.382695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382698    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-credential-socket\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.382876 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382775    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljtf9\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-kube-api-access-ljtf9\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.382876 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382847    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5692adc2-5748-4069-89ac-7c6780bef34f-istio-podinfo\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.382937 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382877    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-certs\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.382937 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382911    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5692adc2-5748-4069-89ac-7c6780bef34f-istiod-ca-cert\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.383044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382952    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-data\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.383044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382971    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-envoy\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.383044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.382990    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-istio-token\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483353    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5692adc2-5748-4069-89ac-7c6780bef34f-istio-podinfo\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483390    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-certs\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483409    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5692adc2-5748-4069-89ac-7c6780bef34f-istiod-ca-cert\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483440    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-data\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483461    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-envoy\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483482    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-istio-token\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483558    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-socket\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483586    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-credential-socket\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483650    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljtf9\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-kube-api-access-ljtf9\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483854    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-certs\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.483924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.483905    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-data\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.484389 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.484001    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-socket\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.484389 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.484063    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-credential-socket\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.484630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.484608    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5692adc2-5748-4069-89ac-7c6780bef34f-istiod-ca-cert\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.485792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.485773    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-envoy\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.486144 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.486116    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5692adc2-5748-4069-89ac-7c6780bef34f-istio-podinfo\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.493372 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.493340    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-istio-token\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.495381 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.495357    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljtf9\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-kube-api-access-ljtf9\") pod \"e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") " pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.633311 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.633220    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:19.913873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.913843    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"]
Sep 07 17:11:19.915057 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:11:19.915037    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5692adc2_5748_4069_89ac_7c6780bef34f.slice/crio-88c1e3a0449e1f5e19bbf5964e22a41e84bb5df3df76f93ac4eb8802a5bc1b55 WatchSource:0}: Error finding container 88c1e3a0449e1f5e19bbf5964e22a41e84bb5df3df76f93ac4eb8802a5bc1b55: Status 404 returned error can't find the container with id 88c1e3a0449e1f5e19bbf5964e22a41e84bb5df3df76f93ac4eb8802a5bc1b55
Sep 07 17:11:19.917235 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.917204    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:19.917312 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.917268    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:19.917312 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:19.917297    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:20.056793 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:20.056745    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" event={"ID":"5692adc2-5748-4069-89ac-7c6780bef34f","Type":"ContainerStarted","Data":"5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"}
Sep 07 17:11:20.056973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:20.056809    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" event={"ID":"5692adc2-5748-4069-89ac-7c6780bef34f","Type":"ContainerStarted","Data":"88c1e3a0449e1f5e19bbf5964e22a41e84bb5df3df76f93ac4eb8802a5bc1b55"}
Sep 07 17:11:20.081259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:20.081188    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podStartSLOduration=1.081164217 podStartE2EDuration="1.081164217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:20.080128422 +0000 UTC m=+891.720683255" watchObservedRunningTime="2026-09-07 17:11:20.081164217 +0000 UTC m=+891.721719015"
Sep 07 17:11:20.634058 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:20.634015    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:20.639520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:20.639490    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:21.061700 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:21.061667    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:21.062636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:21.062610    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:23.633772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.633742    2545 patch_prober.go:28] interesting pod/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 07 17:11:23.634085 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.633832    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 07 17:11:23.766565 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.766524    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:11:23.829512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829479    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-envoy\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.829729 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829558    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-certs\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.829729 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829583    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istiod-ca-cert\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.829729 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829618    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-socket\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.829894 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829865    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-podinfo\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.829946 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829878    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:23.829946 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829901    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqzl8\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-kube-api-access-xqzl8\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.830140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.829964    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-data\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.830140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830011    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-credential-socket\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.830140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830036    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-token\") pod \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\" (UID: \"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f\") "
Sep 07 17:11:23.830140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830049    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:23.830400 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830318    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:23.830455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830411    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.830455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830428    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.830455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830441    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.830698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830676    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:23.830933 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.830909    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:23.832949 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.832920    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-kube-api-access-xqzl8" (OuterVolumeSpecName: "kube-api-access-xqzl8") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "kube-api-access-xqzl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:23.833064 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.832973    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:23.833127 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.833082    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:23.834404 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.834383    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" (UID: "8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:11:23.931265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.931224    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.931265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.931260    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.931265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.931269    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.931265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.931278    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqzl8\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-kube-api-access-xqzl8\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.931572 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.931287    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:23.931572 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:23.931295    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:24.079674 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.079585    2545 generic.go:356] "Generic (PLEG): container finished" podID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerID="bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600" exitCode=0
Sep 07 17:11:24.079674 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.079637    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"
Sep 07 17:11:24.079849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.079679    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" event={"ID":"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f","Type":"ContainerDied","Data":"bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600"}
Sep 07 17:11:24.079849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.079741    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv" event={"ID":"8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f","Type":"ContainerDied","Data":"d549fd029c64b542c527e4f9d726b0bdad03c6039db05f84a2e92aa2c9ec30e9"}
Sep 07 17:11:24.079849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.079770    2545 scope.go:117] "RemoveContainer" containerID="bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600"
Sep 07 17:11:24.089337 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.089318    2545 scope.go:117] "RemoveContainer" containerID="01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"
Sep 07 17:11:24.098624 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.098594    2545 scope.go:117] "RemoveContainer" containerID="bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600"
Sep 07 17:11:24.098924 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:11:24.098907    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600\": container with ID starting with bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600 not found: ID does not exist" containerID="bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600"
Sep 07 17:11:24.098994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.098933    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600"} err="failed to get container status \"bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600\": rpc error: code = NotFound desc = could not find container \"bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600\": container with ID starting with bff73499f5e077b2d593a060b13e4f43dbbf9225cc08823fdeac84ac002c4600 not found: ID does not exist"
Sep 07 17:11:24.098994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.098950    2545 scope.go:117] "RemoveContainer" containerID="01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"
Sep 07 17:11:24.099225 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:11:24.099207    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff\": container with ID starting with 01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff not found: ID does not exist" containerID="01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"
Sep 07 17:11:24.099307 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.099224    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff"} err="failed to get container status \"01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff\": rpc error: code = NotFound desc = could not find container \"01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff\": container with ID starting with 01b893807836220d0781e470577b47dc7b2390dd93f784c4ef3a119fcca143ff not found: ID does not exist"
Sep 07 17:11:24.104437 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.104408    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"]
Sep 07 17:11:24.109185 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.109158    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv"]
Sep 07 17:11:24.889308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:24.889271    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" path="/var/lib/kubelet/pods/8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f/volumes"
Sep 07 17:11:29.537324 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:29.537284    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:11:40.168020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:40.167975    2545 generic.go:356] "Generic (PLEG): container finished" podID="5692adc2-5748-4069-89ac-7c6780bef34f" containerID="5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0" exitCode=0
Sep 07 17:11:40.168475 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:40.168019    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" event={"ID":"5692adc2-5748-4069-89ac-7c6780bef34f","Type":"ContainerDied","Data":"5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"}
Sep 07 17:11:40.168475 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:40.168385    2545 scope.go:117] "RemoveContainer" containerID="5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"
Sep 07 17:11:40.169454 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:40.169407    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:40.169517 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:40.169488    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:40.169575 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:40.169521    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:41.175634 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:41.175598    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" event={"ID":"5692adc2-5748-4069-89ac-7c6780bef34f","Type":"ContainerStarted","Data":"332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee"}
Sep 07 17:11:41.634450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:41.634409    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:41.634682 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:41.634661    2545 patch_prober.go:28] interesting pod/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 17:11:41.634733 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:41.634705    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 17:11:42.633939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:42.633901    2545 patch_prober.go:28] interesting pod/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 17:11:42.634380 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:42.633958    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 17:11:43.634520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.634475    2545 patch_prober.go:28] interesting pod/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 17:11:43.634932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.634567    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 17:11:43.728610 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.728570    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"]
Sep 07 17:11:43.728968 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.728954    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy"
Sep 07 17:11:43.729017 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.728971    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy"
Sep 07 17:11:43.729017 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.728986    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy"
Sep 07 17:11:43.729017 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.728994    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy"
Sep 07 17:11:43.729124 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.729047    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy"
Sep 07 17:11:43.731087 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.731070    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:43.733856 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.733832    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:11:43.743711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.743669    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"]
Sep 07 17:11:43.814327 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.814286    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10109d90-cf00-4502-bfdf-8cacc219b8bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3f5660-7svxw\" (UID: \"10109d90-cf00-4502-bfdf-8cacc219b8bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:43.915458 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.915353    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10109d90-cf00-4502-bfdf-8cacc219b8bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3f5660-7svxw\" (UID: \"10109d90-cf00-4502-bfdf-8cacc219b8bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:43.916035 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:43.916015    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10109d90-cf00-4502-bfdf-8cacc219b8bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3f5660-7svxw\" (UID: \"10109d90-cf00-4502-bfdf-8cacc219b8bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:44.015839 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:44.015802    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"]
Sep 07 17:11:44.055436 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:44.050794    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:44.331337 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:44.331299    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"]
Sep 07 17:11:44.334257 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:11:44.334220    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10109d90_cf00_4502_bfdf_8cacc219b8bc.slice/crio-4276f80066810d55f440b75668ad07ffaa09743973ea0fe4c561506737abc475 WatchSource:0}: Error finding container 4276f80066810d55f440b75668ad07ffaa09743973ea0fe4c561506737abc475: Status 404 returned error can't find the container with id 4276f80066810d55f440b75668ad07ffaa09743973ea0fe4c561506737abc475
Sep 07 17:11:44.634004 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:44.633912    2545 patch_prober.go:28] interesting pod/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 17:11:44.634004 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:44.633973    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 17:11:45.198247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:45.198207    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw" event={"ID":"10109d90-cf00-4502-bfdf-8cacc219b8bc","Type":"ContainerStarted","Data":"d26539cb70b1fcbf6547508c89727ff21e838e9f50f2b29b2c7e3e57f5dd402d"}
Sep 07 17:11:45.198645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:45.198264    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw" event={"ID":"10109d90-cf00-4502-bfdf-8cacc219b8bc","Type":"ContainerStarted","Data":"4276f80066810d55f440b75668ad07ffaa09743973ea0fe4c561506737abc475"}
Sep 07 17:11:45.215125 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:45.215063    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw" podStartSLOduration=2.2150470110000002 podStartE2EDuration="2.215047011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:45.213708455 +0000 UTC m=+916.854263271" watchObservedRunningTime="2026-09-07 17:11:45.215047011 +0000 UTC m=+916.855601806"
Sep 07 17:11:45.634052 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:45.634016    2545 patch_prober.go:28] interesting pod/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 17:11:45.634240 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:45.634077    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 17:11:46.107104 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:46.107070    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"]
Sep 07 17:11:46.208315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:46.208270    2545 generic.go:356] "Generic (PLEG): container finished" podID="10109d90-cf00-4502-bfdf-8cacc219b8bc" containerID="d26539cb70b1fcbf6547508c89727ff21e838e9f50f2b29b2c7e3e57f5dd402d" exitCode=0
Sep 07 17:11:46.208850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:46.208362    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw" event={"ID":"10109d90-cf00-4502-bfdf-8cacc219b8bc","Type":"ContainerDied","Data":"d26539cb70b1fcbf6547508c89727ff21e838e9f50f2b29b2c7e3e57f5dd402d"}
Sep 07 17:11:46.637797 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:46.637764    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:46.638153 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:46.638132    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:46.638879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:46.638855    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:11:47.217084 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.217059    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"]
Sep 07 17:11:47.217467 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.217453    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa9e9fe-f6a8-4dec-80d2-f88662e93f3f" containerName="istio-proxy"
Sep 07 17:11:47.219276 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.219259    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:47.234577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.234530    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"]
Sep 07 17:11:47.247872 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.247838    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9a6442-fce5-4808-b99e-9520c4aeb68c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj\" (UID: \"1c9a6442-fce5-4808-b99e-9520c4aeb68c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:47.348453 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.348427    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:47.348785 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.348760    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9a6442-fce5-4808-b99e-9520c4aeb68c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj\" (UID: \"1c9a6442-fce5-4808-b99e-9520c4aeb68c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:47.349316 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.349298    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9a6442-fce5-4808-b99e-9520c4aeb68c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj\" (UID: \"1c9a6442-fce5-4808-b99e-9520c4aeb68c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:47.449362 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.449324    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10109d90-cf00-4502-bfdf-8cacc219b8bc-maas-api-service-ca\") pod \"10109d90-cf00-4502-bfdf-8cacc219b8bc\" (UID: \"10109d90-cf00-4502-bfdf-8cacc219b8bc\") "
Sep 07 17:11:47.450564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.450025    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10109d90-cf00-4502-bfdf-8cacc219b8bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "10109d90-cf00-4502-bfdf-8cacc219b8bc" (UID: "10109d90-cf00-4502-bfdf-8cacc219b8bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:47.511458 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.511353    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:11:47.529999 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.529956    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:47.551389 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.551357    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10109d90-cf00-4502-bfdf-8cacc219b8bc-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:47.802106 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:47.802075    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"]
Sep 07 17:11:47.803840 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:11:47.803806    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9a6442_fce5_4808_b99e_9520c4aeb68c.slice/crio-eec524bdf448268515c5c7b50886615f077bc9cd2014fcace440fd2eafe248f2 WatchSource:0}: Error finding container eec524bdf448268515c5c7b50886615f077bc9cd2014fcace440fd2eafe248f2: Status 404 returned error can't find the container with id eec524bdf448268515c5c7b50886615f077bc9cd2014fcace440fd2eafe248f2
Sep 07 17:11:48.220632 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:48.220596    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"
Sep 07 17:11:48.221069 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:48.220607    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw" event={"ID":"10109d90-cf00-4502-bfdf-8cacc219b8bc","Type":"ContainerDied","Data":"4276f80066810d55f440b75668ad07ffaa09743973ea0fe4c561506737abc475"}
Sep 07 17:11:48.221069 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:48.220776    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4276f80066810d55f440b75668ad07ffaa09743973ea0fe4c561506737abc475"
Sep 07 17:11:48.222334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:48.222308    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj" event={"ID":"1c9a6442-fce5-4808-b99e-9520c4aeb68c","Type":"ContainerStarted","Data":"9f8465cccad6b23243b780b81a67c330059f3e39ffb1b5c411eeefd19ffe527f"}
Sep 07 17:11:48.222465 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:48.222348    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj" event={"ID":"1c9a6442-fce5-4808-b99e-9520c4aeb68c","Type":"ContainerStarted","Data":"eec524bdf448268515c5c7b50886615f077bc9cd2014fcace440fd2eafe248f2"}
Sep 07 17:11:48.265255 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:48.265201    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj" podStartSLOduration=1.265183252 podStartE2EDuration="1.265183252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:48.243723418 +0000 UTC m=+919.884278227" watchObservedRunningTime="2026-09-07 17:11:48.265183252 +0000 UTC m=+919.905738051"
Sep 07 17:11:49.229915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:49.229876    2545 generic.go:356] "Generic (PLEG): container finished" podID="1c9a6442-fce5-4808-b99e-9520c4aeb68c" containerID="9f8465cccad6b23243b780b81a67c330059f3e39ffb1b5c411eeefd19ffe527f" exitCode=0
Sep 07 17:11:49.229915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:49.229920    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj" event={"ID":"1c9a6442-fce5-4808-b99e-9520c4aeb68c","Type":"ContainerDied","Data":"9f8465cccad6b23243b780b81a67c330059f3e39ffb1b5c411eeefd19ffe527f"}
Sep 07 17:11:50.365442 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:50.365415    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:50.478873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:50.478840    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9a6442-fce5-4808-b99e-9520c4aeb68c-maas-api-service-ca\") pod \"1c9a6442-fce5-4808-b99e-9520c4aeb68c\" (UID: \"1c9a6442-fce5-4808-b99e-9520c4aeb68c\") "
Sep 07 17:11:50.479219 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:50.479196    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c9a6442-fce5-4808-b99e-9520c4aeb68c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c9a6442-fce5-4808-b99e-9520c4aeb68c" (UID: "1c9a6442-fce5-4808-b99e-9520c4aeb68c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:50.580166 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:50.580122    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9a6442-fce5-4808-b99e-9520c4aeb68c-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:51.241683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:51.241600    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"
Sep 07 17:11:51.241683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:51.241624    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj" event={"ID":"1c9a6442-fce5-4808-b99e-9520c4aeb68c","Type":"ContainerDied","Data":"eec524bdf448268515c5c7b50886615f077bc9cd2014fcace440fd2eafe248f2"}
Sep 07 17:11:51.241683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:51.241678    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec524bdf448268515c5c7b50886615f077bc9cd2014fcace440fd2eafe248f2"
Sep 07 17:11:53.767962 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:53.767910    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"]
Sep 07 17:11:53.770736 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:53.770713    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d53e4343-dnhjj"]
Sep 07 17:11:54.718181 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:54.718146    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"]
Sep 07 17:11:54.718384 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:54.718346    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p" podUID="4855c0b3-8730-4157-930b-33fb303cfd9d" containerName="maas-api" containerID="cri-o://9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b" gracePeriod=30
Sep 07 17:11:54.891051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:54.891016    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c9a6442-fce5-4808-b99e-9520c4aeb68c" path="/var/lib/kubelet/pods/1c9a6442-fce5-4808-b99e-9520c4aeb68c/volumes"
Sep 07 17:11:54.891404 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:54.891291    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"]
Sep 07 17:11:54.891502 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:54.891482    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy" containerID="cri-o://332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee" gracePeriod=30
Sep 07 17:11:54.988738 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:54.988711    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:11:55.022768 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.022733    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jspk7\" (UniqueName: \"kubernetes.io/projected/4855c0b3-8730-4157-930b-33fb303cfd9d-kube-api-access-jspk7\") pod \"4855c0b3-8730-4157-930b-33fb303cfd9d\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") "
Sep 07 17:11:55.022945 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.022791    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4855c0b3-8730-4157-930b-33fb303cfd9d-openshift-service-ca\") pod \"4855c0b3-8730-4157-930b-33fb303cfd9d\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") "
Sep 07 17:11:55.022945 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.022832    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-maas-api-tls\") pod \"4855c0b3-8730-4157-930b-33fb303cfd9d\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") "
Sep 07 17:11:55.022945 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.022894    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"]
Sep 07 17:11:55.022945 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.022922    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-metrics-certs\") pod \"4855c0b3-8730-4157-930b-33fb303cfd9d\" (UID: \"4855c0b3-8730-4157-930b-33fb303cfd9d\") "
Sep 07 17:11:55.023288 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.023254    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4855c0b3-8730-4157-930b-33fb303cfd9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4855c0b3-8730-4157-930b-33fb303cfd9d" (UID: "4855c0b3-8730-4157-930b-33fb303cfd9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:55.025081 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.025042    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4855c0b3-8730-4157-930b-33fb303cfd9d" (UID: "4855c0b3-8730-4157-930b-33fb303cfd9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:55.025212 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.025146    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4855c0b3-8730-4157-930b-33fb303cfd9d-kube-api-access-jspk7" (OuterVolumeSpecName: "kube-api-access-jspk7") pod "4855c0b3-8730-4157-930b-33fb303cfd9d" (UID: "4855c0b3-8730-4157-930b-33fb303cfd9d"). InnerVolumeSpecName "kube-api-access-jspk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:55.025256 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.025220    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4855c0b3-8730-4157-930b-33fb303cfd9d" (UID: "4855c0b3-8730-4157-930b-33fb303cfd9d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:55.032230 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.032115    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3f5660-7svxw"]
Sep 07 17:11:55.124562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.124513    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jspk7\" (UniqueName: \"kubernetes.io/projected/4855c0b3-8730-4157-930b-33fb303cfd9d-kube-api-access-jspk7\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.124717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.124585    2545 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4855c0b3-8730-4157-930b-33fb303cfd9d-openshift-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.124717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.124598    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-maas-api-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.124717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.124607    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4855c0b3-8730-4157-930b-33fb303cfd9d-metrics-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:55.264158 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.264062    2545 generic.go:356] "Generic (PLEG): container finished" podID="4855c0b3-8730-4157-930b-33fb303cfd9d" containerID="9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b" exitCode=0
Sep 07 17:11:55.264158 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.264114    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"
Sep 07 17:11:55.264334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.264150    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p" event={"ID":"4855c0b3-8730-4157-930b-33fb303cfd9d","Type":"ContainerDied","Data":"9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b"}
Sep 07 17:11:55.264334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.264202    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p" event={"ID":"4855c0b3-8730-4157-930b-33fb303cfd9d","Type":"ContainerDied","Data":"93046f1dfc7cb79cbc567dd9cda075b0fcccc753a8883ef7c488ab59c894ccb2"}
Sep 07 17:11:55.264334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.264226    2545 scope.go:117] "RemoveContainer" containerID="9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b"
Sep 07 17:11:55.273914 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.273893    2545 scope.go:117] "RemoveContainer" containerID="9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b"
Sep 07 17:11:55.274213 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:11:55.274194    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b\": container with ID starting with 9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b not found: ID does not exist" containerID="9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b"
Sep 07 17:11:55.274278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.274227    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b"} err="failed to get container status \"9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b\": rpc error: code = NotFound desc = could not find container \"9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b\": container with ID starting with 9eb576f4a605efcf9fe902982a0091071f069d700fa66b0f5443cec6281da07b not found: ID does not exist"
Sep 07 17:11:55.285884 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.285854    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"]
Sep 07 17:11:55.287879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.287857    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f5660-55b4c7d46c-thm8p"]
Sep 07 17:11:55.844497 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844462    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"]
Sep 07 17:11:55.844908 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844890    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10109d90-cf00-4502-bfdf-8cacc219b8bc" containerName="revoke-keys"
Sep 07 17:11:55.845001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844910    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="10109d90-cf00-4502-bfdf-8cacc219b8bc" containerName="revoke-keys"
Sep 07 17:11:55.845001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844940    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4855c0b3-8730-4157-930b-33fb303cfd9d" containerName="maas-api"
Sep 07 17:11:55.845001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844949    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="4855c0b3-8730-4157-930b-33fb303cfd9d" containerName="maas-api"
Sep 07 17:11:55.845001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844969    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c9a6442-fce5-4808-b99e-9520c4aeb68c" containerName="revoke-keys"
Sep 07 17:11:55.845001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.844978    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c9a6442-fce5-4808-b99e-9520c4aeb68c" containerName="revoke-keys"
Sep 07 17:11:55.845237 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.845063    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c9a6442-fce5-4808-b99e-9520c4aeb68c" containerName="revoke-keys"
Sep 07 17:11:55.845237 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.845077    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="10109d90-cf00-4502-bfdf-8cacc219b8bc" containerName="revoke-keys"
Sep 07 17:11:55.845237 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.845086    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="4855c0b3-8730-4157-930b-33fb303cfd9d" containerName="maas-api"
Sep 07 17:11:55.847722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.847700    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.850501 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.850485    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c586c514-openshift-default-dockercfg-4c22z\""
Sep 07 17:11:55.860290 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.860265    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"]
Sep 07 17:11:55.931387 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931335    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-data\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931392    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-credential-socket\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931475    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istiod-ca-cert\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931577    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-socket\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931618    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r45pw\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-kube-api-access-r45pw\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931645    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-certs\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931743    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-envoy\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931792    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-podinfo\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:55.931883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:55.931843    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-token\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.032805 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032766    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-envoy\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.032805 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032803    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-podinfo\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032832    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-token\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032877    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-data\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032898    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-credential-socket\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032919    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istiod-ca-cert\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032954    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-socket\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.032984    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r45pw\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-kube-api-access-r45pw\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.033010    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-certs\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033428 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.033356    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-credential-socket\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033428 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.033384    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-data\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.033481    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-socket\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.033742    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-certs\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.033854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.033836    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istiod-ca-cert\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.035305 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.035283    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-envoy\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.035464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.035442    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-podinfo\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.042181 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.042152    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-token\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.044293 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.044269    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r45pw\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-kube-api-access-r45pw\") pod \"e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") " pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.158803 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.158704    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:56.436712 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.436678    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"]
Sep 07 17:11:56.438458 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:11:56.438432    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa33540_faa6_4d80_a4ab_0cf8c4527027.slice/crio-e6aefad787cb1765d9862671ad6819e0e719771cb2c1b48a243c8663bba55135 WatchSource:0}: Error finding container e6aefad787cb1765d9862671ad6819e0e719771cb2c1b48a243c8663bba55135: Status 404 returned error can't find the container with id e6aefad787cb1765d9862671ad6819e0e719771cb2c1b48a243c8663bba55135
Sep 07 17:11:56.440784 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.440750    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:56.440854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.440817    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:56.440854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.440846    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:11:56.893131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.893094    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10109d90-cf00-4502-bfdf-8cacc219b8bc" path="/var/lib/kubelet/pods/10109d90-cf00-4502-bfdf-8cacc219b8bc/volumes"
Sep 07 17:11:56.893731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:56.893708    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4855c0b3-8730-4157-930b-33fb303cfd9d" path="/var/lib/kubelet/pods/4855c0b3-8730-4157-930b-33fb303cfd9d/volumes"
Sep 07 17:11:57.283466 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:57.283376    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" event={"ID":"5fa33540-faa6-4d80-a4ab-0cf8c4527027","Type":"ContainerStarted","Data":"528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"}
Sep 07 17:11:57.283466 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:57.283426    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" event={"ID":"5fa33540-faa6-4d80-a4ab-0cf8c4527027","Type":"ContainerStarted","Data":"e6aefad787cb1765d9862671ad6819e0e719771cb2c1b48a243c8663bba55135"}
Sep 07 17:11:57.310978 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:57.310926    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podStartSLOduration=2.310908473 podStartE2EDuration="2.310908473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:57.3097071 +0000 UTC m=+928.950261919" watchObservedRunningTime="2026-09-07 17:11:57.310908473 +0000 UTC m=+928.951463268"
Sep 07 17:11:58.159171 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:58.159127    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:58.164305 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:58.164278    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:58.289522 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:58.289489    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:58.290399 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:58.290370    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:11:59.035437 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.035397    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn" podUID="a974d31f-4041-46ae-90ad-1b52f0745162" containerName="main" containerID="cri-o://752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75" gracePeriod=45
Sep 07 17:11:59.293909 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.293846    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:59.295452 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.295425    2545 generic.go:356] "Generic (PLEG): container finished" podID="a974d31f-4041-46ae-90ad-1b52f0745162" containerID="752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75" exitCode=0
Sep 07 17:11:59.295595 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.295464    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"
Sep 07 17:11:59.295595 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.295484    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn" event={"ID":"a974d31f-4041-46ae-90ad-1b52f0745162","Type":"ContainerDied","Data":"752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75"}
Sep 07 17:11:59.295595 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.295526    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn" event={"ID":"a974d31f-4041-46ae-90ad-1b52f0745162","Type":"ContainerDied","Data":"47a64d81f24b0da3fb42f1e0551f0e5cfa7847ca8ab860c2314a4e89178994c5"}
Sep 07 17:11:59.295595 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.295563    2545 scope.go:117] "RemoveContainer" containerID="752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75"
Sep 07 17:11:59.304072 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.304056    2545 scope.go:117] "RemoveContainer" containerID="752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75"
Sep 07 17:11:59.304342 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:11:59.304323    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75\": container with ID starting with 752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75 not found: ID does not exist" containerID="752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75"
Sep 07 17:11:59.304393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.304354    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75"} err="failed to get container status \"752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75\": rpc error: code = NotFound desc = could not find container \"752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75\": container with ID starting with 752f574a8ea18190e8566b5722ed8f8066a20fe8f33d13bb01290edc1af90b75 not found: ID does not exist"
Sep 07 17:11:59.364491 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364453    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-home\") pod \"a974d31f-4041-46ae-90ad-1b52f0745162\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") "
Sep 07 17:11:59.364708 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364500    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a974d31f-4041-46ae-90ad-1b52f0745162-tls-certs\") pod \"a974d31f-4041-46ae-90ad-1b52f0745162\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") "
Sep 07 17:11:59.364708 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364531    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-model-cache\") pod \"a974d31f-4041-46ae-90ad-1b52f0745162\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") "
Sep 07 17:11:59.364708 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364610    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrznr\" (UniqueName: \"kubernetes.io/projected/a974d31f-4041-46ae-90ad-1b52f0745162-kube-api-access-zrznr\") pod \"a974d31f-4041-46ae-90ad-1b52f0745162\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") "
Sep 07 17:11:59.364708 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364638    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-dshm\") pod \"a974d31f-4041-46ae-90ad-1b52f0745162\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") "
Sep 07 17:11:59.364708 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364707    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-tmp-dir\") pod \"a974d31f-4041-46ae-90ad-1b52f0745162\" (UID: \"a974d31f-4041-46ae-90ad-1b52f0745162\") "
Sep 07 17:11:59.364969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364823    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-home" (OuterVolumeSpecName: "home") pod "a974d31f-4041-46ae-90ad-1b52f0745162" (UID: "a974d31f-4041-46ae-90ad-1b52f0745162"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:59.364969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.364864    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-model-cache" (OuterVolumeSpecName: "model-cache") pod "a974d31f-4041-46ae-90ad-1b52f0745162" (UID: "a974d31f-4041-46ae-90ad-1b52f0745162"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:59.365142 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.365111    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-home\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:59.365201 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.365149    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-model-cache\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:59.365399 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.365367    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a974d31f-4041-46ae-90ad-1b52f0745162" (UID: "a974d31f-4041-46ae-90ad-1b52f0745162"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:59.367224 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.367200    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-dshm" (OuterVolumeSpecName: "dshm") pod "a974d31f-4041-46ae-90ad-1b52f0745162" (UID: "a974d31f-4041-46ae-90ad-1b52f0745162"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:59.367408 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.367387    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a974d31f-4041-46ae-90ad-1b52f0745162-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a974d31f-4041-46ae-90ad-1b52f0745162" (UID: "a974d31f-4041-46ae-90ad-1b52f0745162"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:59.367474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.367392    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a974d31f-4041-46ae-90ad-1b52f0745162-kube-api-access-zrznr" (OuterVolumeSpecName: "kube-api-access-zrznr") pod "a974d31f-4041-46ae-90ad-1b52f0745162" (UID: "a974d31f-4041-46ae-90ad-1b52f0745162"). InnerVolumeSpecName "kube-api-access-zrznr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:59.466717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.466675    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-tmp-dir\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:59.466717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.466717    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a974d31f-4041-46ae-90ad-1b52f0745162-tls-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:59.466963 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.466735    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrznr\" (UniqueName: \"kubernetes.io/projected/a974d31f-4041-46ae-90ad-1b52f0745162-kube-api-access-zrznr\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:59.466963 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.466750    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a974d31f-4041-46ae-90ad-1b52f0745162-dshm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:11:59.618825 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.618788    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"]
Sep 07 17:11:59.626586 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:11:59.626554    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-2b812a80-kserve-788449597c-sxkxn"]
Sep 07 17:12:00.158869 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.158812    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:12:00.275627 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275593    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-data\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.275818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275655    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5692adc2-5748-4069-89ac-7c6780bef34f-istiod-ca-cert\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.275818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275676    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-envoy\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.275818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275702    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljtf9\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-kube-api-access-ljtf9\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.275818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275737    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-credential-socket\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.275818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275758    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-socket\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.275818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275816    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5692adc2-5748-4069-89ac-7c6780bef34f-istio-podinfo\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.276120 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275872    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-certs\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.276120 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275911    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-istio-token\") pod \"5692adc2-5748-4069-89ac-7c6780bef34f\" (UID: \"5692adc2-5748-4069-89ac-7c6780bef34f\") "
Sep 07 17:12:00.276120 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.275907    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.276120 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276026    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.276120 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276098    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.276373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276174    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.276373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276174    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5692adc2-5748-4069-89ac-7c6780bef34f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:00.276373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276239    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.276373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276259    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.276373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.276275    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.278037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.278006    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:00.278167 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.278032    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:00.278167 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.278069    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-kube-api-access-ljtf9" (OuterVolumeSpecName: "kube-api-access-ljtf9") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "kube-api-access-ljtf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:00.278167 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.278154    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5692adc2-5748-4069-89ac-7c6780bef34f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5692adc2-5748-4069-89ac-7c6780bef34f" (UID: "5692adc2-5748-4069-89ac-7c6780bef34f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:12:00.302605 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.302570    2545 generic.go:356] "Generic (PLEG): container finished" podID="5692adc2-5748-4069-89ac-7c6780bef34f" containerID="332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee" exitCode=0
Sep 07 17:12:00.303010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.302617    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"
Sep 07 17:12:00.303010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.302652    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" event={"ID":"5692adc2-5748-4069-89ac-7c6780bef34f","Type":"ContainerDied","Data":"332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee"}
Sep 07 17:12:00.303010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.302734    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv" event={"ID":"5692adc2-5748-4069-89ac-7c6780bef34f","Type":"ContainerDied","Data":"88c1e3a0449e1f5e19bbf5964e22a41e84bb5df3df76f93ac4eb8802a5bc1b55"}
Sep 07 17:12:00.303010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.302766    2545 scope.go:117] "RemoveContainer" containerID="332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee"
Sep 07 17:12:00.312467 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.312450    2545 scope.go:117] "RemoveContainer" containerID="5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"
Sep 07 17:12:00.321056 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.321040    2545 scope.go:117] "RemoveContainer" containerID="332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee"
Sep 07 17:12:00.321339 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:12:00.321318    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee\": container with ID starting with 332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee not found: ID does not exist" containerID="332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee"
Sep 07 17:12:00.321394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.321347    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee"} err="failed to get container status \"332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee\": rpc error: code = NotFound desc = could not find container \"332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee\": container with ID starting with 332f68b015ca5c6b08d5554b3435b601aa1c07bccbbc7e02379c63a83856fcee not found: ID does not exist"
Sep 07 17:12:00.321394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.321364    2545 scope.go:117] "RemoveContainer" containerID="5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"
Sep 07 17:12:00.321614 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:12:00.321595    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0\": container with ID starting with 5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0 not found: ID does not exist" containerID="5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"
Sep 07 17:12:00.321677 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.321623    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0"} err="failed to get container status \"5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0\": rpc error: code = NotFound desc = could not find container \"5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0\": container with ID starting with 5810e341ebddfd91148937b1bc19c3c0549e0f225be0684d2dd2f6754d4153b0 not found: ID does not exist"
Sep 07 17:12:00.327266 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.327244    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"]
Sep 07 17:12:00.331603 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.331577    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv"]
Sep 07 17:12:00.377044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.377007    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.377044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.377037    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5692adc2-5748-4069-89ac-7c6780bef34f-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.377044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.377051    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.377323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.377063    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljtf9\" (UniqueName: \"kubernetes.io/projected/5692adc2-5748-4069-89ac-7c6780bef34f-kube-api-access-ljtf9\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.377323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.377077    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5692adc2-5748-4069-89ac-7c6780bef34f-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.377323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.377092    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5692adc2-5748-4069-89ac-7c6780bef34f-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:00.889328 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.889287    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" path="/var/lib/kubelet/pods/5692adc2-5748-4069-89ac-7c6780bef34f/volumes"
Sep 07 17:12:00.889765 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:00.889750    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a974d31f-4041-46ae-90ad-1b52f0745162" path="/var/lib/kubelet/pods/a974d31f-4041-46ae-90ad-1b52f0745162/volumes"
Sep 07 17:12:01.126304 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.126263    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5" podUID="041e2e58-cd71-4a66-b637-f7425d6a69af" containerName="main" containerID="cri-o://568979f16672aecf0ddf8e2b778a2e1013377d9382a7c4c53531a2b3e28cff77" gracePeriod=45
Sep 07 17:12:01.312887 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.312856    2545 generic.go:356] "Generic (PLEG): container finished" podID="041e2e58-cd71-4a66-b637-f7425d6a69af" containerID="568979f16672aecf0ddf8e2b778a2e1013377d9382a7c4c53531a2b3e28cff77" exitCode=0
Sep 07 17:12:01.313273 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.312942    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5" event={"ID":"041e2e58-cd71-4a66-b637-f7425d6a69af","Type":"ContainerDied","Data":"568979f16672aecf0ddf8e2b778a2e1013377d9382a7c4c53531a2b3e28cff77"}
Sep 07 17:12:01.369184 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.369159    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:12:01.487733 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487641    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-tmp-dir\") pod \"041e2e58-cd71-4a66-b637-f7425d6a69af\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") "
Sep 07 17:12:01.487733 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487690    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-home\") pod \"041e2e58-cd71-4a66-b637-f7425d6a69af\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") "
Sep 07 17:12:01.487980 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487769    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvbsr\" (UniqueName: \"kubernetes.io/projected/041e2e58-cd71-4a66-b637-f7425d6a69af-kube-api-access-dvbsr\") pod \"041e2e58-cd71-4a66-b637-f7425d6a69af\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") "
Sep 07 17:12:01.487980 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487789    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-dshm\") pod \"041e2e58-cd71-4a66-b637-f7425d6a69af\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") "
Sep 07 17:12:01.487980 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487809    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041e2e58-cd71-4a66-b637-f7425d6a69af-tls-certs\") pod \"041e2e58-cd71-4a66-b637-f7425d6a69af\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") "
Sep 07 17:12:01.487980 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487831    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-model-cache\") pod \"041e2e58-cd71-4a66-b637-f7425d6a69af\" (UID: \"041e2e58-cd71-4a66-b637-f7425d6a69af\") "
Sep 07 17:12:01.487980 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.487952    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "041e2e58-cd71-4a66-b637-f7425d6a69af" (UID: "041e2e58-cd71-4a66-b637-f7425d6a69af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:01.488236 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.488098    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-home" (OuterVolumeSpecName: "home") pod "041e2e58-cd71-4a66-b637-f7425d6a69af" (UID: "041e2e58-cd71-4a66-b637-f7425d6a69af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:01.488236 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.488188    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-model-cache" (OuterVolumeSpecName: "model-cache") pod "041e2e58-cd71-4a66-b637-f7425d6a69af" (UID: "041e2e58-cd71-4a66-b637-f7425d6a69af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:01.488236 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.488228    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-tmp-dir\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:01.488358 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.488248    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-home\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:01.490030 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.490009    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-dshm" (OuterVolumeSpecName: "dshm") pod "041e2e58-cd71-4a66-b637-f7425d6a69af" (UID: "041e2e58-cd71-4a66-b637-f7425d6a69af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:01.490101 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.490012    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/041e2e58-cd71-4a66-b637-f7425d6a69af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "041e2e58-cd71-4a66-b637-f7425d6a69af" (UID: "041e2e58-cd71-4a66-b637-f7425d6a69af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:12:01.490101 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.490086    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/041e2e58-cd71-4a66-b637-f7425d6a69af-kube-api-access-dvbsr" (OuterVolumeSpecName: "kube-api-access-dvbsr") pod "041e2e58-cd71-4a66-b637-f7425d6a69af" (UID: "041e2e58-cd71-4a66-b637-f7425d6a69af"). InnerVolumeSpecName "kube-api-access-dvbsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:01.589373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.589328    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041e2e58-cd71-4a66-b637-f7425d6a69af-tls-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:01.589373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.589363    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-model-cache\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:01.589373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.589376    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvbsr\" (UniqueName: \"kubernetes.io/projected/041e2e58-cd71-4a66-b637-f7425d6a69af-kube-api-access-dvbsr\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:01.589674 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:01.589390    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/041e2e58-cd71-4a66-b637-f7425d6a69af-dshm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:02.320487 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:02.320455    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"
Sep 07 17:12:02.320970 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:02.320455    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5" event={"ID":"041e2e58-cd71-4a66-b637-f7425d6a69af","Type":"ContainerDied","Data":"4c5300fcce4a7388cd59d9e7b3314c605d399f22ef065da3e5be19f76df42a38"}
Sep 07 17:12:02.320970 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:02.320584    2545 scope.go:117] "RemoveContainer" containerID="568979f16672aecf0ddf8e2b778a2e1013377d9382a7c4c53531a2b3e28cff77"
Sep 07 17:12:02.345634 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:02.345594    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"]
Sep 07 17:12:02.350051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:02.350014    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-2b812a80-kserve-8c7bd589f-c6ph5"]
Sep 07 17:12:02.888917 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:02.888883    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="041e2e58-cd71-4a66-b637-f7425d6a69af" path="/var/lib/kubelet/pods/041e2e58-cd71-4a66-b637-f7425d6a69af/volumes"
Sep 07 17:12:04.007770 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.007735    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"]
Sep 07 17:12:04.008224 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008209    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041e2e58-cd71-4a66-b637-f7425d6a69af" containerName="main"
Sep 07 17:12:04.008287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008227    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="041e2e58-cd71-4a66-b637-f7425d6a69af" containerName="main"
Sep 07 17:12:04.008287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008247    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a974d31f-4041-46ae-90ad-1b52f0745162" containerName="main"
Sep 07 17:12:04.008287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008255    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a974d31f-4041-46ae-90ad-1b52f0745162" containerName="main"
Sep 07 17:12:04.008287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008271    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy"
Sep 07 17:12:04.008287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008280    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy"
Sep 07 17:12:04.008464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008295    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy"
Sep 07 17:12:04.008464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008303    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy"
Sep 07 17:12:04.008464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008379    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy"
Sep 07 17:12:04.008464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008389    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="5692adc2-5748-4069-89ac-7c6780bef34f" containerName="istio-proxy"
Sep 07 17:12:04.008464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008398    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="041e2e58-cd71-4a66-b637-f7425d6a69af" containerName="main"
Sep 07 17:12:04.008464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.008406    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="a974d31f-4041-46ae-90ad-1b52f0745162" containerName="main"
Sep 07 17:12:04.011436 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.011415    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.014178 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.014152    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-3c1adc-openshift-default-dockercfg-894zh\""
Sep 07 17:12:04.028275 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.028242    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"]
Sep 07 17:12:04.113999 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.113958    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-data\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114012    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-envoy\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114040    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-socket\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114140    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-credential-socket\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114187    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-certs\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114209    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-token\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114503 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114239    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-podinfo\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.114503 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.114263    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjdrs\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-kube-api-access-kjdrs\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.115121 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.115082    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/368559b0-4fca-4ee8-9015-72d316ae15ae-istiod-ca-cert\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216216    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-credential-socket\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216277    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-certs\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216300    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-token\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216333    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-podinfo\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216362    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjdrs\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-kube-api-access-kjdrs\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216416    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/368559b0-4fca-4ee8-9015-72d316ae15ae-istiod-ca-cert\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216453    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-data\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216809 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216484    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-envoy\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216809 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216509    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-socket\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216809 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216730    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-credential-socket\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.216809 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216782    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-certs\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.217086 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.216966    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-data\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.217086 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.217015    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-socket\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.217367 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.217343    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/368559b0-4fca-4ee8-9015-72d316ae15ae-istiod-ca-cert\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.218936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.218914    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-envoy\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.219125 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.219105    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-podinfo\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.232785 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.232746    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-token\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.233080 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.233059    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjdrs\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-kube-api-access-kjdrs\") pod \"e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") " pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.321140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.321108    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:04.607875 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.607728    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"]
Sep 07 17:12:04.610414 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:12:04.610382    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368559b0_4fca_4ee8_9015_72d316ae15ae.slice/crio-3a29fd75a124304d755be4d2cdd06d3119784037000ff6eb642dd1ccce8fa1d9 WatchSource:0}: Error finding container 3a29fd75a124304d755be4d2cdd06d3119784037000ff6eb642dd1ccce8fa1d9: Status 404 returned error can't find the container with id 3a29fd75a124304d755be4d2cdd06d3119784037000ff6eb642dd1ccce8fa1d9
Sep 07 17:12:04.612654 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.612619    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:04.612752 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.612701    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:04.612752 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:04.612744    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:05.339313 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:05.339278    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" event={"ID":"368559b0-4fca-4ee8-9015-72d316ae15ae","Type":"ContainerStarted","Data":"eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"}
Sep 07 17:12:05.339710 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:05.339335    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" event={"ID":"368559b0-4fca-4ee8-9015-72d316ae15ae","Type":"ContainerStarted","Data":"3a29fd75a124304d755be4d2cdd06d3119784037000ff6eb642dd1ccce8fa1d9"}
Sep 07 17:12:05.364215 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:05.364159    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podStartSLOduration=2.364142959 podStartE2EDuration="2.364142959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:05.363158277 +0000 UTC m=+937.003713093" watchObservedRunningTime="2026-09-07 17:12:05.364142959 +0000 UTC m=+937.004697756"
Sep 07 17:12:06.321734 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:06.321685    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:06.326673 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:06.326644    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:06.345691 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:06.345663    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:06.346586 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:06.346566    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:07.041599 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:07.041560    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:12:08.021983 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.021887    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"]
Sep 07 17:12:08.025549 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.025503    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.029267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.029240    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3f5460\"/\"default-dockercfg-btrqw\""
Sep 07 17:12:08.030639 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.030621    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3f5460\"/\"kube-root-ca.crt\""
Sep 07 17:12:08.031601 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.031579    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3f5460\"/\"openshift-service-ca.crt\""
Sep 07 17:12:08.031738 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.031720    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3f5460\"/\"test-model-3f5460-kserve-self-signed-certs\""
Sep 07 17:12:08.035763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.035740    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"]
Sep 07 17:12:08.155010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.154969    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdnf\" (UniqueName: \"kubernetes.io/projected/fbebd68e-a21e-488c-86a8-02a97aeea200-kube-api-access-qsdnf\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.155214 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.155021    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-model-cache\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.155214 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.155094    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-home\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.155214 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.155149    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbebd68e-a21e-488c-86a8-02a97aeea200-tls-certs\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.155214 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.155189    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-tmp-dir\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.155379 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.155240    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-dshm\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.256608 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.256532    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdnf\" (UniqueName: \"kubernetes.io/projected/fbebd68e-a21e-488c-86a8-02a97aeea200-kube-api-access-qsdnf\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.256813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.256631    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-model-cache\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.256813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.256666    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-home\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.256813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.256690    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbebd68e-a21e-488c-86a8-02a97aeea200-tls-certs\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.256813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.256721    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-tmp-dir\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.256813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.256753    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-dshm\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.257104 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.257077    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-model-cache\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.257168 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.257119    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-tmp-dir\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.257168 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.257086    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-home\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.259022 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.258990    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-dshm\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.259296 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.259276    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbebd68e-a21e-488c-86a8-02a97aeea200-tls-certs\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.267644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.267619    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdnf\" (UniqueName: \"kubernetes.io/projected/fbebd68e-a21e-488c-86a8-02a97aeea200-kube-api-access-qsdnf\") pod \"test-model-3f5460-kserve-547c587757-d4cnv\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") " pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.338172 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.338138    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:08.412323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.412285    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"]
Sep 07 17:12:08.415620 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.415593    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.418514 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.418492    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:12:08.418826 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.418809    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-3c1adc-serving-cert\""
Sep 07 17:12:08.419319 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.419162    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:12:08.419319 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.419260    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:12:08.419475 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.419462    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:12:08.430776 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.430748    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"]
Sep 07 17:12:08.559558 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.558635    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/939939d4-606d-46e9-8168-650bbe01e939-openshift-service-ca\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.559558 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.558693    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-maas-api-tls\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.559558 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.558810    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-metrics-certs\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.559558 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.558839    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrsj\" (UniqueName: \"kubernetes.io/projected/939939d4-606d-46e9-8168-650bbe01e939-kube-api-access-htrsj\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.614814 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.614783    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"]
Sep 07 17:12:08.616350 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:12:08.616324    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbebd68e_a21e_488c_86a8_02a97aeea200.slice/crio-b2cce8010f4ec0b7266eb4ba54e94de960888a5221f0d225b923b7a35b1eca68 WatchSource:0}: Error finding container b2cce8010f4ec0b7266eb4ba54e94de960888a5221f0d225b923b7a35b1eca68: Status 404 returned error can't find the container with id b2cce8010f4ec0b7266eb4ba54e94de960888a5221f0d225b923b7a35b1eca68
Sep 07 17:12:08.661040 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.660426    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-metrics-certs\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.661239 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.661056    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htrsj\" (UniqueName: \"kubernetes.io/projected/939939d4-606d-46e9-8168-650bbe01e939-kube-api-access-htrsj\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.661239 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.661185    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/939939d4-606d-46e9-8168-650bbe01e939-openshift-service-ca\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.661821 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.661220    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-maas-api-tls\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.662730 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.662700    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/939939d4-606d-46e9-8168-650bbe01e939-openshift-service-ca\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.665079 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.665048    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-metrics-certs\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.665195 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.665139    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-maas-api-tls\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.672483 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.672458    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrsj\" (UniqueName: \"kubernetes.io/projected/939939d4-606d-46e9-8168-650bbe01e939-kube-api-access-htrsj\") pod \"maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:08.732489 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:08.732452    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:09.036942 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:09.036731    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"]
Sep 07 17:12:09.051269 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:12:09.051212    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939939d4_606d_46e9_8168_650bbe01e939.slice/crio-020c0f96aa005c125b70cec429b874a0ab26b721b3dd49367c71603f0382114c WatchSource:0}: Error finding container 020c0f96aa005c125b70cec429b874a0ab26b721b3dd49367c71603f0382114c: Status 404 returned error can't find the container with id 020c0f96aa005c125b70cec429b874a0ab26b721b3dd49367c71603f0382114c
Sep 07 17:12:09.059557 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:09.058720    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:12:09.369864 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:09.369827    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v" event={"ID":"939939d4-606d-46e9-8168-650bbe01e939","Type":"ContainerStarted","Data":"020c0f96aa005c125b70cec429b874a0ab26b721b3dd49367c71603f0382114c"}
Sep 07 17:12:09.371424 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:09.371395    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv" event={"ID":"fbebd68e-a21e-488c-86a8-02a97aeea200","Type":"ContainerStarted","Data":"309a8d047c5832ee99c1ac0311ccc1dcf25c078eaad5d161303fdf1646274925"}
Sep 07 17:12:09.371582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:09.371434    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv" event={"ID":"fbebd68e-a21e-488c-86a8-02a97aeea200","Type":"ContainerStarted","Data":"b2cce8010f4ec0b7266eb4ba54e94de960888a5221f0d225b923b7a35b1eca68"}
Sep 07 17:12:09.391690 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:09.391630    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv" podStartSLOduration=2.391614587 podStartE2EDuration="2.391614587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:09.389781047 +0000 UTC m=+941.030335875" watchObservedRunningTime="2026-09-07 17:12:09.391614587 +0000 UTC m=+941.032169429"
Sep 07 17:12:10.378488 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:10.378451    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v" event={"ID":"939939d4-606d-46e9-8168-650bbe01e939","Type":"ContainerStarted","Data":"d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652"}
Sep 07 17:12:10.378940 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:10.378710    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:10.400954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:10.400903    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v" podStartSLOduration=1.914562794 podStartE2EDuration="2.400886212s" totalImagesPullingTime="486.323418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:10.398075609 +0000 UTC m=+942.038630405" watchObservedRunningTime="2026-09-07 17:12:10.400886212 +0000 UTC m=+942.041441029"
Sep 07 17:12:16.390976 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:16.390944    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:17.417845 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:17.417807    2545 generic.go:356] "Generic (PLEG): container finished" podID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerID="528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2" exitCode=0
Sep 07 17:12:17.418367 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:17.417886    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" event={"ID":"5fa33540-faa6-4d80-a4ab-0cf8c4527027","Type":"ContainerDied","Data":"528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"}
Sep 07 17:12:17.418436 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:17.418414    2545 scope.go:117] "RemoveContainer" containerID="528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"
Sep 07 17:12:17.419582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:17.419529    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:17.419677 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:17.419623    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:17.419677 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:17.419659    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:18.339247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:18.338447    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:18.339247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:18.338517    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:18.374977 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:18.374940    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:18.424888 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:18.424852    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" event={"ID":"5fa33540-faa6-4d80-a4ab-0cf8c4527027","Type":"ContainerStarted","Data":"05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11"}
Sep 07 17:12:18.436205 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:18.436170    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:12:19.159971 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:19.159932    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:12:19.160329 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:19.160306    2545 patch_prober.go:28] interesting pod/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:12:19.160499 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:19.160472    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 17:12:20.159661 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:20.159621    2545 patch_prober.go:28] interesting pod/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:12:20.160305 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:20.160270    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 17:12:21.159485 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:21.159436    2545 patch_prober.go:28] interesting pod/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:12:21.159798 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:21.159768    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 17:12:22.159604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:22.159561    2545 patch_prober.go:28] interesting pod/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:12:22.159911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:22.159879    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 17:12:23.160118 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.160067    2545 patch_prober.go:28] interesting pod/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:12:23.160668 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.160143    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 17:12:23.503426 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.503341    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"]
Sep 07 17:12:23.505718 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.505696    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:23.509258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.509230    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:12:23.516060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.516025    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"]
Sep 07 17:12:23.599602 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.599567    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c586c514-tvbjr\" (UID: \"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:23.700664 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.700598    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c586c514-tvbjr\" (UID: \"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:23.701282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.701256    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c586c514-tvbjr\" (UID: \"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:23.816192 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:23.816160    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:24.110037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.109931    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"]
Sep 07 17:12:24.112785 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:12:24.112752    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8567c79_fd42_4abd_8ea9_e7f31d95bb5e.slice/crio-c3a8df4bc40059f67f5790ef695d19e81df34b7e7c87a81633b67c9788060d66 WatchSource:0}: Error finding container c3a8df4bc40059f67f5790ef695d19e81df34b7e7c87a81633b67c9788060d66: Status 404 returned error can't find the container with id c3a8df4bc40059f67f5790ef695d19e81df34b7e7c87a81633b67c9788060d66
Sep 07 17:12:24.165692 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.165659    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:12:24.166131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.166034    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:12:24.166908 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.166888    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:12:24.470813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.470776    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr" event={"ID":"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e","Type":"ContainerStarted","Data":"38cb7100230afc6908001b586f9e74cffcbd3f95fb97f46d7f0d6202313ac0f0"}
Sep 07 17:12:24.470994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.470832    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr" event={"ID":"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e","Type":"ContainerStarted","Data":"c3a8df4bc40059f67f5790ef695d19e81df34b7e7c87a81633b67c9788060d66"}
Sep 07 17:12:24.485970 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:24.485927    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr" podStartSLOduration=1.485907917 podStartE2EDuration="1.485907917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:24.485362036 +0000 UTC m=+956.125916850" watchObservedRunningTime="2026-09-07 17:12:24.485907917 +0000 UTC m=+956.126462737"
Sep 07 17:12:25.478186 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:25.478150    2545 generic.go:356] "Generic (PLEG): container finished" podID="c8567c79-fd42-4abd-8ea9-e7f31d95bb5e" containerID="38cb7100230afc6908001b586f9e74cffcbd3f95fb97f46d7f0d6202313ac0f0" exitCode=0
Sep 07 17:12:25.478589 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:25.478236    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr" event={"ID":"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e","Type":"ContainerDied","Data":"38cb7100230afc6908001b586f9e74cffcbd3f95fb97f46d7f0d6202313ac0f0"}
Sep 07 17:12:26.619119 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:26.619085    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:26.729791 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:26.729755    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e-maas-api-service-ca\") pod \"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e\" (UID: \"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e\") "
Sep 07 17:12:26.730139 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:26.730115    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8567c79-fd42-4abd-8ea9-e7f31d95bb5e" (UID: "c8567c79-fd42-4abd-8ea9-e7f31d95bb5e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:26.831429 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:26.831391    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:26.941230 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:26.941186    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:12:27.492335 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:27.492302    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"
Sep 07 17:12:27.492510 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:27.492347    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr" event={"ID":"c8567c79-fd42-4abd-8ea9-e7f31d95bb5e","Type":"ContainerDied","Data":"c3a8df4bc40059f67f5790ef695d19e81df34b7e7c87a81633b67c9788060d66"}
Sep 07 17:12:27.492510 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:27.492396    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3a8df4bc40059f67f5790ef695d19e81df34b7e7c87a81633b67c9788060d66"
Sep 07 17:12:28.499590 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:28.499523    2545 generic.go:356] "Generic (PLEG): container finished" podID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerID="eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e" exitCode=0
Sep 07 17:12:28.500115 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:28.499599    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" event={"ID":"368559b0-4fca-4ee8-9015-72d316ae15ae","Type":"ContainerDied","Data":"eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"}
Sep 07 17:12:28.500115 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:28.500094    2545 scope.go:117] "RemoveContainer" containerID="eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"
Sep 07 17:12:28.501237 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:28.501205    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:28.501325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:28.501278    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:28.501325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:28.501315    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:12:29.509051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:29.509012    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" event={"ID":"368559b0-4fca-4ee8-9015-72d316ae15ae","Type":"ContainerStarted","Data":"e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90"}
Sep 07 17:12:30.321695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.321652    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:30.321978 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.321953    2545 patch_prober.go:28] interesting pod/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:12:30.322067 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.322003    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 07 17:12:30.520184 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.520146    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"]
Sep 07 17:12:30.524297 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.524269    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c586c514-tvbjr"]
Sep 07 17:12:30.646624 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.639353    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"]
Sep 07 17:12:30.647854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.647818    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy" containerID="cri-o://05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11" gracePeriod=30
Sep 07 17:12:30.888588 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:30.888555    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8567c79-fd42-4abd-8ea9-e7f31d95bb5e" path="/var/lib/kubelet/pods/c8567c79-fd42-4abd-8ea9-e7f31d95bb5e/volumes"
Sep 07 17:12:31.322131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:31.322092    2545 patch_prober.go:28] interesting pod/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:12:31.322335 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:31.322171    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 07 17:12:32.322083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:32.322043    2545 patch_prober.go:28] interesting pod/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:12:32.322489 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:32.322103    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 07 17:12:33.322325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:33.322280    2545 patch_prober.go:28] interesting pod/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:12:33.322731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:33.322359    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 07 17:12:34.322310 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:34.322263    2545 patch_prober.go:28] interesting pod/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:12:34.322496 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:34.322327    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 07 17:12:35.325887 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.325850    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:35.326278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.326134    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:35.326908 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.326885    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:12:35.909217 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.909189    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:12:35.915768 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915745    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-data\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.915915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915799    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-socket\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.915915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915830    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-token\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.915915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915855    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istiod-ca-cert\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.915915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915908    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r45pw\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-kube-api-access-r45pw\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.916136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915927    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-podinfo\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.916136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915941    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:35.916136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915962    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-certs\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.916136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.915989    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-credential-socket\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.916136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916004    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-envoy\") pod \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\" (UID: \"5fa33540-faa6-4d80-a4ab-0cf8c4527027\") "
Sep 07 17:12:35.916136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916009    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:35.916440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916173    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:35.916440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916286    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:35.916440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916291    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:35.916440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916298    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:35.916440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916306    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:35.916440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.916355    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:35.918091 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.918065    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:12:35.918200 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.918138    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-kube-api-access-r45pw" (OuterVolumeSpecName: "kube-api-access-r45pw") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "kube-api-access-r45pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:35.918200 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.918162    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:35.918200 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:35.918195    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fa33540-faa6-4d80-a4ab-0cf8c4527027" (UID: "5fa33540-faa6-4d80-a4ab-0cf8c4527027"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:36.017462 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.017427    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:36.017462 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.017458    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:36.017462 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.017468    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r45pw\" (UniqueName: \"kubernetes.io/projected/5fa33540-faa6-4d80-a4ab-0cf8c4527027-kube-api-access-r45pw\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:36.017711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.017476    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:36.017711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.017486    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:36.017711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.017494    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa33540-faa6-4d80-a4ab-0cf8c4527027-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:36.580188 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.580152    2545 generic.go:356] "Generic (PLEG): container finished" podID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerID="05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11" exitCode=0
Sep 07 17:12:36.580615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.580208    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"
Sep 07 17:12:36.580615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.580238    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" event={"ID":"5fa33540-faa6-4d80-a4ab-0cf8c4527027","Type":"ContainerDied","Data":"05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11"}
Sep 07 17:12:36.580615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.580295    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j" event={"ID":"5fa33540-faa6-4d80-a4ab-0cf8c4527027","Type":"ContainerDied","Data":"e6aefad787cb1765d9862671ad6819e0e719771cb2c1b48a243c8663bba55135"}
Sep 07 17:12:36.580615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.580319    2545 scope.go:117] "RemoveContainer" containerID="05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11"
Sep 07 17:12:36.589817 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.589798    2545 scope.go:117] "RemoveContainer" containerID="528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"
Sep 07 17:12:36.598135 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.598097    2545 scope.go:117] "RemoveContainer" containerID="05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11"
Sep 07 17:12:36.598429 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:12:36.598410    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11\": container with ID starting with 05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11 not found: ID does not exist" containerID="05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11"
Sep 07 17:12:36.598479 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.598437    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11"} err="failed to get container status \"05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11\": rpc error: code = NotFound desc = could not find container \"05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11\": container with ID starting with 05a2f80c8c9d868b0aa092b5d332cabfd47782f120dac0b2cfdd1fc871b55b11 not found: ID does not exist"
Sep 07 17:12:36.598479 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.598454    2545 scope.go:117] "RemoveContainer" containerID="528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"
Sep 07 17:12:36.598717 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:12:36.598700    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2\": container with ID starting with 528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2 not found: ID does not exist" containerID="528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"
Sep 07 17:12:36.598763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.598723    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2"} err="failed to get container status \"528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2\": rpc error: code = NotFound desc = could not find container \"528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2\": container with ID starting with 528436deda1900ce44050b944f97f0b4efe02fa8b7691289d0369d9f0f4e25e2 not found: ID does not exist"
Sep 07 17:12:36.603106 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.603082    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"]
Sep 07 17:12:36.608774 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.608750    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j"]
Sep 07 17:12:36.888664 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:36.888581    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" path="/var/lib/kubelet/pods/5fa33540-faa6-4d80-a4ab-0cf8c4527027/volumes"
Sep 07 17:12:44.944492 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:44.944453    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:12:45.433343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433303    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"]
Sep 07 17:12:45.433698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433684    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8567c79-fd42-4abd-8ea9-e7f31d95bb5e" containerName="revoke-keys"
Sep 07 17:12:45.433761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433699    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8567c79-fd42-4abd-8ea9-e7f31d95bb5e" containerName="revoke-keys"
Sep 07 17:12:45.433761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433711    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy"
Sep 07 17:12:45.433761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433716    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy"
Sep 07 17:12:45.433761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433728    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy"
Sep 07 17:12:45.433761 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433734    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy"
Sep 07 17:12:45.433943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433805    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy"
Sep 07 17:12:45.433943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433814    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa33540-faa6-4d80-a4ab-0cf8c4527027" containerName="istio-proxy"
Sep 07 17:12:45.433943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.433821    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8567c79-fd42-4abd-8ea9-e7f31d95bb5e" containerName="revoke-keys"
Sep 07 17:12:45.436870 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.436852    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:45.442469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.442443    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:12:45.456829 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.456792    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"]
Sep 07 17:12:45.499366 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.499320    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62\" (UID: \"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:45.600902 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.600862    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62\" (UID: \"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:45.601515 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.601494    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62\" (UID: \"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:45.746617 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:45.746491    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:46.043296 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:46.043269    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"]
Sep 07 17:12:46.045050 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:12:46.045014    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae25cad_46c4_4f61_94ce_7ff1f1a05bd5.slice/crio-9dfdaf3223f1ddb20b49ffbb3e353011ce210afc65f11a5d3035c9ea60e57002 WatchSource:0}: Error finding container 9dfdaf3223f1ddb20b49ffbb3e353011ce210afc65f11a5d3035c9ea60e57002: Status 404 returned error can't find the container with id 9dfdaf3223f1ddb20b49ffbb3e353011ce210afc65f11a5d3035c9ea60e57002
Sep 07 17:12:46.634427 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:46.634385    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62" event={"ID":"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5","Type":"ContainerStarted","Data":"bca46f018e088f4681cb190bbf053e9cf6250269a9cf6b6505220fa1d2fff370"}
Sep 07 17:12:46.634789 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:46.634450    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62" event={"ID":"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5","Type":"ContainerStarted","Data":"9dfdaf3223f1ddb20b49ffbb3e353011ce210afc65f11a5d3035c9ea60e57002"}
Sep 07 17:12:46.649616 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:46.649565    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62" podStartSLOduration=1.649547635 podStartE2EDuration="1.649547635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:46.648901672 +0000 UTC m=+978.289456494" watchObservedRunningTime="2026-09-07 17:12:46.649547635 +0000 UTC m=+978.290102421"
Sep 07 17:12:47.641335 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:47.641296    2545 generic.go:356] "Generic (PLEG): container finished" podID="bae25cad-46c4-4f61-94ce-7ff1f1a05bd5" containerID="bca46f018e088f4681cb190bbf053e9cf6250269a9cf6b6505220fa1d2fff370" exitCode=0
Sep 07 17:12:47.641766 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:47.641390    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62" event={"ID":"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5","Type":"ContainerDied","Data":"bca46f018e088f4681cb190bbf053e9cf6250269a9cf6b6505220fa1d2fff370"}
Sep 07 17:12:48.773923 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:48.773891    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:48.831244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:48.831207    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5-maas-api-service-ca\") pod \"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5\" (UID: \"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5\") "
Sep 07 17:12:48.831585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:48.831559    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bae25cad-46c4-4f61-94ce-7ff1f1a05bd5" (UID: "bae25cad-46c4-4f61-94ce-7ff1f1a05bd5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:48.932650 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:48.932560    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:49.654147 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:49.654112    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"
Sep 07 17:12:49.654320 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:49.654112    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62" event={"ID":"bae25cad-46c4-4f61-94ce-7ff1f1a05bd5","Type":"ContainerDied","Data":"9dfdaf3223f1ddb20b49ffbb3e353011ce210afc65f11a5d3035c9ea60e57002"}
Sep 07 17:12:49.654320 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:49.654270    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dfdaf3223f1ddb20b49ffbb3e353011ce210afc65f11a5d3035c9ea60e57002"
Sep 07 17:12:55.926602 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:55.926504    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"]
Sep 07 17:12:55.927073 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:55.926784    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v" podUID="939939d4-606d-46e9-8168-650bbe01e939" containerName="maas-api" containerID="cri-o://d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652" gracePeriod=30
Sep 07 17:12:56.175328 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.175304    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:56.180506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.180447    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"]
Sep 07 17:12:56.186240 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.186216    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3c1adc-q7s62"]
Sep 07 17:12:56.297619 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.297571    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htrsj\" (UniqueName: \"kubernetes.io/projected/939939d4-606d-46e9-8168-650bbe01e939-kube-api-access-htrsj\") pod \"939939d4-606d-46e9-8168-650bbe01e939\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") "
Sep 07 17:12:56.297811 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.297632    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/939939d4-606d-46e9-8168-650bbe01e939-openshift-service-ca\") pod \"939939d4-606d-46e9-8168-650bbe01e939\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") "
Sep 07 17:12:56.297811 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.297650    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-maas-api-tls\") pod \"939939d4-606d-46e9-8168-650bbe01e939\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") "
Sep 07 17:12:56.297811 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.297664    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-metrics-certs\") pod \"939939d4-606d-46e9-8168-650bbe01e939\" (UID: \"939939d4-606d-46e9-8168-650bbe01e939\") "
Sep 07 17:12:56.298012 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.297986    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/939939d4-606d-46e9-8168-650bbe01e939-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "939939d4-606d-46e9-8168-650bbe01e939" (UID: "939939d4-606d-46e9-8168-650bbe01e939"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:56.299839 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.299803    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "939939d4-606d-46e9-8168-650bbe01e939" (UID: "939939d4-606d-46e9-8168-650bbe01e939"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:12:56.299958 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.299863    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "939939d4-606d-46e9-8168-650bbe01e939" (UID: "939939d4-606d-46e9-8168-650bbe01e939"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:12:56.299958 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.299876    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/939939d4-606d-46e9-8168-650bbe01e939-kube-api-access-htrsj" (OuterVolumeSpecName: "kube-api-access-htrsj") pod "939939d4-606d-46e9-8168-650bbe01e939" (UID: "939939d4-606d-46e9-8168-650bbe01e939"). InnerVolumeSpecName "kube-api-access-htrsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:56.398344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.398304    2545 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/939939d4-606d-46e9-8168-650bbe01e939-openshift-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.398344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.398337    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-maas-api-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.398344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.398347    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/939939d4-606d-46e9-8168-650bbe01e939-metrics-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.398618 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.398356    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htrsj\" (UniqueName: \"kubernetes.io/projected/939939d4-606d-46e9-8168-650bbe01e939-kube-api-access-htrsj\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.696552 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.696507    2545 generic.go:356] "Generic (PLEG): container finished" podID="939939d4-606d-46e9-8168-650bbe01e939" containerID="d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652" exitCode=0
Sep 07 17:12:56.696756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.696564    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"
Sep 07 17:12:56.696756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.696592    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v" event={"ID":"939939d4-606d-46e9-8168-650bbe01e939","Type":"ContainerDied","Data":"d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652"}
Sep 07 17:12:56.696756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.696652    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v" event={"ID":"939939d4-606d-46e9-8168-650bbe01e939","Type":"ContainerDied","Data":"020c0f96aa005c125b70cec429b874a0ab26b721b3dd49367c71603f0382114c"}
Sep 07 17:12:56.696756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.696681    2545 scope.go:117] "RemoveContainer" containerID="d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652"
Sep 07 17:12:56.706528 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.706507    2545 scope.go:117] "RemoveContainer" containerID="d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652"
Sep 07 17:12:56.706859 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:12:56.706840    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652\": container with ID starting with d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652 not found: ID does not exist" containerID="d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652"
Sep 07 17:12:56.706922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.706869    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652"} err="failed to get container status \"d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652\": rpc error: code = NotFound desc = could not find container \"d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652\": container with ID starting with d018874b07e6dd001e01e901e1d44ae015f7f1cd77cdf7e0398b08c3cb7f2652 not found: ID does not exist"
Sep 07 17:12:56.719906 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.719878    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"]
Sep 07 17:12:56.727339 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.727312    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c1adc-dbb5f9545-2np5v"]
Sep 07 17:12:56.888619 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.888587    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="939939d4-606d-46e9-8168-650bbe01e939" path="/var/lib/kubelet/pods/939939d4-606d-46e9-8168-650bbe01e939/volumes"
Sep 07 17:12:56.888929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:12:56.888917    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae25cad-46c4-4f61-94ce-7ff1f1a05bd5" path="/var/lib/kubelet/pods/bae25cad-46c4-4f61-94ce-7ff1f1a05bd5/volumes"
Sep 07 17:13:00.739491 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:00.739452    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:13:03.659315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:03.659282    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"]
Sep 07 17:13:03.659723 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:03.659498    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" containerID="cri-o://e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90" gracePeriod=30
Sep 07 17:13:04.396692 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.396657    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"]
Sep 07 17:13:04.397001 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.396987    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae25cad-46c4-4f61-94ce-7ff1f1a05bd5" containerName="revoke-keys"
Sep 07 17:13:04.397054 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.397004    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae25cad-46c4-4f61-94ce-7ff1f1a05bd5" containerName="revoke-keys"
Sep 07 17:13:04.397054 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.397024    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="939939d4-606d-46e9-8168-650bbe01e939" containerName="maas-api"
Sep 07 17:13:04.397054 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.397031    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="939939d4-606d-46e9-8168-650bbe01e939" containerName="maas-api"
Sep 07 17:13:04.397160 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.397092    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="939939d4-606d-46e9-8168-650bbe01e939" containerName="maas-api"
Sep 07 17:13:04.397160 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.397101    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae25cad-46c4-4f61-94ce-7ff1f1a05bd5" containerName="revoke-keys"
Sep 07 17:13:04.400181 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.400152    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.403611 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.403584    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f4bf9e-openshift-default-dockercfg-p6dr8\""
Sep 07 17:13:04.431669 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.431633    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"]
Sep 07 17:13:04.471911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.471869    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-socket\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.471911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.471908    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-certs\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.471930    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-credential-socket\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.471951    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-data\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.471971    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-istio-token\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.472040    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e71d3e5-c051-475d-8767-a2f931f07139-istio-podinfo\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.472057    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svmh8\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-kube-api-access-svmh8\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.472095    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e71d3e5-c051-475d-8767-a2f931f07139-istiod-ca-cert\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.472370 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.472166    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-envoy\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573165    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e71d3e5-c051-475d-8767-a2f931f07139-istiod-ca-cert\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573227    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-envoy\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573260    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-socket\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573281    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-certs\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573307    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-credential-socket\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573337    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-data\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573364    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-istio-token\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573447    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e71d3e5-c051-475d-8767-a2f931f07139-istio-podinfo\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573472    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svmh8\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-kube-api-access-svmh8\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573766    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-socket\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.573929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573799    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-certs\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.574024 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.573979    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-data\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.574101 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.574070    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e71d3e5-c051-475d-8767-a2f931f07139-istiod-ca-cert\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.574207 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.574081    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-credential-socket\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.575901 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.575871    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-envoy\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.576208 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.576186    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e71d3e5-c051-475d-8767-a2f931f07139-istio-podinfo\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.582751 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.582720    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-istio-token\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.582869 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.582814    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svmh8\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-kube-api-access-svmh8\") pod \"e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") " pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:04.713087 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.712996    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:05.000360 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:04.998750    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"]
Sep 07 17:13:05.005925 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.005889    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:13:05.006039 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.005957    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:13:05.006039 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.005986    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:13:05.328939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.328903    2545 patch_prober.go:28] interesting pod/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:13:05.329103 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.328980    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:13:05.747333 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.747240    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" event={"ID":"0e71d3e5-c051-475d-8767-a2f931f07139","Type":"ContainerStarted","Data":"11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607"}
Sep 07 17:13:05.747333 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.747299    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" event={"ID":"0e71d3e5-c051-475d-8767-a2f931f07139","Type":"ContainerStarted","Data":"7573360fc2da59ead7caf5adf50c13ed8bb999d2af839e4de3dd12bde8b5eac4"}
Sep 07 17:13:05.781005 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:05.780940    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" podStartSLOduration=1.780918437 podStartE2EDuration="1.780918437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:13:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:13:05.778961023 +0000 UTC m=+997.419515844" watchObservedRunningTime="2026-09-07 17:13:05.780918437 +0000 UTC m=+997.421473234"
Sep 07 17:13:06.713348 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:06.713304    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:06.718359 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:06.718332    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:06.753676 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:06.753642    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:06.754478 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:06.754459    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:08.898892 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:08.898867    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:13:09.016702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016608    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-certs\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016644    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-credential-socket\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016701    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-data\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016721    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/368559b0-4fca-4ee8-9015-72d316ae15ae-istiod-ca-cert\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016779    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-token\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016808    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-envoy\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016839    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-socket\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016866    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-podinfo\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.016975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.016888    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjdrs\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-kube-api-access-kjdrs\") pod \"368559b0-4fca-4ee8-9015-72d316ae15ae\" (UID: \"368559b0-4fca-4ee8-9015-72d316ae15ae\") "
Sep 07 17:13:09.017287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017056    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:09.017287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017083    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:09.017287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017128    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:09.017287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017197    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:09.017287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017208    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/368559b0-4fca-4ee8-9015-72d316ae15ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:09.017587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017314    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.017587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017331    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.017587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017344    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.017587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017357    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.017587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.017370    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/368559b0-4fca-4ee8-9015-72d316ae15ae-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.019153 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.019125    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:09.019153 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.019140    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:09.019444 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.019421    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:13:09.019444 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.019433    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-kube-api-access-kjdrs" (OuterVolumeSpecName: "kube-api-access-kjdrs") pod "368559b0-4fca-4ee8-9015-72d316ae15ae" (UID: "368559b0-4fca-4ee8-9015-72d316ae15ae"). InnerVolumeSpecName "kube-api-access-kjdrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:09.118544 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.118511    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.118732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.118564    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.118732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.118573    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/368559b0-4fca-4ee8-9015-72d316ae15ae-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.118732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.118582    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjdrs\" (UniqueName: \"kubernetes.io/projected/368559b0-4fca-4ee8-9015-72d316ae15ae-kube-api-access-kjdrs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:09.771458 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.771421    2545 generic.go:356] "Generic (PLEG): container finished" podID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerID="e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90" exitCode=0
Sep 07 17:13:09.771671 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.771490    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"
Sep 07 17:13:09.771671 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.771500    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" event={"ID":"368559b0-4fca-4ee8-9015-72d316ae15ae","Type":"ContainerDied","Data":"e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90"}
Sep 07 17:13:09.771671 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.771618    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s" event={"ID":"368559b0-4fca-4ee8-9015-72d316ae15ae","Type":"ContainerDied","Data":"3a29fd75a124304d755be4d2cdd06d3119784037000ff6eb642dd1ccce8fa1d9"}
Sep 07 17:13:09.771671 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.771649    2545 scope.go:117] "RemoveContainer" containerID="e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90"
Sep 07 17:13:09.781521 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.781368    2545 scope.go:117] "RemoveContainer" containerID="eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"
Sep 07 17:13:09.789448 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.789432    2545 scope.go:117] "RemoveContainer" containerID="e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90"
Sep 07 17:13:09.789770 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:13:09.789752    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90\": container with ID starting with e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90 not found: ID does not exist" containerID="e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90"
Sep 07 17:13:09.789841 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.789778    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90"} err="failed to get container status \"e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90\": rpc error: code = NotFound desc = could not find container \"e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90\": container with ID starting with e6aa0809cf7281b23964dd28f9bcb95f79df234ee957324a1bd243964b910e90 not found: ID does not exist"
Sep 07 17:13:09.789841 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.789795    2545 scope.go:117] "RemoveContainer" containerID="eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"
Sep 07 17:13:09.790054 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:13:09.790036    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e\": container with ID starting with eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e not found: ID does not exist" containerID="eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"
Sep 07 17:13:09.790103 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.790061    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e"} err="failed to get container status \"eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e\": rpc error: code = NotFound desc = could not find container \"eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e\": container with ID starting with eaef99900d0dd613efd07bd902f7b34e363f2a163c43baa74cfe48736af8fd9e not found: ID does not exist"
Sep 07 17:13:09.798087 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.798065    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"]
Sep 07 17:13:09.801690 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:09.801664    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s"]
Sep 07 17:13:10.888476 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:10.888441    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" path="/var/lib/kubelet/pods/368559b0-4fca-4ee8-9015-72d316ae15ae/volumes"
Sep 07 17:13:14.440810 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:14.440770    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:13:19.179832 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:19.179800    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"]
Sep 07 17:13:19.180208 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:19.180044    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" podUID="0e71d3e5-c051-475d-8767-a2f931f07139" containerName="istio-proxy" containerID="cri-o://11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607" gracePeriod=30
Sep 07 17:13:21.733718 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.733684    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"]
Sep 07 17:13:21.756442 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.756408    2545 patch_prober.go:28] interesting pod/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 07 17:13:21.756613 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.756468    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" podUID="0e71d3e5-c051-475d-8767-a2f931f07139" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:13:21.865758 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.865723    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"]
Sep 07 17:13:21.866067 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.866055    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy"
Sep 07 17:13:21.866113 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.866069    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy"
Sep 07 17:13:21.866113 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.866078    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy"
Sep 07 17:13:21.866113 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.866083    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy"
Sep 07 17:13:21.866214 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.866135    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy"
Sep 07 17:13:21.870530 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.870508    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:21.874393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.874373    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:13:21.874489 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.874414    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:13:21.880190 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.880164    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"]
Sep 07 17:13:21.933288 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:21.933243    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l\" (UID: \"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:22.033901 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.033811    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l\" (UID: \"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:22.034406 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.034382    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l\" (UID: \"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:22.181555 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.181500    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:22.453616 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.453587    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"]
Sep 07 17:13:22.455384 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:13:22.455354    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4e6bc4_f742_4581_9e3e_9109cb28aaf5.slice/crio-541d0bf853cbf52c907bde3fbd7d02cfde41ce348a14916c2ed96f584058a1a6 WatchSource:0}: Error finding container 541d0bf853cbf52c907bde3fbd7d02cfde41ce348a14916c2ed96f584058a1a6: Status 404 returned error can't find the container with id 541d0bf853cbf52c907bde3fbd7d02cfde41ce348a14916c2ed96f584058a1a6
Sep 07 17:13:22.845938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.845895    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l" event={"ID":"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5","Type":"ContainerStarted","Data":"0a9bc83b0d8ba7de81b1edec609a92f366a32e0798dad92a13d926fb2cba1440"}
Sep 07 17:13:22.846401 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.845951    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l" event={"ID":"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5","Type":"ContainerStarted","Data":"541d0bf853cbf52c907bde3fbd7d02cfde41ce348a14916c2ed96f584058a1a6"}
Sep 07 17:13:22.860994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:22.860942    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l" podStartSLOduration=1.8609268879999998 podStartE2EDuration="1.860926888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:13:22.860874937 +0000 UTC m=+1014.501429735" watchObservedRunningTime="2026-09-07 17:13:22.860926888 +0000 UTC m=+1014.501481683"
Sep 07 17:13:23.852249 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:23.852209    2545 generic.go:356] "Generic (PLEG): container finished" podID="6f4e6bc4-f742-4581-9e3e-9109cb28aaf5" containerID="0a9bc83b0d8ba7de81b1edec609a92f366a32e0798dad92a13d926fb2cba1440" exitCode=0
Sep 07 17:13:23.852672 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:23.852302    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l" event={"ID":"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5","Type":"ContainerDied","Data":"0a9bc83b0d8ba7de81b1edec609a92f366a32e0798dad92a13d926fb2cba1440"}
Sep 07 17:13:24.090969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.090935    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:13:24.430627 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.430595    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:24.454604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454495    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svmh8\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-kube-api-access-svmh8\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.454604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454581    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-credential-socket\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.454827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454643    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-data\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.454827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454686    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-certs\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.454827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454709    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e71d3e5-c051-475d-8767-a2f931f07139-istiod-ca-cert\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.454827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454764    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-istio-token\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.454827 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454813    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-socket\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454834    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-envoy\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.454867    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e71d3e5-c051-475d-8767-a2f931f07139-istio-podinfo\") pod \"0e71d3e5-c051-475d-8767-a2f931f07139\" (UID: \"0e71d3e5-c051-475d-8767-a2f931f07139\") "
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.455173    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.455389    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.455484    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.455653    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e71d3e5-c051-475d-8767-a2f931f07139-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:24.457457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.455704    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:24.457979 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.457939    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:24.458084 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.457970    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-kube-api-access-svmh8" (OuterVolumeSpecName: "kube-api-access-svmh8") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "kube-api-access-svmh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:24.458084 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.458025    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e71d3e5-c051-475d-8767-a2f931f07139-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:13:24.458376 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.458341    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e71d3e5-c051-475d-8767-a2f931f07139" (UID: "0e71d3e5-c051-475d-8767-a2f931f07139"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:24.556258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556214    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556249    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556260    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556269    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e71d3e5-c051-475d-8767-a2f931f07139-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556571 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556277    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svmh8\" (UniqueName: \"kubernetes.io/projected/0e71d3e5-c051-475d-8767-a2f931f07139-kube-api-access-svmh8\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556571 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556287    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556571 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556295    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556571 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556305    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e71d3e5-c051-475d-8767-a2f931f07139-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.556571 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.556312    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e71d3e5-c051-475d-8767-a2f931f07139-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:24.859525 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.859492    2545 generic.go:356] "Generic (PLEG): container finished" podID="0e71d3e5-c051-475d-8767-a2f931f07139" containerID="11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607" exitCode=0
Sep 07 17:13:24.860029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.859561    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"
Sep 07 17:13:24.860029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.859580    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" event={"ID":"0e71d3e5-c051-475d-8767-a2f931f07139","Type":"ContainerDied","Data":"11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607"}
Sep 07 17:13:24.860029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.859632    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k" event={"ID":"0e71d3e5-c051-475d-8767-a2f931f07139","Type":"ContainerDied","Data":"7573360fc2da59ead7caf5adf50c13ed8bb999d2af839e4de3dd12bde8b5eac4"}
Sep 07 17:13:24.860029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.859654    2545 scope.go:117] "RemoveContainer" containerID="11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607"
Sep 07 17:13:24.870042 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.870022    2545 scope.go:117] "RemoveContainer" containerID="11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607"
Sep 07 17:13:24.870388 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:13:24.870368    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607\": container with ID starting with 11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607 not found: ID does not exist" containerID="11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607"
Sep 07 17:13:24.870446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.870398    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607"} err="failed to get container status \"11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607\": rpc error: code = NotFound desc = could not find container \"11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607\": container with ID starting with 11792112583ca2de3dd9070a99aaa182915712731d5b58f7e792e2977872a607 not found: ID does not exist"
Sep 07 17:13:24.890317 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.890290    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"]
Sep 07 17:13:24.890317 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.890324    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k"]
Sep 07 17:13:24.980547 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:24.980514    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:25.059879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:25.059838    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5-maas-api-service-ca\") pod \"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5\" (UID: \"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5\") "
Sep 07 17:13:25.060212 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:25.060186    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f4e6bc4-f742-4581-9e3e-9109cb28aaf5" (UID: "6f4e6bc4-f742-4581-9e3e-9109cb28aaf5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:25.161410 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:25.161315    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:25.867059 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:25.867032    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"
Sep 07 17:13:25.867492 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:25.867031    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l" event={"ID":"6f4e6bc4-f742-4581-9e3e-9109cb28aaf5","Type":"ContainerDied","Data":"541d0bf853cbf52c907bde3fbd7d02cfde41ce348a14916c2ed96f584058a1a6"}
Sep 07 17:13:25.867492 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:25.867178    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="541d0bf853cbf52c907bde3fbd7d02cfde41ce348a14916c2ed96f584058a1a6"
Sep 07 17:13:26.889225 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:26.889190    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e71d3e5-c051-475d-8767-a2f931f07139" path="/var/lib/kubelet/pods/0e71d3e5-c051-475d-8767-a2f931f07139/volumes"
Sep 07 17:13:32.617054 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:32.617005    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"]
Sep 07 17:13:32.620375 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:32.620346    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9fa102-qj68l"]
Sep 07 17:13:32.887738 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:32.887654    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4e6bc4-f742-4581-9e3e-9109cb28aaf5" path="/var/lib/kubelet/pods/6f4e6bc4-f742-4581-9e3e-9109cb28aaf5/volumes"
Sep 07 17:13:36.639990 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:36.639953    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:13:36.752909 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:36.752846    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv" podUID="fbebd68e-a21e-488c-86a8-02a97aeea200" containerName="main" containerID="cri-o://309a8d047c5832ee99c1ac0311ccc1dcf25c078eaad5d161303fdf1646274925" gracePeriod=45
Sep 07 17:13:36.931512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:36.931478    2545 generic.go:356] "Generic (PLEG): container finished" podID="fbebd68e-a21e-488c-86a8-02a97aeea200" containerID="309a8d047c5832ee99c1ac0311ccc1dcf25c078eaad5d161303fdf1646274925" exitCode=0
Sep 07 17:13:36.931651 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:36.931563    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv" event={"ID":"fbebd68e-a21e-488c-86a8-02a97aeea200","Type":"ContainerDied","Data":"309a8d047c5832ee99c1ac0311ccc1dcf25c078eaad5d161303fdf1646274925"}
Sep 07 17:13:37.009471 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.009443    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:13:37.067517 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067474    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-dshm\") pod \"fbebd68e-a21e-488c-86a8-02a97aeea200\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") "
Sep 07 17:13:37.067716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067564    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-model-cache\") pod \"fbebd68e-a21e-488c-86a8-02a97aeea200\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") "
Sep 07 17:13:37.067716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067581    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-home\") pod \"fbebd68e-a21e-488c-86a8-02a97aeea200\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") "
Sep 07 17:13:37.067716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067618    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-tmp-dir\") pod \"fbebd68e-a21e-488c-86a8-02a97aeea200\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") "
Sep 07 17:13:37.067716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067655    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsdnf\" (UniqueName: \"kubernetes.io/projected/fbebd68e-a21e-488c-86a8-02a97aeea200-kube-api-access-qsdnf\") pod \"fbebd68e-a21e-488c-86a8-02a97aeea200\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") "
Sep 07 17:13:37.067716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067712    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbebd68e-a21e-488c-86a8-02a97aeea200-tls-certs\") pod \"fbebd68e-a21e-488c-86a8-02a97aeea200\" (UID: \"fbebd68e-a21e-488c-86a8-02a97aeea200\") "
Sep 07 17:13:37.068013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067887    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-home" (OuterVolumeSpecName: "home") pod "fbebd68e-a21e-488c-86a8-02a97aeea200" (UID: "fbebd68e-a21e-488c-86a8-02a97aeea200"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:37.068013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067880    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbebd68e-a21e-488c-86a8-02a97aeea200" (UID: "fbebd68e-a21e-488c-86a8-02a97aeea200"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:37.068013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067909    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbebd68e-a21e-488c-86a8-02a97aeea200" (UID: "fbebd68e-a21e-488c-86a8-02a97aeea200"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:37.068013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067978    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-model-cache\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:37.068013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.067997    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-home\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:37.069777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.069753    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-dshm" (OuterVolumeSpecName: "dshm") pod "fbebd68e-a21e-488c-86a8-02a97aeea200" (UID: "fbebd68e-a21e-488c-86a8-02a97aeea200"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:37.069893 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.069854    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbebd68e-a21e-488c-86a8-02a97aeea200-kube-api-access-qsdnf" (OuterVolumeSpecName: "kube-api-access-qsdnf") pod "fbebd68e-a21e-488c-86a8-02a97aeea200" (UID: "fbebd68e-a21e-488c-86a8-02a97aeea200"). InnerVolumeSpecName "kube-api-access-qsdnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:37.069940 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.069904    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbebd68e-a21e-488c-86a8-02a97aeea200-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbebd68e-a21e-488c-86a8-02a97aeea200" (UID: "fbebd68e-a21e-488c-86a8-02a97aeea200"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:37.169024 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.168976    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-dshm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:37.169024 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.169013    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbebd68e-a21e-488c-86a8-02a97aeea200-tmp-dir\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:37.169024 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.169026    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsdnf\" (UniqueName: \"kubernetes.io/projected/fbebd68e-a21e-488c-86a8-02a97aeea200-kube-api-access-qsdnf\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:37.169262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.169040    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbebd68e-a21e-488c-86a8-02a97aeea200-tls-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:37.939524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.939493    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"
Sep 07 17:13:37.940016 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.939547    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv" event={"ID":"fbebd68e-a21e-488c-86a8-02a97aeea200","Type":"ContainerDied","Data":"b2cce8010f4ec0b7266eb4ba54e94de960888a5221f0d225b923b7a35b1eca68"}
Sep 07 17:13:37.940016 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.939611    2545 scope.go:117] "RemoveContainer" containerID="309a8d047c5832ee99c1ac0311ccc1dcf25c078eaad5d161303fdf1646274925"
Sep 07 17:13:37.962374 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.962336    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"]
Sep 07 17:13:37.965062 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:37.965037    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3f5460/test-model-3f5460-kserve-547c587757-d4cnv"]
Sep 07 17:13:38.888499 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:38.888464    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbebd68e-a21e-488c-86a8-02a97aeea200" path="/var/lib/kubelet/pods/fbebd68e-a21e-488c-86a8-02a97aeea200/volumes"
Sep 07 17:13:39.550265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:39.550228    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"]
Sep 07 17:13:39.550769 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:39.550472    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" containerID="cri-o://e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4" gracePeriod=30
Sep 07 17:13:39.586157 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:39.586120    2545 patch_prober.go:28] interesting pod/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:13:39.586300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:39.586188    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:13:44.799421 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.799393    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:13:44.929706 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929624    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/731c285c-a2e4-4088-9e13-c92dd9601574-istio-podinfo\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929706 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929687    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-credential-socket\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929747    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn9v2\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-kube-api-access-vn9v2\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929784    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/731c285c-a2e4-4088-9e13-c92dd9601574-istiod-ca-cert\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929817    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-istio-token\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929844    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-envoy\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929869    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-certs\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.929911 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929898    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-socket\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.930252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.929911    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:44.930252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930166    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:44.930252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930198    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:44.930252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930236    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-data\") pod \"731c285c-a2e4-4088-9e13-c92dd9601574\" (UID: \"731c285c-a2e4-4088-9e13-c92dd9601574\") "
Sep 07 17:13:44.930481 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930250    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/731c285c-a2e4-4088-9e13-c92dd9601574-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:44.930562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930510    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-data" (OuterVolumeSpecName: "istio-data") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:44.930628 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930597    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:44.930628 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930614    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:44.930735 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930627    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:44.930735 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930640    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:44.930735 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.930653    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/731c285c-a2e4-4088-9e13-c92dd9601574-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:44.931986 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.931960    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/731c285c-a2e4-4088-9e13-c92dd9601574-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:13:44.932107 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.932062    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-istio-token" (OuterVolumeSpecName: "istio-token") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:44.932365 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.932345    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:13:44.932432 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.932396    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-kube-api-access-vn9v2" (OuterVolumeSpecName: "kube-api-access-vn9v2") pod "731c285c-a2e4-4088-9e13-c92dd9601574" (UID: "731c285c-a2e4-4088-9e13-c92dd9601574"). InnerVolumeSpecName "kube-api-access-vn9v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:44.977769 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.977736    2545 generic.go:356] "Generic (PLEG): container finished" podID="731c285c-a2e4-4088-9e13-c92dd9601574" containerID="e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4" exitCode=0
Sep 07 17:13:44.977922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.977787    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"
Sep 07 17:13:44.977922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.977790    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" event={"ID":"731c285c-a2e4-4088-9e13-c92dd9601574","Type":"ContainerDied","Data":"e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4"}
Sep 07 17:13:44.977922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.977860    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg" event={"ID":"731c285c-a2e4-4088-9e13-c92dd9601574","Type":"ContainerDied","Data":"957b1c2c9fea825b2c5c8ec006d22672ec42559e6237c5eee2151b6c0853b514"}
Sep 07 17:13:44.977922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.977891    2545 scope.go:117] "RemoveContainer" containerID="e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4"
Sep 07 17:13:44.987122 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.987103    2545 scope.go:117] "RemoveContainer" containerID="a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"
Sep 07 17:13:44.995179 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.995164    2545 scope.go:117] "RemoveContainer" containerID="e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4"
Sep 07 17:13:44.995422 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:13:44.995405    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4\": container with ID starting with e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4 not found: ID does not exist" containerID="e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4"
Sep 07 17:13:44.995467 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.995431    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4"} err="failed to get container status \"e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4\": rpc error: code = NotFound desc = could not find container \"e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4\": container with ID starting with e3f11898b69245baa64703abae35f1e528364db9f998fba974a61bb6e49370c4 not found: ID does not exist"
Sep 07 17:13:44.995467 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.995446    2545 scope.go:117] "RemoveContainer" containerID="a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"
Sep 07 17:13:44.995722 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:13:44.995707    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027\": container with ID starting with a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027 not found: ID does not exist" containerID="a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"
Sep 07 17:13:44.995777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:44.995724    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027"} err="failed to get container status \"a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027\": rpc error: code = NotFound desc = could not find container \"a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027\": container with ID starting with a18de6e7d2cba2bed27d317f3ca665929ecff4187ebfcbe86c398610f46be027 not found: ID does not exist"
Sep 07 17:13:45.000063 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:45.000040    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"]
Sep 07 17:13:45.004648 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:45.004623    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg"]
Sep 07 17:13:45.031278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:45.031247    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/731c285c-a2e4-4088-9e13-c92dd9601574-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:45.031278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:45.031276    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn9v2\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-kube-api-access-vn9v2\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:45.031429 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:45.031287    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/731c285c-a2e4-4088-9e13-c92dd9601574-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:45.031429 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:45.031296    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/731c285c-a2e4-4088-9e13-c92dd9601574-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:13:46.892716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:46.892682    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" path="/var/lib/kubelet/pods/731c285c-a2e4-4088-9e13-c92dd9601574/volumes"
Sep 07 17:13:53.265821 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:53.265779    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:13:57.648928 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:57.648892    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"]
Sep 07 17:13:57.649344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:57.649112    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy" containerID="cri-o://91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f" gracePeriod=30
Sep 07 17:13:58.496830 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.496781    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"]
Sep 07 17:13:58.497114 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497099    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbebd68e-a21e-488c-86a8-02a97aeea200" containerName="main"
Sep 07 17:13:58.497114 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497113    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbebd68e-a21e-488c-86a8-02a97aeea200" containerName="main"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497122    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e71d3e5-c051-475d-8767-a2f931f07139" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497127    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e71d3e5-c051-475d-8767-a2f931f07139" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497139    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497145    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497153    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497159    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497170    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4e6bc4-f742-4581-9e3e-9109cb28aaf5" containerName="revoke-keys"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497176    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4e6bc4-f742-4581-9e3e-9109cb28aaf5" containerName="revoke-keys"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497224    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e71d3e5-c051-475d-8767-a2f931f07139" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497234    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy"
Sep 07 17:13:58.497244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497244    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="731c285c-a2e4-4088-9e13-c92dd9601574" containerName="istio-proxy"
Sep 07 17:13:58.498092 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497253    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbebd68e-a21e-488c-86a8-02a97aeea200" containerName="main"
Sep 07 17:13:58.498092 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497258    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4e6bc4-f742-4581-9e3e-9109cb28aaf5" containerName="revoke-keys"
Sep 07 17:13:58.498092 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.497264    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="368559b0-4fca-4ee8-9015-72d316ae15ae" containerName="istio-proxy"
Sep 07 17:13:58.500223 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.500200    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.502418 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.502398    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-1795dd-openshift-default-dockercfg-kp8p6\""
Sep 07 17:13:58.515326 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.515302    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"]
Sep 07 17:13:58.650599 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650530    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k77fb\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-kube-api-access-k77fb\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.650599 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-envoy\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650654    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-certs\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650675    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-socket\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650741    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-data\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650790    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-podinfo\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650807    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-token\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650823    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istiod-ca-cert\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.651025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.650856    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-credential-socket\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752122    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-podinfo\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752170    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-token\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752188    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istiod-ca-cert\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752216 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752211    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-credential-socket\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752260    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77fb\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-kube-api-access-k77fb\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752295    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-envoy\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752341    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-certs\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752373    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-socket\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752402    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-data\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752857 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752740    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-credential-socket\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752857 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752834    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-socket\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.752979 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.752890    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-data\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.753112 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.753092    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-certs\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.753171 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.753118    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istiod-ca-cert\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.754816 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.754793    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-envoy\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.754976 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.754957    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-podinfo\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.767425 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.767404    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-token\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.767892 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.767872    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k77fb\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-kube-api-access-k77fb\") pod \"e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") " pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:58.810519 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:58.810482    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:13:59.089622 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:59.089596    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"]
Sep 07 17:13:59.091394 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:13:59.091367    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0ab6c6_20c5_4fab_b91e_df9025cb6edc.slice/crio-b03d3e3f000d61da45936d35c12dcab9e61f08cfb2d38d2c5449ec9bf739304a WatchSource:0}: Error finding container b03d3e3f000d61da45936d35c12dcab9e61f08cfb2d38d2c5449ec9bf739304a: Status 404 returned error can't find the container with id b03d3e3f000d61da45936d35c12dcab9e61f08cfb2d38d2c5449ec9bf739304a
Sep 07 17:13:59.093701 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:59.093660    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:13:59.093807 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:59.093750    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:13:59.093807 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:13:59.093791    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:00.061799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:00.061760    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" event={"ID":"af0ab6c6-20c5-4fab-b91e-df9025cb6edc","Type":"ContainerStarted","Data":"4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f"}
Sep 07 17:14:00.062287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:00.061813    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" event={"ID":"af0ab6c6-20c5-4fab-b91e-df9025cb6edc","Type":"ContainerStarted","Data":"b03d3e3f000d61da45936d35c12dcab9e61f08cfb2d38d2c5449ec9bf739304a"}
Sep 07 17:14:00.086456 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:00.086398    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podStartSLOduration=2.086380395 podStartE2EDuration="2.086380395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:00.083394806 +0000 UTC m=+1051.723949622" watchObservedRunningTime="2026-09-07 17:14:00.086380395 +0000 UTC m=+1051.726935247"
Sep 07 17:14:00.811143 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:00.811106    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:00.816091 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:00.816063    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:01.067068 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:01.066975    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:01.068097 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:01.068077    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:01.956846 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:01.956807    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:14:02.902310 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.902285    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:14:02.987091 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.986978    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-data\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987091 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987046    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-podinfo\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987091 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987069    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ea1dc11-f587-4890-91c3-ac18419c2f25-istiod-ca-cert\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987100    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-socket\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987131    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-certs\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987156    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-credential-socket\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987179    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-token\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987204    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxkj5\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-kube-api-access-wxkj5\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987235    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-envoy\") pod \"6ea1dc11-f587-4890-91c3-ac18419c2f25\" (UID: \"6ea1dc11-f587-4890-91c3-ac18419c2f25\") "
Sep 07 17:14:02.987371 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987331    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987527    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987569    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987596    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987619    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea1dc11-f587-4890-91c3-ac18419c2f25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987682    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987743    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:02.987763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.987762    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:02.989588 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.989563    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-kube-api-access-wxkj5" (OuterVolumeSpecName: "kube-api-access-wxkj5") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "kube-api-access-wxkj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:14:02.989680 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.989625    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:14:02.989846 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.989829    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:14:02.989892 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:02.989858    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ea1dc11-f587-4890-91c3-ac18419c2f25" (UID: "6ea1dc11-f587-4890-91c3-ac18419c2f25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:14:03.079714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.079680    2545 generic.go:356] "Generic (PLEG): container finished" podID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerID="91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f" exitCode=0
Sep 07 17:14:03.079932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.079736    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"
Sep 07 17:14:03.079932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.079782    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" event={"ID":"6ea1dc11-f587-4890-91c3-ac18419c2f25","Type":"ContainerDied","Data":"91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f"}
Sep 07 17:14:03.079932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.079852    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp" event={"ID":"6ea1dc11-f587-4890-91c3-ac18419c2f25","Type":"ContainerDied","Data":"65c07bca5fa23230f4f469d6e78da5570b08a7bbf8dd6fe8ef3d77e123ae8e7c"}
Sep 07 17:14:03.079932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.079884    2545 scope.go:117] "RemoveContainer" containerID="91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f"
Sep 07 17:14:03.088198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.088144    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:03.088198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.088164    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ea1dc11-f587-4890-91c3-ac18419c2f25-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:03.088198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.088173    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:03.088198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.088183    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:03.088198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.088192    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxkj5\" (UniqueName: \"kubernetes.io/projected/6ea1dc11-f587-4890-91c3-ac18419c2f25-kube-api-access-wxkj5\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:03.088198 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.088201    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ea1dc11-f587-4890-91c3-ac18419c2f25-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:03.089782 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.089766    2545 scope.go:117] "RemoveContainer" containerID="a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"
Sep 07 17:14:03.103390 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.103346    2545 scope.go:117] "RemoveContainer" containerID="91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f"
Sep 07 17:14:03.103861 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:14:03.103828    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f\": container with ID starting with 91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f not found: ID does not exist" containerID="91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f"
Sep 07 17:14:03.103952 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.103881    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f"} err="failed to get container status \"91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f\": rpc error: code = NotFound desc = could not find container \"91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f\": container with ID starting with 91b552fe29213d4d35a5cf932b3eef9a909209c1d06ddcc1f3c7bf8e1480001f not found: ID does not exist"
Sep 07 17:14:03.103952 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.103918    2545 scope.go:117] "RemoveContainer" containerID="a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"
Sep 07 17:14:03.104210 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:14:03.104194    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a\": container with ID starting with a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a not found: ID does not exist" containerID="a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"
Sep 07 17:14:03.104262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.104212    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a"} err="failed to get container status \"a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a\": rpc error: code = NotFound desc = could not find container \"a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a\": container with ID starting with a5c25098f5d81a4d919be729f311c270ce7815a8aed5d67a7895c2436f2a554a not found: ID does not exist"
Sep 07 17:14:03.115646 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.115614    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"]
Sep 07 17:14:03.119324 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:03.119290    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp"]
Sep 07 17:14:04.888152 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:04.888118    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" path="/var/lib/kubelet/pods/6ea1dc11-f587-4890-91c3-ac18419c2f25/volumes"
Sep 07 17:14:10.551566 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.550018    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"]
Sep 07 17:14:10.551566 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.550491    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy"
Sep 07 17:14:10.551566 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.550509    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy"
Sep 07 17:14:10.551566 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.550623    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy"
Sep 07 17:14:10.567560 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.566758    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"]
Sep 07 17:14:10.567560 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.566894    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.571583 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.570031    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f799c427-openshift-default-dockercfg-f4m8r\""
Sep 07 17:14:10.665231 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.665189    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-envoy\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.666553 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.666509    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-podinfo\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.666799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.666781    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-certs\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.666954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.666938    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-socket\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.667090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.667076    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-token\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.667226 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.667205    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-data\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.667395 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.667363    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-credential-socket\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.667580 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.667561    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89g2n\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-kube-api-access-89g2n\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.667765 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.667740    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istiod-ca-cert\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769053    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-envoy\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769100    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-podinfo\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769353 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769228    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-certs\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769353 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769284    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-socket\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769353 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769321    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-token\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769353 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769351    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-data\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769395    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-credential-socket\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769468    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89g2n\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-kube-api-access-89g2n\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.769587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769513    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istiod-ca-cert\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.770022 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.769993    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-certs\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.770252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.770232    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-credential-socket\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.770337 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.770268    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istiod-ca-cert\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.770432 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.770416    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-socket\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.770583 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.770566    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-data\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.771519 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.771495    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-envoy\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.771913 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.771893    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-podinfo\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.781671 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.781639    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89g2n\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-kube-api-access-89g2n\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.782106 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.782079    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-token\") pod \"e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") " pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:10.882347 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:10.882304    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:11.179245 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:11.179217    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"]
Sep 07 17:14:11.181255 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:14:11.181228    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9fa442_d3f2_4b02_96f1_21cd5c9da1e5.slice/crio-c8643859cf84525f347ec46991480847ce2c0bf37cdb665780d585538fd6800e WatchSource:0}: Error finding container c8643859cf84525f347ec46991480847ce2c0bf37cdb665780d585538fd6800e: Status 404 returned error can't find the container with id c8643859cf84525f347ec46991480847ce2c0bf37cdb665780d585538fd6800e
Sep 07 17:14:11.183482 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:11.183451    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:11.183563 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:11.183518    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:11.183609 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:11.183583    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:12.131461 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:12.131425    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" event={"ID":"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5","Type":"ContainerStarted","Data":"f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"}
Sep 07 17:14:12.131973 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:12.131482    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" event={"ID":"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5","Type":"ContainerStarted","Data":"c8643859cf84525f347ec46991480847ce2c0bf37cdb665780d585538fd6800e"}
Sep 07 17:14:12.157046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:12.156975    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podStartSLOduration=2.15695318 podStartE2EDuration="2.15695318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:12.153046769 +0000 UTC m=+1063.793601590" watchObservedRunningTime="2026-09-07 17:14:12.15695318 +0000 UTC m=+1063.797507977"
Sep 07 17:14:12.743174 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:12.743117    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:14:12.888875 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:12.888846    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:12.889051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:12.888929    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:13.136954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:13.136921    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:13.137868 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:13.137847    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:16.068444 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.068412    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 17:14:16.068861 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.068478    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 17:14:16.155663 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.155626    2545 generic.go:356] "Generic (PLEG): container finished" podID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerID="4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f" exitCode=0
Sep 07 17:14:16.155836 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.155702    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" event={"ID":"af0ab6c6-20c5-4fab-b91e-df9025cb6edc","Type":"ContainerDied","Data":"4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f"}
Sep 07 17:14:16.156098 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.156084    2545 scope.go:117] "RemoveContainer" containerID="4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f"
Sep 07 17:14:16.157121 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.157094    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:16.157192 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.157163    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:16.157232 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:16.157195    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:17.166457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:17.166420    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" event={"ID":"af0ab6c6-20c5-4fab-b91e-df9025cb6edc","Type":"ContainerStarted","Data":"1f75727d1d05ada5b6573327c3e262f3b59706e8cf5e285c793fe0659f99a2e5"}
Sep 07 17:14:17.810695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:17.810657    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:17.810874 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:17.810812    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 17:14:17.810874 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:17.810860    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 17:14:18.811937 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:18.811891    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 17:14:18.812407 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:18.811980    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 17:14:19.811069 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:19.811023    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 17:14:19.811247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:19.811114    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 17:14:20.811333 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:20.811297    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 17:14:20.811840 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:20.811361    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 17:14:21.811707 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:21.811662    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 17:14:21.812096 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:21.811720    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 17:14:22.814889 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:22.814856    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:22.815352 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:22.815237    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:22.815999 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:22.815980    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:14:25.139191 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:25.139150    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:14:27.693045 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.693005    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"]
Sep 07 17:14:27.693575 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.693328    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy"
Sep 07 17:14:27.693575 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.693339    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy"
Sep 07 17:14:27.693575 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.693394    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea1dc11-f587-4890-91c3-ac18419c2f25" containerName="istio-proxy"
Sep 07 17:14:27.696378 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.696357    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.706376 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.706346    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-3973bf-openshift-default-dockercfg-6mglf\""
Sep 07 17:14:27.716179 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716150    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-data\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716192    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-envoy\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716212    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-podinfo\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716406 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716310    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nngs9\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-kube-api-access-nngs9\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716406 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716362    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-socket\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716406 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716392    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-certs\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716432    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-credential-socket\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716466    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istiod-ca-cert\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.716594 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.716559    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-token\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.732269 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.732243    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"]
Sep 07 17:14:27.817062 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817028    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-credential-socket\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817072    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istiod-ca-cert\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817103    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-token\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817141    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-data\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817522 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817493    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-credential-socket\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817522    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-envoy\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817500    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-data\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817571    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-podinfo\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817614    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nngs9\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-kube-api-access-nngs9\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817851 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817639    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-socket\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.817851 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817656    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-certs\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.818008 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817966    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-socket\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.818008 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.817982    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-certs\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.818524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.818504    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istiod-ca-cert\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.820113 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.820086    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-envoy\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.820262 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.820242    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-podinfo\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.827188 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.827167    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-token\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:27.827921 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:27.827894    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nngs9\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-kube-api-access-nngs9\") pod \"e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") " pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:28.009015 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:28.008918    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:28.293836 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:28.293740    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"]
Sep 07 17:14:28.297262 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:14:28.297219    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdf70a1_0111_4c75_8bcf_3e162a1602ad.slice/crio-6df2872276029a414cbebfd7313c37686736e282d93facb0851f727a060acde9 WatchSource:0}: Error finding container 6df2872276029a414cbebfd7313c37686736e282d93facb0851f727a060acde9: Status 404 returned error can't find the container with id 6df2872276029a414cbebfd7313c37686736e282d93facb0851f727a060acde9
Sep 07 17:14:28.299491 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:28.299452    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:28.299594 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:28.299556    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:28.299639 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:28.299599    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:29.179771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:29.179723    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 17:14:29.180173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:29.179798    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:14:29.240670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:29.240571    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" event={"ID":"0fdf70a1-0111-4c75-8bcf-3e162a1602ad","Type":"ContainerStarted","Data":"66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"}
Sep 07 17:14:29.240670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:29.240639    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" event={"ID":"0fdf70a1-0111-4c75-8bcf-3e162a1602ad","Type":"ContainerStarted","Data":"6df2872276029a414cbebfd7313c37686736e282d93facb0851f727a060acde9"}
Sep 07 17:14:29.265496 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:29.265425    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podStartSLOduration=2.265394929 podStartE2EDuration="2.265394929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:29.264175589 +0000 UTC m=+1080.904730406" watchObservedRunningTime="2026-09-07 17:14:29.265394929 +0000 UTC m=+1080.905949767"
Sep 07 17:14:30.009165 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.009119    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:30.014218 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.014189    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:30.247987 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.247954    2545 generic.go:356] "Generic (PLEG): container finished" podID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerID="f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85" exitCode=0
Sep 07 17:14:30.248378 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.248032    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" event={"ID":"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5","Type":"ContainerDied","Data":"f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"}
Sep 07 17:14:30.248378 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.248308    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:30.248572 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.248529    2545 scope.go:117] "RemoveContainer" containerID="f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"
Sep 07 17:14:30.249333 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.249315    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:30.249608 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.249580    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:30.249689 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.249663    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:30.249756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:30.249714    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:31.260341 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:31.260302    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" event={"ID":"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5","Type":"ContainerStarted","Data":"9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d"}
Sep 07 17:14:31.882683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:31.882636    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:31.882964 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:31.882935    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 07 17:14:31.883020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:31.882993    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 07 17:14:32.306355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.306267    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"]
Sep 07 17:14:32.308784 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.308763    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.313177 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.313157    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-3973bf-serving-cert\""
Sep 07 17:14:32.313357 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.313337    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:14:32.314400 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.314380    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:14:32.314569 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.314426    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:14:32.314657 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.314465    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:14:32.326413 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.326385    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"]
Sep 07 17:14:32.361125 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.361086    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.361511 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.361485    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.361748 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.361711    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jqs\" (UniqueName: \"kubernetes.io/projected/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-kube-api-access-55jqs\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.361859 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.361820    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.462434 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.462388    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.462659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.462460    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jqs\" (UniqueName: \"kubernetes.io/projected/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-kube-api-access-55jqs\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.462659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.462553    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.462659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.462584    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.463171 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.463147    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.465165 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.465142    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.467381 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.467360    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.471405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.471353    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jqs\" (UniqueName: \"kubernetes.io/projected/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-kube-api-access-55jqs\") pod \"maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.619875 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.619834    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:32.883285 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.883187    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 07 17:14:32.883285 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.883250    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 07 17:14:32.926466 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:32.926428    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"]
Sep 07 17:14:32.927466 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:14:32.927441    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3b9bc7_2ac0_4411_ab54_9c970a4c4c9f.slice/crio-c9461b323eceaa5dd69ab7367baa2a3539394030c8652074bba0d0f3d73e3c7c WatchSource:0}: Error finding container c9461b323eceaa5dd69ab7367baa2a3539394030c8652074bba0d0f3d73e3c7c: Status 404 returned error can't find the container with id c9461b323eceaa5dd69ab7367baa2a3539394030c8652074bba0d0f3d73e3c7c
Sep 07 17:14:33.273904 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:33.273811    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq" event={"ID":"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f","Type":"ContainerStarted","Data":"c9461b323eceaa5dd69ab7367baa2a3539394030c8652074bba0d0f3d73e3c7c"}
Sep 07 17:14:33.882779 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:33.882741    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 07 17:14:33.883193 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:33.882801    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 07 17:14:34.281653 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:34.281565    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq" event={"ID":"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f","Type":"ContainerStarted","Data":"394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69"}
Sep 07 17:14:34.281793 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:34.281692    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:34.306287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:34.306225    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq" podStartSLOduration=1.943399361 podStartE2EDuration="2.306207206s" totalImagesPullingTime="362.807845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:34.304266897 +0000 UTC m=+1085.944821696" watchObservedRunningTime="2026-09-07 17:14:34.306207206 +0000 UTC m=+1085.946762065"
Sep 07 17:14:34.883240 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:34.883196    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 07 17:14:34.883667 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:34.883266    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 07 17:14:35.753260 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:35.753223    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:14:35.883003 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:35.882962    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 07 17:14:35.883173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:35.883025    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 07 17:14:36.911573 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:36.911519    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:36.912021 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:36.911800    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:36.912468 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:36.912451    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:14:40.292732 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:40.292701    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:14:45.524241 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:45.524184    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:54758->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Sep 07 17:14:45.524719 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:45.524311    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:54758->10.133.0.56:15021: read: connection reset by peer"
Sep 07 17:14:46.346903 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.346869    2545 generic.go:356] "Generic (PLEG): container finished" podID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerID="66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015" exitCode=0
Sep 07 17:14:46.347076 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.346942    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" event={"ID":"0fdf70a1-0111-4c75-8bcf-3e162a1602ad","Type":"ContainerDied","Data":"66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"}
Sep 07 17:14:46.347362 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.347342    2545 scope.go:117] "RemoveContainer" containerID="66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"
Sep 07 17:14:46.348365 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.348340    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:46.348441 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.348429    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:46.348482 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.348464    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:14:46.661252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.661171    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"]
Sep 07 17:14:46.663343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.663327    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:46.665799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.665777    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:14:46.673574 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.673549    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"]
Sep 07 17:14:46.787034 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.786995    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291e41ad-37eb-44cb-b5bf-4a621395d5b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f799c427-zc6l9\" (UID: \"291e41ad-37eb-44cb-b5bf-4a621395d5b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:46.890935 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.890902    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291e41ad-37eb-44cb-b5bf-4a621395d5b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f799c427-zc6l9\" (UID: \"291e41ad-37eb-44cb-b5bf-4a621395d5b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:46.891722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.891697    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291e41ad-37eb-44cb-b5bf-4a621395d5b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f799c427-zc6l9\" (UID: \"291e41ad-37eb-44cb-b5bf-4a621395d5b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:46.975796 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:46.975698    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:47.253207 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:47.253170    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"]
Sep 07 17:14:47.266861 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:14:47.265874    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291e41ad_37eb_44cb_b5bf_4a621395d5b6.slice/crio-74d4c7dafa50f9edfb470cdaef54be73b66d4d780ee27b142867b5a9e7717ec1 WatchSource:0}: Error finding container 74d4c7dafa50f9edfb470cdaef54be73b66d4d780ee27b142867b5a9e7717ec1: Status 404 returned error can't find the container with id 74d4c7dafa50f9edfb470cdaef54be73b66d4d780ee27b142867b5a9e7717ec1
Sep 07 17:14:47.358828 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:47.357877    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" event={"ID":"0fdf70a1-0111-4c75-8bcf-3e162a1602ad","Type":"ContainerStarted","Data":"22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d"}
Sep 07 17:14:47.360866 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:47.360778    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9" event={"ID":"291e41ad-37eb-44cb-b5bf-4a621395d5b6","Type":"ContainerStarted","Data":"74d4c7dafa50f9edfb470cdaef54be73b66d4d780ee27b142867b5a9e7717ec1"}
Sep 07 17:14:48.009450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:48.009348    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:48.009849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:48.009614    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 17:14:48.009849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:48.009665    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 17:14:48.369634 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:48.369595    2545 generic.go:356] "Generic (PLEG): container finished" podID="291e41ad-37eb-44cb-b5bf-4a621395d5b6" containerID="03bfa478ec875a78a5e6c0a9e634c8a323ab8e5f2b997bf3a7ad8fb2a01d17b0" exitCode=0
Sep 07 17:14:48.369771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:48.369658    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9" event={"ID":"291e41ad-37eb-44cb-b5bf-4a621395d5b6","Type":"ContainerDied","Data":"03bfa478ec875a78a5e6c0a9e634c8a323ab8e5f2b997bf3a7ad8fb2a01d17b0"}
Sep 07 17:14:49.009590 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:49.009521    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 17:14:49.009996 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:49.009610    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 17:14:49.514480 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:49.514456    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:49.614023 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:49.613985    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291e41ad-37eb-44cb-b5bf-4a621395d5b6-maas-api-service-ca\") pod \"291e41ad-37eb-44cb-b5bf-4a621395d5b6\" (UID: \"291e41ad-37eb-44cb-b5bf-4a621395d5b6\") "
Sep 07 17:14:49.614355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:49.614329    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291e41ad-37eb-44cb-b5bf-4a621395d5b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "291e41ad-37eb-44cb-b5bf-4a621395d5b6" (UID: "291e41ad-37eb-44cb-b5bf-4a621395d5b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:14:49.715063 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:49.714974    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291e41ad-37eb-44cb-b5bf-4a621395d5b6-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:14:50.010259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:50.010162    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 17:14:50.010259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:50.010240    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 17:14:50.381043 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:50.381007    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"
Sep 07 17:14:50.381043 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:50.381014    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9" event={"ID":"291e41ad-37eb-44cb-b5bf-4a621395d5b6","Type":"ContainerDied","Data":"74d4c7dafa50f9edfb470cdaef54be73b66d4d780ee27b142867b5a9e7717ec1"}
Sep 07 17:14:50.381267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:50.381078    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74d4c7dafa50f9edfb470cdaef54be73b66d4d780ee27b142867b5a9e7717ec1"
Sep 07 17:14:51.010035 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:51.009997    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 17:14:51.010226 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:51.010058    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 17:14:52.010204 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:52.010156    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 17:14:52.010613 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:52.010220    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 17:14:53.013504 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:53.013469    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:53.013972 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:53.013853    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:53.014496 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:53.014475    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:14:57.720338 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:57.720298    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"]
Sep 07 17:14:57.726246 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:57.726218    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f799c427-zc6l9"]
Sep 07 17:14:58.889037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:14:58.889003    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="291e41ad-37eb-44cb-b5bf-4a621395d5b6" path="/var/lib/kubelet/pods/291e41ad-37eb-44cb-b5bf-4a621395d5b6/volumes"
Sep 07 17:15:00.139574 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.139527    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"]
Sep 07 17:15:00.140011 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.139871    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291e41ad-37eb-44cb-b5bf-4a621395d5b6" containerName="revoke-keys"
Sep 07 17:15:00.140011 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.139883    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="291e41ad-37eb-44cb-b5bf-4a621395d5b6" containerName="revoke-keys"
Sep 07 17:15:00.140011 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.139949    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="291e41ad-37eb-44cb-b5bf-4a621395d5b6" containerName="revoke-keys"
Sep 07 17:15:00.142518 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.142499    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"
Sep 07 17:15:00.145295 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.145271    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:15:00.153577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.153409    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"
Sep 07 17:15:00.157590 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.157415    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"]
Sep 07 17:15:00.432581 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.432141    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"]
Sep 07 17:15:00.434854 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:15:00.434814    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650974b6_0fc5_4f0d_9196_1899fcf46e12.slice/crio-a8c3d4fd696ae81c5f8ce176b0e42d6265afcadf8512f364b5fc0304ac51b82e WatchSource:0}: Error finding container a8c3d4fd696ae81c5f8ce176b0e42d6265afcadf8512f364b5fc0304ac51b82e: Status 404 returned error can't find the container with id a8c3d4fd696ae81c5f8ce176b0e42d6265afcadf8512f364b5fc0304ac51b82e
Sep 07 17:15:00.738913 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:00.738830    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:15:01.442514 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:01.442479    2545 generic.go:356] "Generic (PLEG): container finished" podID="650974b6-0fc5-4f0d-9196-1899fcf46e12" containerID="28512835c35e7c13170b33afe50883e9d7851ca18f130dba73639ad934e6181f" exitCode=0
Sep 07 17:15:01.442950 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:01.442569    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67" event={"ID":"650974b6-0fc5-4f0d-9196-1899fcf46e12","Type":"ContainerDied","Data":"28512835c35e7c13170b33afe50883e9d7851ca18f130dba73639ad934e6181f"}
Sep 07 17:15:01.442950 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:01.442626    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67" event={"ID":"650974b6-0fc5-4f0d-9196-1899fcf46e12","Type":"ContainerStarted","Data":"a8c3d4fd696ae81c5f8ce176b0e42d6265afcadf8512f364b5fc0304ac51b82e"}
Sep 07 17:15:02.576351 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:02.576324    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"
Sep 07 17:15:03.456884 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:03.456854    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67"
Sep 07 17:15:03.456884 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:03.456866    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813355-77n67" event={"ID":"650974b6-0fc5-4f0d-9196-1899fcf46e12","Type":"ContainerDied","Data":"a8c3d4fd696ae81c5f8ce176b0e42d6265afcadf8512f364b5fc0304ac51b82e"}
Sep 07 17:15:03.457098 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:03.456912    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8c3d4fd696ae81c5f8ce176b0e42d6265afcadf8512f364b5fc0304ac51b82e"
Sep 07 17:15:04.994518 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:04.994482    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"]
Sep 07 17:15:04.994955 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:04.994707    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" containerID="cri-o://9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d" gracePeriod=30
Sep 07 17:15:06.914619 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:06.914578    2545 patch_prober.go:28] interesting pod/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:15:06.914991 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:06.914634    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:15:10.241108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.241082    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:15:10.398322 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398269    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istiod-ca-cert\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398340    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-credential-socket\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398365    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-podinfo\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398462    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-certs\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398562 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398509    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-socket\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398812 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398594    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-envoy\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398812 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398620    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-data\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398812 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398647    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89g2n\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-kube-api-access-89g2n\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398812 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398682    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:15:10.398812 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398703    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-token\") pod \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\" (UID: \"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5\") "
Sep 07 17:15:10.398812 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398733    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:15:10.399083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398748    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:15:10.399083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398817    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:15:10.399083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.398903    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:15:10.399083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.399056    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.399083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.399074    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.399083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.399087    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.399335 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.399100    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.399335 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.399113    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.400742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.400707    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:15:10.400842 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.400813    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:15:10.400922 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.400907    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:15:10.400978 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.400960    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-kube-api-access-89g2n" (OuterVolumeSpecName: "kube-api-access-89g2n") pod "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" (UID: "8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5"). InnerVolumeSpecName "kube-api-access-89g2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:15:10.496011 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.495980    2545 generic.go:356] "Generic (PLEG): container finished" podID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerID="9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d" exitCode=0
Sep 07 17:15:10.496175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.496031    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"
Sep 07 17:15:10.496175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.496041    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" event={"ID":"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5","Type":"ContainerDied","Data":"9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d"}
Sep 07 17:15:10.496175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.496092    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw" event={"ID":"8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5","Type":"ContainerDied","Data":"c8643859cf84525f347ec46991480847ce2c0bf37cdb665780d585538fd6800e"}
Sep 07 17:15:10.496175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.496116    2545 scope.go:117] "RemoveContainer" containerID="9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d"
Sep 07 17:15:10.501943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.501910    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.501943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.501945    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.502148 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.501961    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89g2n\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-kube-api-access-89g2n\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.502148 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.501977    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:15:10.510364 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.510344    2545 scope.go:117] "RemoveContainer" containerID="f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"
Sep 07 17:15:10.518681 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.518662    2545 scope.go:117] "RemoveContainer" containerID="9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d"
Sep 07 17:15:10.518947 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:15:10.518927    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d\": container with ID starting with 9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d not found: ID does not exist" containerID="9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d"
Sep 07 17:15:10.518997 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.518956    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d"} err="failed to get container status \"9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d\": rpc error: code = NotFound desc = could not find container \"9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d\": container with ID starting with 9ada75abdbd0432fff3799524cf622f45a857707270e86af02eec2ca7f46271d not found: ID does not exist"
Sep 07 17:15:10.518997 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.518972    2545 scope.go:117] "RemoveContainer" containerID="f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"
Sep 07 17:15:10.519192 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:15:10.519178    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85\": container with ID starting with f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85 not found: ID does not exist" containerID="f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"
Sep 07 17:15:10.519237 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.519195    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85"} err="failed to get container status \"f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85\": rpc error: code = NotFound desc = could not find container \"f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85\": container with ID starting with f844f3326f07bb25887af880f374e29071d988783a2b90e00641207e6d99cc85 not found: ID does not exist"
Sep 07 17:15:10.523677 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.523655    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"]
Sep 07 17:15:10.528008 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.527984    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw"]
Sep 07 17:15:10.887888 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:10.887854    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" path="/var/lib/kubelet/pods/8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5/volumes"
Sep 07 17:15:18.842411 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:18.842368    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:15:19.827158 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827123    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"]
Sep 07 17:15:19.827484 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827467    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy"
Sep 07 17:15:19.827484 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827482    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy"
Sep 07 17:15:19.827711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827493    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="650974b6-0fc5-4f0d-9196-1899fcf46e12" containerName="cleanup"
Sep 07 17:15:19.827711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827499    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="650974b6-0fc5-4f0d-9196-1899fcf46e12" containerName="cleanup"
Sep 07 17:15:19.827711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827582    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy"
Sep 07 17:15:19.827711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827591    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy"
Sep 07 17:15:19.827711 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.827598    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="650974b6-0fc5-4f0d-9196-1899fcf46e12" containerName="cleanup"
Sep 07 17:15:19.832456 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.832430    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.836080 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.836049    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-202015-openshift-default-dockercfg-xnwm4\""
Sep 07 17:15:19.846224 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.846198    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"]
Sep 07 17:15:19.986636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986594    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-credential-socket\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.986842 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986655    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-data\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.986842 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986720    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-token\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.986842 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986776    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-certs\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.986842 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986814    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-podinfo\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.987041 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986884    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7ww\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-kube-api-access-qx7ww\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.987041 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986916    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-socket\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.987041 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986939    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-envoy\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:19.987041 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:19.986988    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istiod-ca-cert\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.087934 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.087838    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-credential-socket\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.087934 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.087892    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-data\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088019    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-token\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088075    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-certs\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088109    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-podinfo\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088175 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088153    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7ww\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-kube-api-access-qx7ww\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088392 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088185    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-socket\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088392 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088211    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-envoy\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088392 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088243    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istiod-ca-cert\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088392 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088276    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-data\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088392 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088304    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-credential-socket\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088467    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-certs\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.088670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088594    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-socket\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.089005 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.088984    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istiod-ca-cert\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.090427 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.090397    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-envoy\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.090756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.090734    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-podinfo\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.096311 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.096284    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-token\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.096605 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.096587    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7ww\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-kube-api-access-qx7ww\") pod \"e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") " pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.143450 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.143407    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:20.441525 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.441496    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"]
Sep 07 17:15:20.443719 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:15:20.443691    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0a076b_4774_4c46_9d7c_daa2d0394e05.slice/crio-392c3bf5095710e5567b1e5a4f05296ae38f03da77eea40302c150ed3ad0220c WatchSource:0}: Error finding container 392c3bf5095710e5567b1e5a4f05296ae38f03da77eea40302c150ed3ad0220c: Status 404 returned error can't find the container with id 392c3bf5095710e5567b1e5a4f05296ae38f03da77eea40302c150ed3ad0220c
Sep 07 17:15:20.446258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.446229    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:20.446330 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.446290    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:20.446369 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.446334    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:20.555280 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.555241    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" event={"ID":"dd0a076b-4774-4c46-9d7c-daa2d0394e05","Type":"ContainerStarted","Data":"2c8f57e82b3e337d9ed69c72147ad799ad3aa7af42242b5103006961068c7cdd"}
Sep 07 17:15:20.555461 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.555307    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" event={"ID":"dd0a076b-4774-4c46-9d7c-daa2d0394e05","Type":"ContainerStarted","Data":"392c3bf5095710e5567b1e5a4f05296ae38f03da77eea40302c150ed3ad0220c"}
Sep 07 17:15:20.579921 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:20.579859    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podStartSLOduration=1.579840079 podStartE2EDuration="1.579840079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:20.57797071 +0000 UTC m=+1132.218525529" watchObservedRunningTime="2026-09-07 17:15:20.579840079 +0000 UTC m=+1132.220394876"
Sep 07 17:15:21.144200 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:21.144161    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:21.149359 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:21.149332    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:21.561495 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:21.561467    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:21.562362 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:21.562342    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:29.545376 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:29.545336    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:15:40.676330 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:40.676290    2545 generic.go:356] "Generic (PLEG): container finished" podID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerID="2c8f57e82b3e337d9ed69c72147ad799ad3aa7af42242b5103006961068c7cdd" exitCode=0
Sep 07 17:15:40.676894 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:40.676368    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" event={"ID":"dd0a076b-4774-4c46-9d7c-daa2d0394e05","Type":"ContainerDied","Data":"2c8f57e82b3e337d9ed69c72147ad799ad3aa7af42242b5103006961068c7cdd"}
Sep 07 17:15:40.676894 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:40.676887    2545 scope.go:117] "RemoveContainer" containerID="2c8f57e82b3e337d9ed69c72147ad799ad3aa7af42242b5103006961068c7cdd"
Sep 07 17:15:40.678103 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:40.678077    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:40.678183 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:40.678142    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:40.678183 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:40.678173    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:41.684040 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:41.684003    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" event={"ID":"dd0a076b-4774-4c46-9d7c-daa2d0394e05","Type":"ContainerStarted","Data":"481be327bd767f6ebaccc9a323d62d949dcaa33dff50e3a8ba13827874894dab"}
Sep 07 17:15:42.144287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:42.144238    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:42.144512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:42.144386    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 17:15:42.144512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:42.144435    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 17:15:43.144957 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:43.144908    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 17:15:43.145463 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:43.144996    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 17:15:44.144244 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:44.144204    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 17:15:44.144564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:44.144514    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 17:15:45.143972 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:45.143927    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 17:15:45.144587 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:45.144552    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 17:15:46.144342 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:46.144294    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 17:15:46.144995 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:46.144958    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 17:15:47.148389 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:47.148359    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:47.148836 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:47.148670    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:47.149308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:47.149290    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:15:48.111493 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.111463    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"]
Sep 07 17:15:48.111830 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.111808    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy"
Sep 07 17:15:48.111830 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.111824    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9fa442-d3f2-4b02-96f1-21cd5c9da1e5" containerName="istio-proxy"
Sep 07 17:15:48.113944 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.113924    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.116785 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.116765    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-43ab35-openshift-default-dockercfg-7kmnb\""
Sep 07 17:15:48.132724 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.132694    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"]
Sep 07 17:15:48.232023 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.231975    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-data\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232037    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-istio-token\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232094    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561d3e64-636e-485b-b107-ecc6ff51f210-istiod-ca-cert\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232180    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7txg\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-kube-api-access-h7txg\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232218    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561d3e64-636e-485b-b107-ecc6ff51f210-istio-podinfo\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232248    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-certs\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232329    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-credential-socket\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232393    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-socket\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.232585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.232466    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-envoy\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333414 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333366    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-envoy\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333424    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-data\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333446    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-istio-token\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333467    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561d3e64-636e-485b-b107-ecc6ff51f210-istiod-ca-cert\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333503    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7txg\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-kube-api-access-h7txg\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333530    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561d3e64-636e-485b-b107-ecc6ff51f210-istio-podinfo\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333591    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-certs\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.333644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333633    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-credential-socket\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.334071 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.333676    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-socket\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.334071 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.334011    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-data\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.334323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.334280    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-certs\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.334323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.334311    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-socket\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.334474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.334400    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561d3e64-636e-485b-b107-ecc6ff51f210-istiod-ca-cert\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.334474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.334410    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-credential-socket\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.335884 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.335856    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-envoy\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.336388 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.336364    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561d3e64-636e-485b-b107-ecc6ff51f210-istio-podinfo\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.342971 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.342937    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-istio-token\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.343176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.343151    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7txg\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-kube-api-access-h7txg\") pod \"e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") " pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.424231 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.424130    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:48.710816 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.710789    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"]
Sep 07 17:15:48.712348 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:15:48.712319    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561d3e64_636e_485b_b107_ecc6ff51f210.slice/crio-ce65193e5a59ce89608e72b75f1d0967b97be8a7a6f7e35a36cf83a3987599d9 WatchSource:0}: Error finding container ce65193e5a59ce89608e72b75f1d0967b97be8a7a6f7e35a36cf83a3987599d9: Status 404 returned error can't find the container with id ce65193e5a59ce89608e72b75f1d0967b97be8a7a6f7e35a36cf83a3987599d9
Sep 07 17:15:48.714470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.714440    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:48.714564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.714505    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:48.714564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.714556    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:15:48.728675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:48.728640    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" event={"ID":"561d3e64-636e-485b-b107-ecc6ff51f210","Type":"ContainerStarted","Data":"ce65193e5a59ce89608e72b75f1d0967b97be8a7a6f7e35a36cf83a3987599d9"}
Sep 07 17:15:49.735757 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:49.735719    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" event={"ID":"561d3e64-636e-485b-b107-ecc6ff51f210","Type":"ContainerStarted","Data":"cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"}
Sep 07 17:15:49.758940 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:49.758878    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podStartSLOduration=1.758860589 podStartE2EDuration="1.758860589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:49.756627619 +0000 UTC m=+1161.397182441" watchObservedRunningTime="2026-09-07 17:15:49.758860589 +0000 UTC m=+1161.399415384"
Sep 07 17:15:50.424389 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:50.424348    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:50.429502 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:50.429474    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:50.741694 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:50.741608    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:50.742724 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:50.742706    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:15:51.877000 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:15:51.876917    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:16:07.232594 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:07.232551    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:16:11.863936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:11.863895    2545 generic.go:356] "Generic (PLEG): container finished" podID="561d3e64-636e-485b-b107-ecc6ff51f210" containerID="cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544" exitCode=0
Sep 07 17:16:11.864356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:11.863969    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" event={"ID":"561d3e64-636e-485b-b107-ecc6ff51f210","Type":"ContainerDied","Data":"cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"}
Sep 07 17:16:11.864356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:11.864333    2545 scope.go:117] "RemoveContainer" containerID="cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"
Sep 07 17:16:11.865483 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:11.865448    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:11.865565 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:11.865548    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:11.865605 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:11.865591    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:12.873363 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:12.873331    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" event={"ID":"561d3e64-636e-485b-b107-ecc6ff51f210","Type":"ContainerStarted","Data":"f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b"}
Sep 07 17:16:13.424961 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:13.424921    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:16:13.425179 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:13.425153    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 07 17:16:13.425266 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:13.425211    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 07 17:16:14.425296 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:14.425253    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 07 17:16:14.425731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:14.425324    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 07 17:16:15.424967 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:15.424927    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 07 17:16:15.425149 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:15.424991    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 07 17:16:16.425032 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:16.424989    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 07 17:16:16.425443 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:16.425065    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 07 17:16:17.270560 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.270503    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:17.272745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.272726    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:17.276673 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.276651    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:16:17.283493 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.283467    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:17.302211 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.302172    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdbz\" (UniqueName: \"kubernetes.io/projected/ef250461-1830-4d9b-b1bf-3639b7482925-kube-api-access-7gdbz\") pod \"test-curl-7724-140701956580528\" (UID: \"ef250461-1830-4d9b-b1bf-3639b7482925\") " pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:17.403452 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.403409    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdbz\" (UniqueName: \"kubernetes.io/projected/ef250461-1830-4d9b-b1bf-3639b7482925-kube-api-access-7gdbz\") pod \"test-curl-7724-140701956580528\" (UID: \"ef250461-1830-4d9b-b1bf-3639b7482925\") " pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:17.413742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.413712    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdbz\" (UniqueName: \"kubernetes.io/projected/ef250461-1830-4d9b-b1bf-3639b7482925-kube-api-access-7gdbz\") pod \"test-curl-7724-140701956580528\" (UID: \"ef250461-1830-4d9b-b1bf-3639b7482925\") " pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:17.425361 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.425323    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 07 17:16:17.425790 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.425381    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 07 17:16:17.582284 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.582235    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:17.877015 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.876979    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:17.904602 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:17.904561    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701956580528" event={"ID":"ef250461-1830-4d9b-b1bf-3639b7482925","Type":"ContainerStarted","Data":"817dc0ae2a8496bbb97f0eeb7c62637c19fe6da0f054e09fe1bddc42dd3934b6"}
Sep 07 17:16:18.429285 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:18.429250    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:16:18.429708 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:18.429637    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:16:18.430252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:18.430231    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:16:18.911247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:18.911209    2545 generic.go:356] "Generic (PLEG): container finished" podID="ef250461-1830-4d9b-b1bf-3639b7482925" containerID="eda1737a64a02bbb17f61207948d1e2067ae8c8a6b32e7d386bbae8cbd4ad631" exitCode=0
Sep 07 17:16:18.911445 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:18.911293    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701956580528" event={"ID":"ef250461-1830-4d9b-b1bf-3639b7482925","Type":"ContainerDied","Data":"eda1737a64a02bbb17f61207948d1e2067ae8c8a6b32e7d386bbae8cbd4ad631"}
Sep 07 17:16:20.044385 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.044354    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.080813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.080785    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140701956580528_ef250461-1830-4d9b-b1bf-3639b7482925/test-curl-7724-140701956580528/0.log"
Sep 07 17:16:20.102161 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.102127    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:20.105777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.105749    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:20.124628 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.124596    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gdbz\" (UniqueName: \"kubernetes.io/projected/ef250461-1830-4d9b-b1bf-3639b7482925-kube-api-access-7gdbz\") pod \"ef250461-1830-4d9b-b1bf-3639b7482925\" (UID: \"ef250461-1830-4d9b-b1bf-3639b7482925\") "
Sep 07 17:16:20.126874 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.126853    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef250461-1830-4d9b-b1bf-3639b7482925-kube-api-access-7gdbz" (OuterVolumeSpecName: "kube-api-access-7gdbz") pod "ef250461-1830-4d9b-b1bf-3639b7482925" (UID: "ef250461-1830-4d9b-b1bf-3639b7482925"). InnerVolumeSpecName "kube-api-access-7gdbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:16:20.225321 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.225237    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gdbz\" (UniqueName: \"kubernetes.io/projected/ef250461-1830-4d9b-b1bf-3639b7482925-kube-api-access-7gdbz\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:16:20.888478 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.888442    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef250461-1830-4d9b-b1bf-3639b7482925" path="/var/lib/kubelet/pods/ef250461-1830-4d9b-b1bf-3639b7482925/volumes"
Sep 07 17:16:20.924060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.924010    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.924060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:20.924047    2545 scope.go:117] "RemoveContainer" containerID="eda1737a64a02bbb17f61207948d1e2067ae8c8a6b32e7d386bbae8cbd4ad631"
Sep 07 17:16:22.535725 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:22.535683    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:16:23.113177 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.113134    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:23.113786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.113762    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef250461-1830-4d9b-b1bf-3639b7482925" containerName="test-curl-7724-140701956580528"
Sep 07 17:16:23.113840 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.113791    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef250461-1830-4d9b-b1bf-3639b7482925" containerName="test-curl-7724-140701956580528"
Sep 07 17:16:23.113931 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.113915    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef250461-1830-4d9b-b1bf-3639b7482925" containerName="test-curl-7724-140701956580528"
Sep 07 17:16:23.118676 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.118647    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:23.121645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.121617    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:16:23.123229 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.123201    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:23.147034 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.146991    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7c8\" (UniqueName: \"kubernetes.io/projected/e383ce65-2d65-49c4-8847-21262f61b989-kube-api-access-7n7c8\") pod \"test-curl-7724-140701949242656\" (UID: \"e383ce65-2d65-49c4-8847-21262f61b989\") " pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:23.247999 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.247963    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7c8\" (UniqueName: \"kubernetes.io/projected/e383ce65-2d65-49c4-8847-21262f61b989-kube-api-access-7n7c8\") pod \"test-curl-7724-140701949242656\" (UID: \"e383ce65-2d65-49c4-8847-21262f61b989\") " pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:23.259525 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.259488    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7c8\" (UniqueName: \"kubernetes.io/projected/e383ce65-2d65-49c4-8847-21262f61b989-kube-api-access-7n7c8\") pod \"test-curl-7724-140701949242656\" (UID: \"e383ce65-2d65-49c4-8847-21262f61b989\") " pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:23.431082 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.430999    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:23.703888 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.703863    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:23.706181 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:16:23.706150    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode383ce65_2d65_49c4_8847_21262f61b989.slice/crio-63a288151bd163fcbb8a97670386570282a7ab3dfb401547ae82245b61fea1ba WatchSource:0}: Error finding container 63a288151bd163fcbb8a97670386570282a7ab3dfb401547ae82245b61fea1ba: Status 404 returned error can't find the container with id 63a288151bd163fcbb8a97670386570282a7ab3dfb401547ae82245b61fea1ba
Sep 07 17:16:23.944277 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:23.944239    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701949242656" event={"ID":"e383ce65-2d65-49c4-8847-21262f61b989","Type":"ContainerStarted","Data":"63a288151bd163fcbb8a97670386570282a7ab3dfb401547ae82245b61fea1ba"}
Sep 07 17:16:24.951531 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:24.951495    2545 generic.go:356] "Generic (PLEG): container finished" podID="e383ce65-2d65-49c4-8847-21262f61b989" containerID="c0c8ca880151dabca05d100963149696fe67943ebc17e94772b6a183ae0a47d2" exitCode=0
Sep 07 17:16:24.951939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:24.951580    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701949242656" event={"ID":"e383ce65-2d65-49c4-8847-21262f61b989","Type":"ContainerDied","Data":"c0c8ca880151dabca05d100963149696fe67943ebc17e94772b6a183ae0a47d2"}
Sep 07 17:16:26.105961 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.105935    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:26.128663 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.128633    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140701949242656_e383ce65-2d65-49c4-8847-21262f61b989/test-curl-7724-140701949242656/0.log"
Sep 07 17:16:26.153860 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.153823    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:26.155834 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.155809    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:26.172461 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.172431    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n7c8\" (UniqueName: \"kubernetes.io/projected/e383ce65-2d65-49c4-8847-21262f61b989-kube-api-access-7n7c8\") pod \"e383ce65-2d65-49c4-8847-21262f61b989\" (UID: \"e383ce65-2d65-49c4-8847-21262f61b989\") "
Sep 07 17:16:26.174528 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.174501    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e383ce65-2d65-49c4-8847-21262f61b989-kube-api-access-7n7c8" (OuterVolumeSpecName: "kube-api-access-7n7c8") pod "e383ce65-2d65-49c4-8847-21262f61b989" (UID: "e383ce65-2d65-49c4-8847-21262f61b989"). InnerVolumeSpecName "kube-api-access-7n7c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:16:26.274040 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.273953    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n7c8\" (UniqueName: \"kubernetes.io/projected/e383ce65-2d65-49c4-8847-21262f61b989-kube-api-access-7n7c8\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:16:26.888086 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.888051    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e383ce65-2d65-49c4-8847-21262f61b989" path="/var/lib/kubelet/pods/e383ce65-2d65-49c4-8847-21262f61b989/volumes"
Sep 07 17:16:26.972910 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.972882    2545 scope.go:117] "RemoveContainer" containerID="c0c8ca880151dabca05d100963149696fe67943ebc17e94772b6a183ae0a47d2"
Sep 07 17:16:26.973160 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:26.972921    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:28.984077 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:28.984042    2545 scope.go:117] "RemoveContainer" containerID="f0d5774ebf468135beb3dc6a7f892bb8d47cc81dc96f180b81786b9ce28f0cf4"
Sep 07 17:16:30.978310 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.978275    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"]
Sep 07 17:16:30.978787 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.978770    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e383ce65-2d65-49c4-8847-21262f61b989" containerName="test-curl-7724-140701949242656"
Sep 07 17:16:30.978832 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.978790    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="e383ce65-2d65-49c4-8847-21262f61b989" containerName="test-curl-7724-140701949242656"
Sep 07 17:16:30.978888 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.978877    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="e383ce65-2d65-49c4-8847-21262f61b989" containerName="test-curl-7724-140701949242656"
Sep 07 17:16:30.983511 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.983491    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:30.988462 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.988441    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4170e7d8-openshift-default-dockercfg-2w9t4\""
Sep 07 17:16:30.999261 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:30.999232    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"]
Sep 07 17:16:31.016451 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016413    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-envoy\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016476    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-socket\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016502    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-certs\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016529    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-data\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016586    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istiod-ca-cert\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016659 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016609    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5llh\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-kube-api-access-z5llh\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016666    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-podinfo\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016707    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-credential-socket\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.016916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.016739    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-token\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.117782 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117740    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-envoy\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117814    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-socket\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117843    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-certs\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117871    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-data\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117905    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istiod-ca-cert\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117931    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5llh\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-kube-api-access-z5llh\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.117973    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-podinfo\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.118020    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-credential-socket\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.118049    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-token\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118528 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.118501    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-data\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.118646 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.118611    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-socket\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.119161 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.118802    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-certs\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.119318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.119080    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-credential-socket\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.119318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.119175    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istiod-ca-cert\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.121356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.121288    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-envoy\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.121739 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.121717    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-podinfo\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.128059 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.128031    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-token\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.129510 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.129481    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5llh\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-kube-api-access-z5llh\") pod \"e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") " pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.294281 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.294172    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:31.577615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.577589    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"]
Sep 07 17:16:31.578776 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:16:31.578751    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69aeafb_f674_4a47_9e28_50e2dd033cc3.slice/crio-aed2ea6764ef632d4a47913d2f31442ef2e6ec1defb3987bcc5d38e64bfae7be WatchSource:0}: Error finding container aed2ea6764ef632d4a47913d2f31442ef2e6ec1defb3987bcc5d38e64bfae7be: Status 404 returned error can't find the container with id aed2ea6764ef632d4a47913d2f31442ef2e6ec1defb3987bcc5d38e64bfae7be
Sep 07 17:16:31.581018 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.580986    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:31.581090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.581053    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:31.581090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:31.581082    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:32.005866 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:32.005777    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" event={"ID":"a69aeafb-f674-4a47-9e28-50e2dd033cc3","Type":"ContainerStarted","Data":"ab9ade6a72844930024ecfb549a6d8c4187ee1c8f5fb6c3f8c7630fb32a0c3c3"}
Sep 07 17:16:32.005866 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:32.005857    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" event={"ID":"a69aeafb-f674-4a47-9e28-50e2dd033cc3","Type":"ContainerStarted","Data":"aed2ea6764ef632d4a47913d2f31442ef2e6ec1defb3987bcc5d38e64bfae7be"}
Sep 07 17:16:32.037180 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:32.037122    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podStartSLOduration=2.037106509 podStartE2EDuration="2.037106509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:16:32.033864987 +0000 UTC m=+1203.674419804" watchObservedRunningTime="2026-09-07 17:16:32.037106509 +0000 UTC m=+1203.677661306"
Sep 07 17:16:32.295444 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:32.295353    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:32.300670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:32.300646    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:33.011647 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:33.011619    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:33.012720 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:33.012700    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:40.342482 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:40.342441    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:16:49.053768 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:49.053713    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 17:16:49.054281 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:49.053783    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:16:50.114647 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:50.114611    2545 generic.go:356] "Generic (PLEG): container finished" podID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerID="ab9ade6a72844930024ecfb549a6d8c4187ee1c8f5fb6c3f8c7630fb32a0c3c3" exitCode=0
Sep 07 17:16:50.115067 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:50.114684    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" event={"ID":"a69aeafb-f674-4a47-9e28-50e2dd033cc3","Type":"ContainerDied","Data":"ab9ade6a72844930024ecfb549a6d8c4187ee1c8f5fb6c3f8c7630fb32a0c3c3"}
Sep 07 17:16:50.115113 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:50.115090    2545 scope.go:117] "RemoveContainer" containerID="ab9ade6a72844930024ecfb549a6d8c4187ee1c8f5fb6c3f8c7630fb32a0c3c3"
Sep 07 17:16:50.116231 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:50.116204    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:50.116292 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:50.116279    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:50.116330 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:50.116314    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:16:51.122046 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:51.122012    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" event={"ID":"a69aeafb-f674-4a47-9e28-50e2dd033cc3","Type":"ContainerStarted","Data":"26a2403ec4939b6d17e2b66a50ea05614cf70e6834de1fd1fa486e7526008f65"}
Sep 07 17:16:51.294876 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:51.294835    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:51.295123 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:51.295102    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 17:16:51.295178 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:51.295161    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 17:16:52.295018 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:52.294980    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 17:16:52.295407 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:52.295033    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 17:16:53.295195 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:53.295152    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 17:16:53.295636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:53.295240    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 17:16:54.294939 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:54.294897    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 17:16:54.295122 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:54.294956    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 17:16:55.295225 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:55.295186    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 17:16:55.295623 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:55.295254    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 17:16:56.136607 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:56.136566    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:16:56.295760 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:56.295710    2545 patch_prober.go:28] interesting pod/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 17:16:56.296136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:56.295791    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 17:16:57.298820 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:57.298789    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:57.299190 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:57.299141    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:16:57.299868 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:16:57.299848    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:17:14.647788 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:14.647750    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:17:29.012465 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:29.012392    2545 scope.go:117] "RemoveContainer" containerID="54ba27c799e9f71ea0fea16bfd5c6525710ab476209b03c6297b0c204c156cd4"
Sep 07 17:17:31.575625 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:31.575583    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:17:38.155486 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.155451    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"]
Sep 07 17:17:38.160260 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.160242    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:38.162899 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.162875    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:17:38.168692 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.168659    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"]
Sep 07 17:17:38.215552 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.215498    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfeb722d-98ac-4144-8b5e-a8731838b30f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf\" (UID: \"bfeb722d-98ac-4144-8b5e-a8731838b30f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:38.317029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.316989    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfeb722d-98ac-4144-8b5e-a8731838b30f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf\" (UID: \"bfeb722d-98ac-4144-8b5e-a8731838b30f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:38.317658 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.317637    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfeb722d-98ac-4144-8b5e-a8731838b30f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf\" (UID: \"bfeb722d-98ac-4144-8b5e-a8731838b30f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:38.471318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.471220    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:38.745053 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:38.745020    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"]
Sep 07 17:17:38.746721 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:17:38.746693    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfeb722d_98ac_4144_8b5e_a8731838b30f.slice/crio-cddbf72c940204432bab9d8f42270a25dda3d33235055e791db19d71a40ed47c WatchSource:0}: Error finding container cddbf72c940204432bab9d8f42270a25dda3d33235055e791db19d71a40ed47c: Status 404 returned error can't find the container with id cddbf72c940204432bab9d8f42270a25dda3d33235055e791db19d71a40ed47c
Sep 07 17:17:39.394871 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:39.394832    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf" event={"ID":"bfeb722d-98ac-4144-8b5e-a8731838b30f","Type":"ContainerStarted","Data":"ad4cfc8b2e2595f7247ae4842791691035813baf15a662420967e87ec107b470"}
Sep 07 17:17:39.395314 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:39.394886    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf" event={"ID":"bfeb722d-98ac-4144-8b5e-a8731838b30f","Type":"ContainerStarted","Data":"cddbf72c940204432bab9d8f42270a25dda3d33235055e791db19d71a40ed47c"}
Sep 07 17:17:39.414017 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:39.413961    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf" podStartSLOduration=1.413945146 podStartE2EDuration="1.413945146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:17:39.411788972 +0000 UTC m=+1271.052343788" watchObservedRunningTime="2026-09-07 17:17:39.413945146 +0000 UTC m=+1271.054499944"
Sep 07 17:17:40.401987 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:40.401948    2545 generic.go:356] "Generic (PLEG): container finished" podID="bfeb722d-98ac-4144-8b5e-a8731838b30f" containerID="ad4cfc8b2e2595f7247ae4842791691035813baf15a662420967e87ec107b470" exitCode=0
Sep 07 17:17:40.402403 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:40.402007    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf" event={"ID":"bfeb722d-98ac-4144-8b5e-a8731838b30f","Type":"ContainerDied","Data":"ad4cfc8b2e2595f7247ae4842791691035813baf15a662420967e87ec107b470"}
Sep 07 17:17:41.544523 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:41.544490    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:41.645419 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:41.645372    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfeb722d-98ac-4144-8b5e-a8731838b30f-maas-api-service-ca\") pod \"bfeb722d-98ac-4144-8b5e-a8731838b30f\" (UID: \"bfeb722d-98ac-4144-8b5e-a8731838b30f\") "
Sep 07 17:17:41.645775 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:41.645752    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfeb722d-98ac-4144-8b5e-a8731838b30f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bfeb722d-98ac-4144-8b5e-a8731838b30f" (UID: "bfeb722d-98ac-4144-8b5e-a8731838b30f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:17:41.746031 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:41.745936    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfeb722d-98ac-4144-8b5e-a8731838b30f-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:17:42.414910 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:42.414878    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"
Sep 07 17:17:42.415083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:42.414926    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf" event={"ID":"bfeb722d-98ac-4144-8b5e-a8731838b30f","Type":"ContainerDied","Data":"cddbf72c940204432bab9d8f42270a25dda3d33235055e791db19d71a40ed47c"}
Sep 07 17:17:42.415083 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:42.414975    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cddbf72c940204432bab9d8f42270a25dda3d33235055e791db19d71a40ed47c"
Sep 07 17:17:50.437769 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:50.437734    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:17:53.604771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.604738    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7727-ac9b9a"]
Sep 07 17:17:53.605140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.605114    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfeb722d-98ac-4144-8b5e-a8731838b30f" containerName="revoke-keys"
Sep 07 17:17:53.605140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.605129    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfeb722d-98ac-4144-8b5e-a8731838b30f" containerName="revoke-keys"
Sep 07 17:17:53.605211 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.605198    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfeb722d-98ac-4144-8b5e-a8731838b30f" containerName="revoke-keys"
Sep 07 17:17:53.608049 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.608031    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:53.610692 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.610670    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:17:53.624785 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.624660    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7727-ac9b9a"]
Sep 07 17:17:53.753376 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.753337    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww7ll\" (UniqueName: \"kubernetes.io/projected/6121feab-60bc-4b4a-9974-c54250bfd598-kube-api-access-ww7ll\") pod \"mt-curl-7727-ac9b9a\" (UID: \"6121feab-60bc-4b4a-9974-c54250bfd598\") " pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:53.854640 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.854603    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww7ll\" (UniqueName: \"kubernetes.io/projected/6121feab-60bc-4b4a-9974-c54250bfd598-kube-api-access-ww7ll\") pod \"mt-curl-7727-ac9b9a\" (UID: \"6121feab-60bc-4b4a-9974-c54250bfd598\") " pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:53.871644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.871569    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww7ll\" (UniqueName: \"kubernetes.io/projected/6121feab-60bc-4b4a-9974-c54250bfd598-kube-api-access-ww7ll\") pod \"mt-curl-7727-ac9b9a\" (UID: \"6121feab-60bc-4b4a-9974-c54250bfd598\") " pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:53.920333 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:53.920298    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:54.095425 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:54.095390    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"]
Sep 07 17:17:54.099218 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:54.099191    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4170e7d8-4ntbf"]
Sep 07 17:17:54.207492 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:54.207386    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7727-ac9b9a"]
Sep 07 17:17:54.217493 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:17:54.217463    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6121feab_60bc_4b4a_9974_c54250bfd598.slice/crio-91d58ea1feca0b7e3200496374f0ad9e2ee8bd68d6183149292b93a4791157dc WatchSource:0}: Error finding container 91d58ea1feca0b7e3200496374f0ad9e2ee8bd68d6183149292b93a4791157dc: Status 404 returned error can't find the container with id 91d58ea1feca0b7e3200496374f0ad9e2ee8bd68d6183149292b93a4791157dc
Sep 07 17:17:54.219182 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:54.219156    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:17:54.481805 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:54.481714    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7727-ac9b9a" event={"ID":"6121feab-60bc-4b4a-9974-c54250bfd598","Type":"ContainerStarted","Data":"91d58ea1feca0b7e3200496374f0ad9e2ee8bd68d6183149292b93a4791157dc"}
Sep 07 17:17:54.888514 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:54.888483    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfeb722d-98ac-4144-8b5e-a8731838b30f" path="/var/lib/kubelet/pods/bfeb722d-98ac-4144-8b5e-a8731838b30f/volumes"
Sep 07 17:17:55.488583 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:55.488515    2545 generic.go:356] "Generic (PLEG): container finished" podID="6121feab-60bc-4b4a-9974-c54250bfd598" containerID="46e90e318dc9efa2c6aca37b8cbcd3f29399e5a85afe5fc1e018e15a1a4447dc" exitCode=0
Sep 07 17:17:55.488782 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:55.488607    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7727-ac9b9a" event={"ID":"6121feab-60bc-4b4a-9974-c54250bfd598","Type":"ContainerDied","Data":"46e90e318dc9efa2c6aca37b8cbcd3f29399e5a85afe5fc1e018e15a1a4447dc"}
Sep 07 17:17:56.624121 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.624095    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:56.664866 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.664830    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7727-ac9b9a_6121feab-60bc-4b4a-9974-c54250bfd598/mt-curl-7727-ac9b9a/0.log"
Sep 07 17:17:56.681362 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.681333    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww7ll\" (UniqueName: \"kubernetes.io/projected/6121feab-60bc-4b4a-9974-c54250bfd598-kube-api-access-ww7ll\") pod \"6121feab-60bc-4b4a-9974-c54250bfd598\" (UID: \"6121feab-60bc-4b4a-9974-c54250bfd598\") "
Sep 07 17:17:56.683356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.683328    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6121feab-60bc-4b4a-9974-c54250bfd598-kube-api-access-ww7ll" (OuterVolumeSpecName: "kube-api-access-ww7ll") pod "6121feab-60bc-4b4a-9974-c54250bfd598" (UID: "6121feab-60bc-4b4a-9974-c54250bfd598"). InnerVolumeSpecName "kube-api-access-ww7ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:17:56.689323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.689291    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7727-ac9b9a"]
Sep 07 17:17:56.691469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.691448    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7727-ac9b9a"]
Sep 07 17:17:56.782596 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.782476    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww7ll\" (UniqueName: \"kubernetes.io/projected/6121feab-60bc-4b4a-9974-c54250bfd598-kube-api-access-ww7ll\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:17:56.891893 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:56.891861    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6121feab-60bc-4b4a-9974-c54250bfd598" path="/var/lib/kubelet/pods/6121feab-60bc-4b4a-9974-c54250bfd598/volumes"
Sep 07 17:17:57.500453 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:57.500421    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-ac9b9a"
Sep 07 17:17:57.500640 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:17:57.500457    2545 scope.go:117] "RemoveContainer" containerID="46e90e318dc9efa2c6aca37b8cbcd3f29399e5a85afe5fc1e018e15a1a4447dc"
Sep 07 17:18:09.147373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:18:09.147333    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:18:29.039909 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:18:29.039864    2545 scope.go:117] "RemoveContainer" containerID="38cb7100230afc6908001b586f9e74cffcbd3f95fb97f46d7f0d6202313ac0f0"
Sep 07 17:18:29.052379 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:18:29.052332    2545 scope.go:117] "RemoveContainer" containerID="d26539cb70b1fcbf6547508c89727ff21e838e9f50f2b29b2c7e3e57f5dd402d"
Sep 07 17:18:29.063972 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:18:29.063946    2545 scope.go:117] "RemoveContainer" containerID="9f8465cccad6b23243b780b81a67c330059f3e39ffb1b5c411eeefd19ffe527f"
Sep 07 17:19:00.655862 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:00.655775    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"]
Sep 07 17:19:00.656399 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:00.656023    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy" containerID="cri-o://26a2403ec4939b6d17e2b66a50ea05614cf70e6834de1fd1fa486e7526008f65" gracePeriod=30
Sep 07 17:19:01.438963 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:01.438927    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:19:05.876180 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.876142    2545 generic.go:356] "Generic (PLEG): container finished" podID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerID="26a2403ec4939b6d17e2b66a50ea05614cf70e6834de1fd1fa486e7526008f65" exitCode=0
Sep 07 17:19:05.876673 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.876211    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" event={"ID":"a69aeafb-f674-4a47-9e28-50e2dd033cc3","Type":"ContainerDied","Data":"26a2403ec4939b6d17e2b66a50ea05614cf70e6834de1fd1fa486e7526008f65"}
Sep 07 17:19:05.876673 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.876273    2545 scope.go:117] "RemoveContainer" containerID="ab9ade6a72844930024ecfb549a6d8c4187ee1c8f5fb6c3f8c7630fb32a0c3c3"
Sep 07 17:19:05.905763 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.905738    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:19:05.998100 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998010    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-podinfo\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998100 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998055    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-certs\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998100 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998089    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-token\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998123    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-credential-socket\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998184    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-envoy\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998215    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-socket\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998237    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istiod-ca-cert\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998270    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-data\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998295    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5llh\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-kube-api-access-z5llh\") pod \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\" (UID: \"a69aeafb-f674-4a47-9e28-50e2dd033cc3\") "
Sep 07 17:19:05.998754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998465    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:19:05.998754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998590    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:05.998754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998472    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:19:05.998754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998667    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:19:05.998754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998722    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:19:05.998974 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:05.998790    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:19:06.000265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.000243    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:19:06.000472 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.000450    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-kube-api-access-z5llh" (OuterVolumeSpecName: "kube-api-access-z5llh") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "kube-api-access-z5llh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:19:06.000722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.000697    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:19:06.000722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.000700    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a69aeafb-f674-4a47-9e28-50e2dd033cc3" (UID: "a69aeafb-f674-4a47-9e28-50e2dd033cc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:19:06.099578 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099517    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099578 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099575    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099578 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099584    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5llh\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-kube-api-access-z5llh\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099595    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099603    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099611    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099618    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.099813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.099627    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69aeafb-f674-4a47-9e28-50e2dd033cc3-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:06.884505 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.884473    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"
Sep 07 17:19:06.890558 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.890509    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk" event={"ID":"a69aeafb-f674-4a47-9e28-50e2dd033cc3","Type":"ContainerDied","Data":"aed2ea6764ef632d4a47913d2f31442ef2e6ec1defb3987bcc5d38e64bfae7be"}
Sep 07 17:19:06.890801 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.890785    2545 scope.go:117] "RemoveContainer" containerID="26a2403ec4939b6d17e2b66a50ea05614cf70e6834de1fd1fa486e7526008f65"
Sep 07 17:19:06.913713 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.913683    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"]
Sep 07 17:19:06.919218 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:06.919191    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk"]
Sep 07 17:19:08.888485 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:08.888451    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" path="/var/lib/kubelet/pods/a69aeafb-f674-4a47-9e28-50e2dd033cc3/volumes"
Sep 07 17:19:22.044184 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:22.044149    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:19:29.099834 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:29.099798    2545 scope.go:117] "RemoveContainer" containerID="bca46f018e088f4681cb190bbf053e9cf6250269a9cf6b6505220fa1d2fff370"
Sep 07 17:19:29.108501 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:29.108478    2545 scope.go:117] "RemoveContainer" containerID="0a9bc83b0d8ba7de81b1edec609a92f366a32e0798dad92a13d926fb2cba1440"
Sep 07 17:19:37.330418 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:37.330381    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:19:41.672986 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.672949    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7727-00bc32"]
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673287    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6121feab-60bc-4b4a-9974-c54250bfd598" containerName="mt-curl-7727-ac9b9a"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673298    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6121feab-60bc-4b4a-9974-c54250bfd598" containerName="mt-curl-7727-ac9b9a"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673309    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673315    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673325    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673331    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673393    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6121feab-60bc-4b4a-9974-c54250bfd598" containerName="mt-curl-7727-ac9b9a"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673403    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy"
Sep 07 17:19:41.673446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.673418    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69aeafb-f674-4a47-9e28-50e2dd033cc3" containerName="istio-proxy"
Sep 07 17:19:41.677652 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.677635    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:41.680863 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.680835    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:19:41.683322 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.683286    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7727-00bc32"]
Sep 07 17:19:41.820491 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.820453    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6ktf\" (UniqueName: \"kubernetes.io/projected/4935f5ce-4945-4913-a489-7c5314b35f5e-kube-api-access-h6ktf\") pod \"mt-curl-7727-00bc32\" (UID: \"4935f5ce-4945-4913-a489-7c5314b35f5e\") " pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:41.921670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.921630    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6ktf\" (UniqueName: \"kubernetes.io/projected/4935f5ce-4945-4913-a489-7c5314b35f5e-kube-api-access-h6ktf\") pod \"mt-curl-7727-00bc32\" (UID: \"4935f5ce-4945-4913-a489-7c5314b35f5e\") " pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:41.930377 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.930321    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6ktf\" (UniqueName: \"kubernetes.io/projected/4935f5ce-4945-4913-a489-7c5314b35f5e-kube-api-access-h6ktf\") pod \"mt-curl-7727-00bc32\" (UID: \"4935f5ce-4945-4913-a489-7c5314b35f5e\") " pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:41.988341 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:41.988309    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:42.258363 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:42.258336    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7727-00bc32"]
Sep 07 17:19:42.260930 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:19:42.260905    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4935f5ce_4945_4913_a489_7c5314b35f5e.slice/crio-72878429f943cec15030fe7916f2f9a708a7ffdfb1a8c53e70786f3de21002e1 WatchSource:0}: Error finding container 72878429f943cec15030fe7916f2f9a708a7ffdfb1a8c53e70786f3de21002e1: Status 404 returned error can't find the container with id 72878429f943cec15030fe7916f2f9a708a7ffdfb1a8c53e70786f3de21002e1
Sep 07 17:19:43.082330 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:43.082295    2545 generic.go:356] "Generic (PLEG): container finished" podID="4935f5ce-4945-4913-a489-7c5314b35f5e" containerID="eed02cf71921a41812ae57ae02ec4b15f320d4351f2957d7dd2b7cfa6c0e4cd9" exitCode=0
Sep 07 17:19:43.082776 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:43.082378    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7727-00bc32" event={"ID":"4935f5ce-4945-4913-a489-7c5314b35f5e","Type":"ContainerDied","Data":"eed02cf71921a41812ae57ae02ec4b15f320d4351f2957d7dd2b7cfa6c0e4cd9"}
Sep 07 17:19:43.082776 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:43.082419    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7727-00bc32" event={"ID":"4935f5ce-4945-4913-a489-7c5314b35f5e","Type":"ContainerStarted","Data":"72878429f943cec15030fe7916f2f9a708a7ffdfb1a8c53e70786f3de21002e1"}
Sep 07 17:19:44.224991 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.224962    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:44.259347 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.259323    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7727-00bc32_4935f5ce-4945-4913-a489-7c5314b35f5e/mt-curl-7727-00bc32/0.log"
Sep 07 17:19:44.279838 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.279808    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7727-00bc32"]
Sep 07 17:19:44.283714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.283690    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7727-00bc32"]
Sep 07 17:19:44.344778 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.344696    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6ktf\" (UniqueName: \"kubernetes.io/projected/4935f5ce-4945-4913-a489-7c5314b35f5e-kube-api-access-h6ktf\") pod \"4935f5ce-4945-4913-a489-7c5314b35f5e\" (UID: \"4935f5ce-4945-4913-a489-7c5314b35f5e\") "
Sep 07 17:19:44.346730 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.346702    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4935f5ce-4945-4913-a489-7c5314b35f5e-kube-api-access-h6ktf" (OuterVolumeSpecName: "kube-api-access-h6ktf") pod "4935f5ce-4945-4913-a489-7c5314b35f5e" (UID: "4935f5ce-4945-4913-a489-7c5314b35f5e"). InnerVolumeSpecName "kube-api-access-h6ktf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:19:44.398144 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.398113    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7727-41470f"]
Sep 07 17:19:44.398439 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.398427    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4935f5ce-4945-4913-a489-7c5314b35f5e" containerName="mt-curl-7727-00bc32"
Sep 07 17:19:44.398494 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.398440    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="4935f5ce-4945-4913-a489-7c5314b35f5e" containerName="mt-curl-7727-00bc32"
Sep 07 17:19:44.398560 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.398507    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="4935f5ce-4945-4913-a489-7c5314b35f5e" containerName="mt-curl-7727-00bc32"
Sep 07 17:19:44.401312 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.401296    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:44.406097 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.406072    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7727-41470f"]
Sep 07 17:19:44.446136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.446106    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6ktf\" (UniqueName: \"kubernetes.io/projected/4935f5ce-4945-4913-a489-7c5314b35f5e-kube-api-access-h6ktf\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:44.546636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.546601    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq942\" (UniqueName: \"kubernetes.io/projected/d26a7825-307c-4ea8-b66c-33e1e838cadb-kube-api-access-mq942\") pod \"mt-curl-7727-41470f\" (UID: \"d26a7825-307c-4ea8-b66c-33e1e838cadb\") " pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:44.648006 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.647911    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq942\" (UniqueName: \"kubernetes.io/projected/d26a7825-307c-4ea8-b66c-33e1e838cadb-kube-api-access-mq942\") pod \"mt-curl-7727-41470f\" (UID: \"d26a7825-307c-4ea8-b66c-33e1e838cadb\") " pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:44.656557 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.656512    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq942\" (UniqueName: \"kubernetes.io/projected/d26a7825-307c-4ea8-b66c-33e1e838cadb-kube-api-access-mq942\") pod \"mt-curl-7727-41470f\" (UID: \"d26a7825-307c-4ea8-b66c-33e1e838cadb\") " pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:44.712344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.712306    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:44.888633 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.888602    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4935f5ce-4945-4913-a489-7c5314b35f5e" path="/var/lib/kubelet/pods/4935f5ce-4945-4913-a489-7c5314b35f5e/volumes"
Sep 07 17:19:44.982256 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:44.982230    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7727-41470f"]
Sep 07 17:19:44.983627 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:19:44.983600    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd26a7825_307c_4ea8_b66c_33e1e838cadb.slice/crio-401e4ca5c52af5605a7186c31f3a97d7217f117f840fb18ade5f76e847f9af4f WatchSource:0}: Error finding container 401e4ca5c52af5605a7186c31f3a97d7217f117f840fb18ade5f76e847f9af4f: Status 404 returned error can't find the container with id 401e4ca5c52af5605a7186c31f3a97d7217f117f840fb18ade5f76e847f9af4f
Sep 07 17:19:45.094332 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:45.094304    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-00bc32"
Sep 07 17:19:45.094332 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:45.094332    2545 scope.go:117] "RemoveContainer" containerID="eed02cf71921a41812ae57ae02ec4b15f320d4351f2957d7dd2b7cfa6c0e4cd9"
Sep 07 17:19:45.095830 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:45.095805    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7727-41470f" event={"ID":"d26a7825-307c-4ea8-b66c-33e1e838cadb","Type":"ContainerStarted","Data":"401e4ca5c52af5605a7186c31f3a97d7217f117f840fb18ade5f76e847f9af4f"}
Sep 07 17:19:46.102670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:46.102633    2545 generic.go:356] "Generic (PLEG): container finished" podID="d26a7825-307c-4ea8-b66c-33e1e838cadb" containerID="db6ab06eaeea63bf998ce06e0035e1abd1f722e662960c6123bb267f9f682e5e" exitCode=0
Sep 07 17:19:46.103131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:46.102715    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7727-41470f" event={"ID":"d26a7825-307c-4ea8-b66c-33e1e838cadb","Type":"ContainerDied","Data":"db6ab06eaeea63bf998ce06e0035e1abd1f722e662960c6123bb267f9f682e5e"}
Sep 07 17:19:47.242590 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.242567    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:47.260813 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.260773    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7727-41470f_d26a7825-307c-4ea8-b66c-33e1e838cadb/mt-curl-7727-41470f/0.log"
Sep 07 17:19:47.280548 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.280506    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7727-41470f"]
Sep 07 17:19:47.283628 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.283595    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7727-41470f"]
Sep 07 17:19:47.372323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.372244    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq942\" (UniqueName: \"kubernetes.io/projected/d26a7825-307c-4ea8-b66c-33e1e838cadb-kube-api-access-mq942\") pod \"d26a7825-307c-4ea8-b66c-33e1e838cadb\" (UID: \"d26a7825-307c-4ea8-b66c-33e1e838cadb\") "
Sep 07 17:19:47.374272 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.374249    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d26a7825-307c-4ea8-b66c-33e1e838cadb-kube-api-access-mq942" (OuterVolumeSpecName: "kube-api-access-mq942") pod "d26a7825-307c-4ea8-b66c-33e1e838cadb" (UID: "d26a7825-307c-4ea8-b66c-33e1e838cadb"). InnerVolumeSpecName "kube-api-access-mq942". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:19:47.473028 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:47.472993    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq942\" (UniqueName: \"kubernetes.io/projected/d26a7825-307c-4ea8-b66c-33e1e838cadb-kube-api-access-mq942\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:19:48.114844 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:48.114819    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:48.114844 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:48.114845    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="401e4ca5c52af5605a7186c31f3a97d7217f117f840fb18ade5f76e847f9af4f"
Sep 07 17:19:48.125160 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:19:48.125133    2545 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7727-41470f\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" podUID="d26a7825-307c-4ea8-b66c-33e1e838cadb" pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:48.886875 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:19:48.886826    2545 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7727-41470f\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" podUID="d26a7825-307c-4ea8-b66c-33e1e838cadb" pod="opendatahub/mt-curl-7727-41470f"
Sep 07 17:19:48.887941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:48.887920    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d26a7825-307c-4ea8-b66c-33e1e838cadb" path="/var/lib/kubelet/pods/d26a7825-307c-4ea8-b66c-33e1e838cadb/volumes"
Sep 07 17:19:51.034524 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:51.034485    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:19:55.400777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.400742    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"]
Sep 07 17:19:55.401234 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.401218    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26a7825-307c-4ea8-b66c-33e1e838cadb" containerName="mt-curl-7727-41470f"
Sep 07 17:19:55.401278 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.401237    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26a7825-307c-4ea8-b66c-33e1e838cadb" containerName="mt-curl-7727-41470f"
Sep 07 17:19:55.401326 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.401315    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d26a7825-307c-4ea8-b66c-33e1e838cadb" containerName="mt-curl-7727-41470f"
Sep 07 17:19:55.405140 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.405117    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.407742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.407720    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b36e3a-openshift-default-dockercfg-k49wh\""
Sep 07 17:19:55.414855 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.414822    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"]
Sep 07 17:19:55.439112 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439076    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqj98\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-kube-api-access-nqj98\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439127    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-credential-socket\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439179    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-socket\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439207    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istiod-ca-cert\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439252 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439237    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-podinfo\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439264    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-token\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439373    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-data\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439485 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439403    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-certs\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.439485 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.439425    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-envoy\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.540843 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.540802    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqj98\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-kube-api-access-nqj98\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.540843 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.540847    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-credential-socket\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.540979    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-socket\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541025    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istiod-ca-cert\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541057    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-podinfo\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541090 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541087    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-token\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541298 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541166    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-data\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541298 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541201    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-certs\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541298 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541229    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-envoy\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541298 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541239    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-credential-socket\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541552 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541516    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-certs\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541617 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541558    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-data\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541617 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541601    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-socket\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.541788 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.541769    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istiod-ca-cert\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.543486 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.543464    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-envoy\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.543573 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.543502    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-podinfo\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.553819 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.553793    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-token\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.580839 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.580805    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqj98\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-kube-api-access-nqj98\") pod \"e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") " pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.717174 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.717081    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:55.994883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.994855    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"]
Sep 07 17:19:55.996025 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:19:55.995993    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b05ab10_5651_40b5_95c0_a155cf7d2eae.slice/crio-97c01951019103177c463e5d47fb5d9ae1528ea0aaefa9eec09fa136571c0f33 WatchSource:0}: Error finding container 97c01951019103177c463e5d47fb5d9ae1528ea0aaefa9eec09fa136571c0f33: Status 404 returned error can't find the container with id 97c01951019103177c463e5d47fb5d9ae1528ea0aaefa9eec09fa136571c0f33
Sep 07 17:19:55.998134 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.998097    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:19:55.998220 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.998168    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:19:55.998220 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:55.998199    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:19:56.160015 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:56.159977    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" event={"ID":"3b05ab10-5651-40b5-95c0-a155cf7d2eae","Type":"ContainerStarted","Data":"e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"}
Sep 07 17:19:56.160265 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:56.160032    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" event={"ID":"3b05ab10-5651-40b5-95c0-a155cf7d2eae","Type":"ContainerStarted","Data":"97c01951019103177c463e5d47fb5d9ae1528ea0aaefa9eec09fa136571c0f33"}
Sep 07 17:19:56.182115 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:56.182061    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podStartSLOduration=1.18204471 podStartE2EDuration="1.18204471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:19:56.179116467 +0000 UTC m=+1407.819671295" watchObservedRunningTime="2026-09-07 17:19:56.18204471 +0000 UTC m=+1407.822599499"
Sep 07 17:19:56.717399 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:56.717352    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:57.723609 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:57.723571    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:58.176689 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:58.176620    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:58.177779 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:58.177747    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:19:59.200405 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.200364    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"]
Sep 07 17:19:59.204341 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.204297    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.206786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.206764    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b36e3a-serving-cert\""
Sep 07 17:19:59.214962 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.214806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"]
Sep 07 17:19:59.276720 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.276688    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/eb762cd4-49ba-49a6-b37f-a442ef6d2943-kube-api-access-sbnp7\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.276880 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.276733    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-maas-api-tls\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.276880 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.276763    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb762cd4-49ba-49a6-b37f-a442ef6d2943-openshift-service-ca\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.276880 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.276797    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-metrics-certs\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.377753 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.377717    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/eb762cd4-49ba-49a6-b37f-a442ef6d2943-kube-api-access-sbnp7\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.377932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.377763    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-maas-api-tls\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.377932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.377793    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb762cd4-49ba-49a6-b37f-a442ef6d2943-openshift-service-ca\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.377932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.377822    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-metrics-certs\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.378578 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.378524    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb762cd4-49ba-49a6-b37f-a442ef6d2943-openshift-service-ca\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.380243 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.380214    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-metrics-certs\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.380341 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.380286    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-maas-api-tls\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.385825 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.385802    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/eb762cd4-49ba-49a6-b37f-a442ef6d2943-kube-api-access-sbnp7\") pod \"maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.520061 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.519977    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:19:59.795548 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:19:59.795510    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"]
Sep 07 17:19:59.797815 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:19:59.797785    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb762cd4_49ba_49a6_b37f_a442ef6d2943.slice/crio-1b42daea1a9e7617687d6ed44350192c9d7119ea108479513fd9339b4f7da658 WatchSource:0}: Error finding container 1b42daea1a9e7617687d6ed44350192c9d7119ea108479513fd9339b4f7da658: Status 404 returned error can't find the container with id 1b42daea1a9e7617687d6ed44350192c9d7119ea108479513fd9339b4f7da658
Sep 07 17:20:00.188475 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:00.188432    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td" event={"ID":"eb762cd4-49ba-49a6-b37f-a442ef6d2943","Type":"ContainerStarted","Data":"1b42daea1a9e7617687d6ed44350192c9d7119ea108479513fd9339b4f7da658"}
Sep 07 17:20:01.195366 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:01.195334    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td" event={"ID":"eb762cd4-49ba-49a6-b37f-a442ef6d2943","Type":"ContainerStarted","Data":"91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a"}
Sep 07 17:20:01.195782 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:01.195391    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:20:01.233825 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:01.233768    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td" podStartSLOduration=1.7208157960000001 podStartE2EDuration="2.233750647s" totalImagesPullingTime="512.934851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:01.231289351 +0000 UTC m=+1412.871844165" watchObservedRunningTime="2026-09-07 17:20:01.233750647 +0000 UTC m=+1412.874305504"
Sep 07 17:20:07.206747 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:07.206710    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:20:09.534469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:09.534434    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:20:20.313243 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:20.313209    2545 generic.go:356] "Generic (PLEG): container finished" podID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerID="e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726" exitCode=0
Sep 07 17:20:20.313695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:20.313256    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" event={"ID":"3b05ab10-5651-40b5-95c0-a155cf7d2eae","Type":"ContainerDied","Data":"e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"}
Sep 07 17:20:20.313695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:20.313642    2545 scope.go:117] "RemoveContainer" containerID="e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"
Sep 07 17:20:20.314718 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:20.314684    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:20.314837 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:20.314769    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:20.314837 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:20.314820    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:21.321146 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:21.321067    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" event={"ID":"3b05ab10-5651-40b5-95c0-a155cf7d2eae","Type":"ContainerStarted","Data":"b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5"}
Sep 07 17:20:21.717698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:21.717600    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:20:21.717858 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:21.717830    2545 patch_prober.go:28] interesting pod/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 07 17:20:21.717901 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:21.717876    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 07 17:20:22.718276 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:22.718235    2545 patch_prober.go:28] interesting pod/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 07 17:20:22.718683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:22.718299    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 07 17:20:23.718484 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:23.718443    2545 patch_prober.go:28] interesting pod/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 07 17:20:23.718929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:23.718519    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 07 17:20:24.717470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:24.717428    2545 patch_prober.go:28] interesting pod/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 07 17:20:24.717707 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:24.717503    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 07 17:20:25.718150 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:25.718106    2545 patch_prober.go:28] interesting pod/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 07 17:20:25.718565 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:25.718172    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 07 17:20:26.721622 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:26.721586    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:20:26.722029 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:26.721860    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:20:26.722428 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:26.722408    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:20:36.843646 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:36.843603    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:20:51.453838 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:51.453801    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:20:54.895282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:54.895248    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"]
Sep 07 17:20:54.898246 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:54.898229    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:54.900926 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:54.900902    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:20:54.907129 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:54.907103    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"]
Sep 07 17:20:55.009736 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:55.009694    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/546df091-695f-44cf-9f20-4b8c368143da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b36e3a-htq67\" (UID: \"546df091-695f-44cf-9f20-4b8c368143da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:55.110568 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:55.110501    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/546df091-695f-44cf-9f20-4b8c368143da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b36e3a-htq67\" (UID: \"546df091-695f-44cf-9f20-4b8c368143da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:55.111208 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:55.111185    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/546df091-695f-44cf-9f20-4b8c368143da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b36e3a-htq67\" (UID: \"546df091-695f-44cf-9f20-4b8c368143da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:55.210800 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:55.210700    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:55.493768 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:55.493743    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"]
Sep 07 17:20:55.495758 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:20:55.495727    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546df091_695f_44cf_9f20_4b8c368143da.slice/crio-3b888e89a6c62a8801d638a0dd73c5a8d2d1116e4ea40979f927c83c434c57de WatchSource:0}: Error finding container 3b888e89a6c62a8801d638a0dd73c5a8d2d1116e4ea40979f927c83c434c57de: Status 404 returned error can't find the container with id 3b888e89a6c62a8801d638a0dd73c5a8d2d1116e4ea40979f927c83c434c57de
Sep 07 17:20:55.509872 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:55.509845    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67" event={"ID":"546df091-695f-44cf-9f20-4b8c368143da","Type":"ContainerStarted","Data":"3b888e89a6c62a8801d638a0dd73c5a8d2d1116e4ea40979f927c83c434c57de"}
Sep 07 17:20:56.516760 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:56.516664    2545 generic.go:356] "Generic (PLEG): container finished" podID="546df091-695f-44cf-9f20-4b8c368143da" containerID="56a5f2be3fa24bc0b7e60b0db1061c8f3cdf3b628d5a418b1ff08c133be2cd2a" exitCode=0
Sep 07 17:20:56.517134 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:56.516754    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67" event={"ID":"546df091-695f-44cf-9f20-4b8c368143da","Type":"ContainerDied","Data":"56a5f2be3fa24bc0b7e60b0db1061c8f3cdf3b628d5a418b1ff08c133be2cd2a"}
Sep 07 17:20:57.656025 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:57.655999    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:57.736546 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:57.736500    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/546df091-695f-44cf-9f20-4b8c368143da-maas-api-service-ca\") pod \"546df091-695f-44cf-9f20-4b8c368143da\" (UID: \"546df091-695f-44cf-9f20-4b8c368143da\") "
Sep 07 17:20:57.736929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:57.736905    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/546df091-695f-44cf-9f20-4b8c368143da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "546df091-695f-44cf-9f20-4b8c368143da" (UID: "546df091-695f-44cf-9f20-4b8c368143da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:20:57.838290 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:57.838258    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/546df091-695f-44cf-9f20-4b8c368143da-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:20:58.528901 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:58.528870    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"
Sep 07 17:20:58.529086 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:58.528913    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67" event={"ID":"546df091-695f-44cf-9f20-4b8c368143da","Type":"ContainerDied","Data":"3b888e89a6c62a8801d638a0dd73c5a8d2d1116e4ea40979f927c83c434c57de"}
Sep 07 17:20:58.529086 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:20:58.528962    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b888e89a6c62a8801d638a0dd73c5a8d2d1116e4ea40979f927c83c434c57de"
Sep 07 17:21:10.498826 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.498788    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"]
Sep 07 17:21:10.499318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.499016    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td" podUID="eb762cd4-49ba-49a6-b37f-a442ef6d2943" containerName="maas-api" containerID="cri-o://91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a" gracePeriod=30
Sep 07 17:21:10.755883 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.755819    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:21:10.760857 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.760829    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-maas-api-tls\") pod \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") "
Sep 07 17:21:10.761005 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.760892    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb762cd4-49ba-49a6-b37f-a442ef6d2943-openshift-service-ca\") pod \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") "
Sep 07 17:21:10.761005 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.760944    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/eb762cd4-49ba-49a6-b37f-a442ef6d2943-kube-api-access-sbnp7\") pod \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") "
Sep 07 17:21:10.761005 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.760972    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-metrics-certs\") pod \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\" (UID: \"eb762cd4-49ba-49a6-b37f-a442ef6d2943\") "
Sep 07 17:21:10.761334 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.761304    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb762cd4-49ba-49a6-b37f-a442ef6d2943-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb762cd4-49ba-49a6-b37f-a442ef6d2943" (UID: "eb762cd4-49ba-49a6-b37f-a442ef6d2943"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:10.763355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.763266    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb762cd4-49ba-49a6-b37f-a442ef6d2943" (UID: "eb762cd4-49ba-49a6-b37f-a442ef6d2943"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:21:10.763743 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.763710    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb762cd4-49ba-49a6-b37f-a442ef6d2943-kube-api-access-sbnp7" (OuterVolumeSpecName: "kube-api-access-sbnp7") pod "eb762cd4-49ba-49a6-b37f-a442ef6d2943" (UID: "eb762cd4-49ba-49a6-b37f-a442ef6d2943"). InnerVolumeSpecName "kube-api-access-sbnp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:10.763937 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.763914    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eb762cd4-49ba-49a6-b37f-a442ef6d2943" (UID: "eb762cd4-49ba-49a6-b37f-a442ef6d2943"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:21:10.812677 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.812637    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"]
Sep 07 17:21:10.814895 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.814869    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b36e3a-htq67"]
Sep 07 17:21:10.862391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.862348    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-maas-api-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:10.862391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.862382    2545 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb762cd4-49ba-49a6-b37f-a442ef6d2943-openshift-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:10.862391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.862391    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/eb762cd4-49ba-49a6-b37f-a442ef6d2943-kube-api-access-sbnp7\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:10.862391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.862402    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb762cd4-49ba-49a6-b37f-a442ef6d2943-metrics-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:10.889337 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:10.889301    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546df091-695f-44cf-9f20-4b8c368143da" path="/var/lib/kubelet/pods/546df091-695f-44cf-9f20-4b8c368143da/volumes"
Sep 07 17:21:11.603007 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.602964    2545 generic.go:356] "Generic (PLEG): container finished" podID="eb762cd4-49ba-49a6-b37f-a442ef6d2943" containerID="91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a" exitCode=0
Sep 07 17:21:11.603417 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.603014    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"
Sep 07 17:21:11.603417 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.603038    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td" event={"ID":"eb762cd4-49ba-49a6-b37f-a442ef6d2943","Type":"ContainerDied","Data":"91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a"}
Sep 07 17:21:11.603417 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.603121    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td" event={"ID":"eb762cd4-49ba-49a6-b37f-a442ef6d2943","Type":"ContainerDied","Data":"1b42daea1a9e7617687d6ed44350192c9d7119ea108479513fd9339b4f7da658"}
Sep 07 17:21:11.603417 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.603146    2545 scope.go:117] "RemoveContainer" containerID="91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a"
Sep 07 17:21:11.612653 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.612625    2545 scope.go:117] "RemoveContainer" containerID="91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a"
Sep 07 17:21:11.613005 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:21:11.612988    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a\": container with ID starting with 91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a not found: ID does not exist" containerID="91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a"
Sep 07 17:21:11.613072 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.613016    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a"} err="failed to get container status \"91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a\": rpc error: code = NotFound desc = could not find container \"91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a\": container with ID starting with 91c1ff3b670f877e0222eafc7652e157becf31a184e0b72980007a63db90603a not found: ID does not exist"
Sep 07 17:21:11.623229 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.622724    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"]
Sep 07 17:21:11.629136 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:11.629102    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b36e3a-546fc4d5b-x29td"]
Sep 07 17:21:12.888696 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:12.888665    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb762cd4-49ba-49a6-b37f-a442ef6d2943" path="/var/lib/kubelet/pods/eb762cd4-49ba-49a6-b37f-a442ef6d2943/volumes"
Sep 07 17:21:15.435399 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:15.435349    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:21:17.976108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:17.976072    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"]
Sep 07 17:21:17.976498 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:17.976366    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy" containerID="cri-o://b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5" gracePeriod=30
Sep 07 17:21:18.342895 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.342846    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"]
Sep 07 17:21:18.343288 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.343269    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546df091-695f-44cf-9f20-4b8c368143da" containerName="revoke-keys"
Sep 07 17:21:18.343383 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.343291    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="546df091-695f-44cf-9f20-4b8c368143da" containerName="revoke-keys"
Sep 07 17:21:18.343383 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.343307    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb762cd4-49ba-49a6-b37f-a442ef6d2943" containerName="maas-api"
Sep 07 17:21:18.343383 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.343314    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb762cd4-49ba-49a6-b37f-a442ef6d2943" containerName="maas-api"
Sep 07 17:21:18.343577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.343417    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb762cd4-49ba-49a6-b37f-a442ef6d2943" containerName="maas-api"
Sep 07 17:21:18.343577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.343431    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="546df091-695f-44cf-9f20-4b8c368143da" containerName="revoke-keys"
Sep 07 17:21:18.347790 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.347766    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:18.350386 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.350360    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:21:18.357522 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.357492    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"]
Sep 07 17:21:18.430639 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.430601    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/daa3c4e8-6830-484f-abed-60f9d7df8b5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-611042-bh72l\" (UID: \"daa3c4e8-6830-484f-abed-60f9d7df8b5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:18.531675 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.531634    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/daa3c4e8-6830-484f-abed-60f9d7df8b5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-611042-bh72l\" (UID: \"daa3c4e8-6830-484f-abed-60f9d7df8b5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:18.532336 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.532308    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/daa3c4e8-6830-484f-abed-60f9d7df8b5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-611042-bh72l\" (UID: \"daa3c4e8-6830-484f-abed-60f9d7df8b5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:18.659139 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.659021    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:18.933957 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:18.933927    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"]
Sep 07 17:21:18.935766 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:21:18.935738    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa3c4e8_6830_484f_abed_60f9d7df8b5c.slice/crio-2c566ff1918dd6eb0c354baa81e45192ff5b4cd1678c655e168491471ea36f6d WatchSource:0}: Error finding container 2c566ff1918dd6eb0c354baa81e45192ff5b4cd1678c655e168491471ea36f6d: Status 404 returned error can't find the container with id 2c566ff1918dd6eb0c354baa81e45192ff5b4cd1678c655e168491471ea36f6d
Sep 07 17:21:19.652398 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:19.652358    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l" event={"ID":"daa3c4e8-6830-484f-abed-60f9d7df8b5c","Type":"ContainerStarted","Data":"d9fdf815f4f8666fb1e4553de74b37fea8ef6b20a9235a43e470a70622e09474"}
Sep 07 17:21:19.652799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:19.652464    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l" event={"ID":"daa3c4e8-6830-484f-abed-60f9d7df8b5c","Type":"ContainerStarted","Data":"2c566ff1918dd6eb0c354baa81e45192ff5b4cd1678c655e168491471ea36f6d"}
Sep 07 17:21:19.669910 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:19.669855    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l" podStartSLOduration=1.669836672 podStartE2EDuration="1.669836672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:21:19.667076141 +0000 UTC m=+1491.307630956" watchObservedRunningTime="2026-09-07 17:21:19.669836672 +0000 UTC m=+1491.310391488"
Sep 07 17:21:20.659826 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:20.659786    2545 generic.go:356] "Generic (PLEG): container finished" podID="daa3c4e8-6830-484f-abed-60f9d7df8b5c" containerID="d9fdf815f4f8666fb1e4553de74b37fea8ef6b20a9235a43e470a70622e09474" exitCode=0
Sep 07 17:21:20.660273 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:20.659870    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l" event={"ID":"daa3c4e8-6830-484f-abed-60f9d7df8b5c","Type":"ContainerDied","Data":"d9fdf815f4f8666fb1e4553de74b37fea8ef6b20a9235a43e470a70622e09474"}
Sep 07 17:21:21.798504 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:21.798473    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:21.863799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:21.863756    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/daa3c4e8-6830-484f-abed-60f9d7df8b5c-maas-api-service-ca\") pod \"daa3c4e8-6830-484f-abed-60f9d7df8b5c\" (UID: \"daa3c4e8-6830-484f-abed-60f9d7df8b5c\") "
Sep 07 17:21:21.864128 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:21.864105    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daa3c4e8-6830-484f-abed-60f9d7df8b5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "daa3c4e8-6830-484f-abed-60f9d7df8b5c" (UID: "daa3c4e8-6830-484f-abed-60f9d7df8b5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:21.964965 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:21.964871    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/daa3c4e8-6830-484f-abed-60f9d7df8b5c-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:22.671887 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:22.671858    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"
Sep 07 17:21:22.672060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:22.671856    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l" event={"ID":"daa3c4e8-6830-484f-abed-60f9d7df8b5c","Type":"ContainerDied","Data":"2c566ff1918dd6eb0c354baa81e45192ff5b4cd1678c655e168491471ea36f6d"}
Sep 07 17:21:22.672060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:22.671983    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c566ff1918dd6eb0c354baa81e45192ff5b4cd1678c655e168491471ea36f6d"
Sep 07 17:21:23.222086 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.222058    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:21:23.275742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275649    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-data\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.275742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275714    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-podinfo\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.275742 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275741    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-token\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275757    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-socket\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275781    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqj98\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-kube-api-access-nqj98\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275825    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-envoy\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275881    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istiod-ca-cert\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275948    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-credential-socket\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276057 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275997    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-certs\") pod \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\" (UID: \"3b05ab10-5651-40b5-95c0-a155cf7d2eae\") "
Sep 07 17:21:23.276379 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.275992    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:23.276379 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.276116    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:23.276379 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.276368    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:23.276522 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.276483    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:23.276601 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.276576    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:23.278296 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.278264    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:23.278296 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.278270    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:23.278604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.278577    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-kube-api-access-nqj98" (OuterVolumeSpecName: "kube-api-access-nqj98") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "kube-api-access-nqj98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:23.278604 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.278580    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b05ab10-5651-40b5-95c0-a155cf7d2eae" (UID: "3b05ab10-5651-40b5-95c0-a155cf7d2eae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:21:23.377764 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377715    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.377764 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377755    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.377764 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377768    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.378027 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377779    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.378027 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377791    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.378027 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377802    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.378027 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377813    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqj98\" (UniqueName: \"kubernetes.io/projected/3b05ab10-5651-40b5-95c0-a155cf7d2eae-kube-api-access-nqj98\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.378027 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377824    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.378027 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.377837    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b05ab10-5651-40b5-95c0-a155cf7d2eae-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:23.683817 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.683780    2545 generic.go:356] "Generic (PLEG): container finished" podID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerID="b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5" exitCode=0
Sep 07 17:21:23.684009 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.683840    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" event={"ID":"3b05ab10-5651-40b5-95c0-a155cf7d2eae","Type":"ContainerDied","Data":"b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5"}
Sep 07 17:21:23.684009 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.683859    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"
Sep 07 17:21:23.684009 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.683925    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t" event={"ID":"3b05ab10-5651-40b5-95c0-a155cf7d2eae","Type":"ContainerDied","Data":"97c01951019103177c463e5d47fb5d9ae1528ea0aaefa9eec09fa136571c0f33"}
Sep 07 17:21:23.684009 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.683946    2545 scope.go:117] "RemoveContainer" containerID="b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5"
Sep 07 17:21:23.693505 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.693484    2545 scope.go:117] "RemoveContainer" containerID="e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"
Sep 07 17:21:23.702162 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.702142    2545 scope.go:117] "RemoveContainer" containerID="b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5"
Sep 07 17:21:23.702482 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:21:23.702459    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5\": container with ID starting with b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5 not found: ID does not exist" containerID="b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5"
Sep 07 17:21:23.702577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.702495    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5"} err="failed to get container status \"b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5\": rpc error: code = NotFound desc = could not find container \"b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5\": container with ID starting with b40fb51eb401a5a9e6091ee19732a675ec0857af04b3ed7f98cbe7e37d621ed5 not found: ID does not exist"
Sep 07 17:21:23.702577 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.702523    2545 scope.go:117] "RemoveContainer" containerID="e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"
Sep 07 17:21:23.702949 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:21:23.702929    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726\": container with ID starting with e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726 not found: ID does not exist" containerID="e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"
Sep 07 17:21:23.703009 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.702955    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726"} err="failed to get container status \"e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726\": rpc error: code = NotFound desc = could not find container \"e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726\": container with ID starting with e3393ccf82fa1e79ba008414557d0fec41ce614aee3222d0e8dc10147629d726 not found: ID does not exist"
Sep 07 17:21:23.708713 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.708688    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"]
Sep 07 17:21:23.713407 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:23.713366    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t"]
Sep 07 17:21:24.889078 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:24.889039    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" path="/var/lib/kubelet/pods/3b05ab10-5651-40b5-95c0-a155cf7d2eae/volumes"
Sep 07 17:21:29.150463 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:29.150424    2545 scope.go:117] "RemoveContainer" containerID="03bfa478ec875a78a5e6c0a9e634c8a323ab8e5f2b997bf3a7ad8fb2a01d17b0"
Sep 07 17:21:31.842845 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:31.842808    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:21:34.345335 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:34.345290    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"]
Sep 07 17:21:34.349559 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:34.349519    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-611042-bh72l"]
Sep 07 17:21:34.889929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:34.889891    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa3c4e8-6830-484f-abed-60f9d7df8b5c" path="/var/lib/kubelet/pods/daa3c4e8-6830-484f-abed-60f9d7df8b5c/volumes"
Sep 07 17:21:41.646896 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.646856    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"]
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647200    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647211    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647220    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647225    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647241    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa3c4e8-6830-484f-abed-60f9d7df8b5c" containerName="revoke-keys"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647247    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa3c4e8-6830-484f-abed-60f9d7df8b5c" containerName="revoke-keys"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647301    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647310    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b05ab10-5651-40b5-95c0-a155cf7d2eae" containerName="istio-proxy"
Sep 07 17:21:41.647356 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.647318    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa3c4e8-6830-484f-abed-60f9d7df8b5c" containerName="revoke-keys"
Sep 07 17:21:41.651744 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.651723    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:41.654614 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.654564    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:21:41.659459 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.659052    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"]
Sep 07 17:21:41.744877 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.744835    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f282e297-84cb-4e70-b7c1-4d60e381ca54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7\" (UID: \"f282e297-84cb-4e70-b7c1-4d60e381ca54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:41.846446 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.846393    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f282e297-84cb-4e70-b7c1-4d60e381ca54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7\" (UID: \"f282e297-84cb-4e70-b7c1-4d60e381ca54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:41.847075 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.847053    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f282e297-84cb-4e70-b7c1-4d60e381ca54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7\" (UID: \"f282e297-84cb-4e70-b7c1-4d60e381ca54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:41.964465 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:41.964371    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:42.246117 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:42.246053    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"]
Sep 07 17:21:42.248678 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:21:42.248649    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf282e297_84cb_4e70_b7c1_4d60e381ca54.slice/crio-38a80ec0c6c2a572b0c1b5d11c11f39454f047e770863f8e25fcdaafe9734907 WatchSource:0}: Error finding container 38a80ec0c6c2a572b0c1b5d11c11f39454f047e770863f8e25fcdaafe9734907: Status 404 returned error can't find the container with id 38a80ec0c6c2a572b0c1b5d11c11f39454f047e770863f8e25fcdaafe9734907
Sep 07 17:21:42.792300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:42.792263    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7" event={"ID":"f282e297-84cb-4e70-b7c1-4d60e381ca54","Type":"ContainerStarted","Data":"791255da0659e43b16e34f08968ebf205b9e3d1841fb3800a7303a4ef8281076"}
Sep 07 17:21:42.792729 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:42.792318    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7" event={"ID":"f282e297-84cb-4e70-b7c1-4d60e381ca54","Type":"ContainerStarted","Data":"38a80ec0c6c2a572b0c1b5d11c11f39454f047e770863f8e25fcdaafe9734907"}
Sep 07 17:21:42.808970 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:42.808864    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7" podStartSLOduration=1.808847773 podStartE2EDuration="1.808847773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:21:42.807093977 +0000 UTC m=+1514.447648775" watchObservedRunningTime="2026-09-07 17:21:42.808847773 +0000 UTC m=+1514.449402661"
Sep 07 17:21:43.799323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:43.799285    2545 generic.go:356] "Generic (PLEG): container finished" podID="f282e297-84cb-4e70-b7c1-4d60e381ca54" containerID="791255da0659e43b16e34f08968ebf205b9e3d1841fb3800a7303a4ef8281076" exitCode=0
Sep 07 17:21:43.799743 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:43.799374    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7" event={"ID":"f282e297-84cb-4e70-b7c1-4d60e381ca54","Type":"ContainerDied","Data":"791255da0659e43b16e34f08968ebf205b9e3d1841fb3800a7303a4ef8281076"}
Sep 07 17:21:44.936668 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:44.936637    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:45.078608 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:45.078569    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f282e297-84cb-4e70-b7c1-4d60e381ca54-maas-api-service-ca\") pod \"f282e297-84cb-4e70-b7c1-4d60e381ca54\" (UID: \"f282e297-84cb-4e70-b7c1-4d60e381ca54\") "
Sep 07 17:21:45.078932 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:45.078911    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f282e297-84cb-4e70-b7c1-4d60e381ca54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f282e297-84cb-4e70-b7c1-4d60e381ca54" (UID: "f282e297-84cb-4e70-b7c1-4d60e381ca54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:45.179598 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:45.179519    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f282e297-84cb-4e70-b7c1-4d60e381ca54-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:21:45.810845 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:45.810811    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7" event={"ID":"f282e297-84cb-4e70-b7c1-4d60e381ca54","Type":"ContainerDied","Data":"38a80ec0c6c2a572b0c1b5d11c11f39454f047e770863f8e25fcdaafe9734907"}
Sep 07 17:21:45.811022 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:45.810860    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38a80ec0c6c2a572b0c1b5d11c11f39454f047e770863f8e25fcdaafe9734907"
Sep 07 17:21:45.811022 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:45.810820    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"
Sep 07 17:21:48.742695 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:48.742657    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:21:52.500292 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:52.500192    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"]
Sep 07 17:21:52.502686 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:52.502658    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-202015-b5gk7"]
Sep 07 17:21:52.888605 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:52.888568    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f282e297-84cb-4e70-b7c1-4d60e381ca54" path="/var/lib/kubelet/pods/f282e297-84cb-4e70-b7c1-4d60e381ca54/volumes"
Sep 07 17:21:59.760337 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:59.760301    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"]
Sep 07 17:21:59.760850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:21:59.760555    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" containerID="cri-o://481be327bd767f6ebaccc9a323d62d949dcaa33dff50e3a8ba13827874894dab" gracePeriod=30
Sep 07 17:22:00.079564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.079518    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"]
Sep 07 17:22:00.079875 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.079862    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f282e297-84cb-4e70-b7c1-4d60e381ca54" containerName="revoke-keys"
Sep 07 17:22:00.079933 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.079876    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f282e297-84cb-4e70-b7c1-4d60e381ca54" containerName="revoke-keys"
Sep 07 17:22:00.079970 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.079961    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="f282e297-84cb-4e70-b7c1-4d60e381ca54" containerName="revoke-keys"
Sep 07 17:22:00.082819 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.082799    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:00.085485 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.085460    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:22:00.096916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.096885    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"]
Sep 07 17:22:00.110624 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.110586    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac298574-501d-4731-ab99-363d9cc0f2e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n\" (UID: \"ac298574-501d-4731-ab99-363d9cc0f2e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:00.211717 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.211674    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac298574-501d-4731-ab99-363d9cc0f2e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n\" (UID: \"ac298574-501d-4731-ab99-363d9cc0f2e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:00.212330 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.212308    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac298574-501d-4731-ab99-363d9cc0f2e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n\" (UID: \"ac298574-501d-4731-ab99-363d9cc0f2e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:00.396920 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.396811    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:00.679333 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.679302    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"]
Sep 07 17:22:00.681161 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:22:00.681136    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac298574_501d_4731_ab99_363d9cc0f2e9.slice/crio-72919ab0fa3dd075b9041b666231cc088f79c1def3ac1334c4c213daa84659e5 WatchSource:0}: Error finding container 72919ab0fa3dd075b9041b666231cc088f79c1def3ac1334c4c213daa84659e5: Status 404 returned error can't find the container with id 72919ab0fa3dd075b9041b666231cc088f79c1def3ac1334c4c213daa84659e5
Sep 07 17:22:00.894964 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.894927    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n" event={"ID":"ac298574-501d-4731-ab99-363d9cc0f2e9","Type":"ContainerStarted","Data":"4b1e81554bc770e15b4f134b18237cd50c64e900cb0e7d02c80b26f8fce21982"}
Sep 07 17:22:00.895375 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.894985    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n" event={"ID":"ac298574-501d-4731-ab99-363d9cc0f2e9","Type":"ContainerStarted","Data":"72919ab0fa3dd075b9041b666231cc088f79c1def3ac1334c4c213daa84659e5"}
Sep 07 17:22:00.916879 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:00.916813    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n" podStartSLOduration=0.916795062 podStartE2EDuration="916.795062ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:00.916518773 +0000 UTC m=+1532.557073569" watchObservedRunningTime="2026-09-07 17:22:00.916795062 +0000 UTC m=+1532.557349855"
Sep 07 17:22:01.901987 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:01.901948    2545 generic.go:356] "Generic (PLEG): container finished" podID="ac298574-501d-4731-ab99-363d9cc0f2e9" containerID="4b1e81554bc770e15b4f134b18237cd50c64e900cb0e7d02c80b26f8fce21982" exitCode=0
Sep 07 17:22:01.902372 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:01.902006    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n" event={"ID":"ac298574-501d-4731-ab99-363d9cc0f2e9","Type":"ContainerDied","Data":"4b1e81554bc770e15b4f134b18237cd50c64e900cb0e7d02c80b26f8fce21982"}
Sep 07 17:22:02.151597 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:02.151555    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:22:02.151772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:02.151617    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:22:03.043992 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.043964    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:03.144414 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.144372    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac298574-501d-4731-ab99-363d9cc0f2e9-maas-api-service-ca\") pod \"ac298574-501d-4731-ab99-363d9cc0f2e9\" (UID: \"ac298574-501d-4731-ab99-363d9cc0f2e9\") "
Sep 07 17:22:03.144799 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.144765    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac298574-501d-4731-ab99-363d9cc0f2e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac298574-501d-4731-ab99-363d9cc0f2e9" (UID: "ac298574-501d-4731-ab99-363d9cc0f2e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:22:03.245893 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.245800    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac298574-501d-4731-ab99-363d9cc0f2e9-maas-api-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:03.919727 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.919697    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"
Sep 07 17:22:03.919908 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.919699    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n" event={"ID":"ac298574-501d-4731-ab99-363d9cc0f2e9","Type":"ContainerDied","Data":"72919ab0fa3dd075b9041b666231cc088f79c1def3ac1334c4c213daa84659e5"}
Sep 07 17:22:03.919908 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:03.919829    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72919ab0fa3dd075b9041b666231cc088f79c1def3ac1334c4c213daa84659e5"
Sep 07 17:22:04.636729 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:04.636673    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:22:04.927532 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:04.927437    2545 generic.go:356] "Generic (PLEG): container finished" podID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerID="481be327bd767f6ebaccc9a323d62d949dcaa33dff50e3a8ba13827874894dab" exitCode=0
Sep 07 17:22:04.927532 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:04.927511    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" event={"ID":"dd0a076b-4774-4c46-9d7c-daa2d0394e05","Type":"ContainerDied","Data":"481be327bd767f6ebaccc9a323d62d949dcaa33dff50e3a8ba13827874894dab"}
Sep 07 17:22:04.927777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:04.927610    2545 scope.go:117] "RemoveContainer" containerID="2c8f57e82b3e337d9ed69c72147ad799ad3aa7af42242b5103006961068c7cdd"
Sep 07 17:22:05.018628 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.018597    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:22:05.062945 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.062906    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-token\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063126 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.062958    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-certs\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063126 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.062996    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-envoy\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063126 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063026    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-data\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063126 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063055    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istiod-ca-cert\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063126 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063081    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-credential-socket\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063162    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-podinfo\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063187    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-socket\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063249    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx7ww\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-kube-api-access-qx7ww\") pod \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\" (UID: \"dd0a076b-4774-4c46-9d7c-daa2d0394e05\") "
Sep 07 17:22:05.063440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063293    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:05.063440 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063316    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:05.063731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063470    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:05.063731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063508    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:05.063731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063578    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.063731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063596    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.063731 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063605    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.063969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.063783    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:22:05.065575 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.065530    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-kube-api-access-qx7ww" (OuterVolumeSpecName: "kube-api-access-qx7ww") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "kube-api-access-qx7ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:05.065730 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.065708    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:05.065823 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.065799    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:22:05.066012 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.065995    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd0a076b-4774-4c46-9d7c-daa2d0394e05" (UID: "dd0a076b-4774-4c46-9d7c-daa2d0394e05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:05.164359 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.164295    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx7ww\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-kube-api-access-qx7ww\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.164359 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.164359    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.164359 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.164374    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.164744 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.164387    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.164744 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.164400    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0a076b-4774-4c46-9d7c-daa2d0394e05-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.164744 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.164413    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0a076b-4774-4c46-9d7c-daa2d0394e05-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:05.933951 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.933921    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"
Sep 07 17:22:05.933951 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.933944    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc" event={"ID":"dd0a076b-4774-4c46-9d7c-daa2d0394e05","Type":"ContainerDied","Data":"392c3bf5095710e5567b1e5a4f05296ae38f03da77eea40302c150ed3ad0220c"}
Sep 07 17:22:05.934414 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.933996    2545 scope.go:117] "RemoveContainer" containerID="481be327bd767f6ebaccc9a323d62d949dcaa33dff50e3a8ba13827874894dab"
Sep 07 17:22:05.957416 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.957378    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"]
Sep 07 17:22:05.961188 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:05.961164    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc"]
Sep 07 17:22:06.888276 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:06.888242    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" path="/var/lib/kubelet/pods/dd0a076b-4774-4c46-9d7c-daa2d0394e05/volumes"
Sep 07 17:22:11.274506 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:11.274466    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"]
Sep 07 17:22:11.282171 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:11.282141    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-43ab35-mfv6n"]
Sep 07 17:22:12.888792 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:12.888755    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac298574-501d-4731-ab99-363d9cc0f2e9" path="/var/lib/kubelet/pods/ac298574-501d-4731-ab99-363d9cc0f2e9/volumes"
Sep 07 17:22:16.832948 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:16.832902    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:22:18.269807 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:18.269769    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"]
Sep 07 17:22:18.270269 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:18.269992    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" containerID="cri-o://f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b" gracePeriod=30
Sep 07 17:22:18.432632 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:18.432591    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:22:18.432794 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:18.432667    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:22:23.522239 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.522209    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:22:23.626354 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626316    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-socket\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626390    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7txg\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-kube-api-access-h7txg\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626433    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-credential-socket\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626464    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-envoy\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626495    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-data\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626522    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561d3e64-636e-485b-b107-ecc6ff51f210-istiod-ca-cert\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626580    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-istio-token\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626647    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561d3e64-636e-485b-b107-ecc6ff51f210-istio-podinfo\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626682    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-certs\") pod \"561d3e64-636e-485b-b107-ecc6ff51f210\" (UID: \"561d3e64-636e-485b-b107-ecc6ff51f210\") "
Sep 07 17:22:23.626924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626688    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:23.626924 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626844    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:23.627132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626959    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561d3e64-636e-485b-b107-ecc6ff51f210-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:22:23.627132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.626987    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.627132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.627007    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.627132 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.627087    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:23.627344 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.627249    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-data" (OuterVolumeSpecName: "istio-data") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:23.628735 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.628708    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-istio-token" (OuterVolumeSpecName: "istio-token") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:23.628824 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.628778    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-kube-api-access-h7txg" (OuterVolumeSpecName: "kube-api-access-h7txg") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "kube-api-access-h7txg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:23.629079 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.629052    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:23.629079 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.629068    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/561d3e64-636e-485b-b107-ecc6ff51f210-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "561d3e64-636e-485b-b107-ecc6ff51f210" (UID: "561d3e64-636e-485b-b107-ecc6ff51f210"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:22:23.728138 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728092    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7txg\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-kube-api-access-h7txg\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.728138 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728129    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.728138 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728137    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.728138 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728148    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561d3e64-636e-485b-b107-ecc6ff51f210-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.728415 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728156    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561d3e64-636e-485b-b107-ecc6ff51f210-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.728415 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728163    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561d3e64-636e-485b-b107-ecc6ff51f210-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:23.728415 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:23.728172    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561d3e64-636e-485b-b107-ecc6ff51f210-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:22:24.036124 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.036035    2545 generic.go:356] "Generic (PLEG): container finished" podID="561d3e64-636e-485b-b107-ecc6ff51f210" containerID="f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b" exitCode=0
Sep 07 17:22:24.036124 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.036083    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"
Sep 07 17:22:24.036124 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.036111    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" event={"ID":"561d3e64-636e-485b-b107-ecc6ff51f210","Type":"ContainerDied","Data":"f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b"}
Sep 07 17:22:24.036391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.036174    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv" event={"ID":"561d3e64-636e-485b-b107-ecc6ff51f210","Type":"ContainerDied","Data":"ce65193e5a59ce89608e72b75f1d0967b97be8a7a6f7e35a36cf83a3987599d9"}
Sep 07 17:22:24.036391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.036203    2545 scope.go:117] "RemoveContainer" containerID="f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b"
Sep 07 17:22:24.046109 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.046083    2545 scope.go:117] "RemoveContainer" containerID="cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"
Sep 07 17:22:24.054424 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.054404    2545 scope.go:117] "RemoveContainer" containerID="f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b"
Sep 07 17:22:24.054725 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:22:24.054704    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b\": container with ID starting with f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b not found: ID does not exist" containerID="f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b"
Sep 07 17:22:24.054788 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.054736    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b"} err="failed to get container status \"f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b\": rpc error: code = NotFound desc = could not find container \"f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b\": container with ID starting with f4b850acc7d5d0bcecf989328c5e1849e35322c08826af499c8d45045ba35e4b not found: ID does not exist"
Sep 07 17:22:24.054788 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.054757    2545 scope.go:117] "RemoveContainer" containerID="cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"
Sep 07 17:22:24.054999 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:22:24.054977    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544\": container with ID starting with cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544 not found: ID does not exist" containerID="cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"
Sep 07 17:22:24.055055 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.055010    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544"} err="failed to get container status \"cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544\": rpc error: code = NotFound desc = could not find container \"cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544\": container with ID starting with cd036c1e21666d2815e48c7cf81d19dc40c5af14592d421bf042dee330a5d544 not found: ID does not exist"
Sep 07 17:22:24.059600 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.059577    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"]
Sep 07 17:22:24.063687 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.063667    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv"]
Sep 07 17:22:24.457476 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457445    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"]
Sep 07 17:22:24.457822 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457806    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy"
Sep 07 17:22:24.457822 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457823    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457834    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457839    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457859    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457865    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457871    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457876    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457883    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac298574-501d-4731-ab99-363d9cc0f2e9" containerName="revoke-keys"
Sep 07 17:22:24.457938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457888    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac298574-501d-4731-ab99-363d9cc0f2e9" containerName="revoke-keys"
Sep 07 17:22:24.458176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457951    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy"
Sep 07 17:22:24.458176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457961    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy"
Sep 07 17:22:24.458176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457967    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" containerName="istio-proxy"
Sep 07 17:22:24.458176 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.457973    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac298574-501d-4731-ab99-363d9cc0f2e9" containerName="revoke-keys"
Sep 07 17:22:24.462704 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.462680    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.465315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.465291    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-fac82d-openshift-default-dockercfg-b7dlt\""
Sep 07 17:22:24.474558 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.474510    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"]
Sep 07 17:22:24.535169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535132    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-socket\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535172    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6371d90e-f761-42e6-b113-c8fe71247cfa-istiod-ca-cert\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535197    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgbh5\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-kube-api-access-dgbh5\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535265    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-envoy\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535287    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-podinfo\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535305    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-credential-socket\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535318    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-data\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535338    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-certs\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.535714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.535459    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-token\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636186 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636140    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-socket\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636186 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636186    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6371d90e-f761-42e6-b113-c8fe71247cfa-istiod-ca-cert\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636222    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgbh5\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-kube-api-access-dgbh5\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636274    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-envoy\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636308    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-podinfo\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636334    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-credential-socket\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636356    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-data\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636386    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-certs\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636449    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-token\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636908 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636883    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-certs\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.636975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.636884    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-credential-socket\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.637088 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.637063    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-data\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.637232 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.637107    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6371d90e-f761-42e6-b113-c8fe71247cfa-istiod-ca-cert\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.637297 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.637225    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-socket\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.638644 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.638616    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-envoy\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.638886 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.638870    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-podinfo\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.645258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.645231    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgbh5\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-kube-api-access-dgbh5\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.648630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.648604    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-token\") pod \"e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") " pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.774400 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.774287    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:24.888125 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:24.888091    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561d3e64-636e-485b-b107-ecc6ff51f210" path="/var/lib/kubelet/pods/561d3e64-636e-485b-b107-ecc6ff51f210/volumes"
Sep 07 17:22:25.063502 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:25.063475    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"]
Sep 07 17:22:25.065296 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:22:25.065265    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6371d90e_f761_42e6_b113_c8fe71247cfa.slice/crio-93c5aedab629c681f7634a7cace8e6c7dca5e09ab22f707e5b3622b30d2cf876 WatchSource:0}: Error finding container 93c5aedab629c681f7634a7cace8e6c7dca5e09ab22f707e5b3622b30d2cf876: Status 404 returned error can't find the container with id 93c5aedab629c681f7634a7cace8e6c7dca5e09ab22f707e5b3622b30d2cf876
Sep 07 17:22:25.067653 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:25.067619    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:25.067744 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:25.067701    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:25.067802 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:25.067751    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:26.049912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:26.049869    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" event={"ID":"6371d90e-f761-42e6-b113-c8fe71247cfa","Type":"ContainerStarted","Data":"652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"}
Sep 07 17:22:26.050323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:26.049936    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" event={"ID":"6371d90e-f761-42e6-b113-c8fe71247cfa","Type":"ContainerStarted","Data":"93c5aedab629c681f7634a7cace8e6c7dca5e09ab22f707e5b3622b30d2cf876"}
Sep 07 17:22:26.076972 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:26.076916    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podStartSLOduration=2.07689951 podStartE2EDuration="2.07689951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:26.072812446 +0000 UTC m=+1557.713367242" watchObservedRunningTime="2026-09-07 17:22:26.07689951 +0000 UTC m=+1557.717454305"
Sep 07 17:22:26.775269 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:26.775221    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:26.780513 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:26.780483    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:27.055491 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:27.055401    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:27.056418 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:27.056397    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:29.120109 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.120068    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"]
Sep 07 17:22:29.120754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.120720    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0a076b-4774-4c46-9d7c-daa2d0394e05" containerName="istio-proxy"
Sep 07 17:22:29.123518 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.123499    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.126065 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.126036    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-fac82d-serving-cert\""
Sep 07 17:22:29.135142 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.134934    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"]
Sep 07 17:22:29.277716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.277680    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.277716 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.277717    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-metrics-certs\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.277943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.277803    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028e3ae6-35b2-486b-a0cb-faa76e8e9009-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.277943 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.277844    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wg6z\" (UniqueName: \"kubernetes.io/projected/028e3ae6-35b2-486b-a0cb-faa76e8e9009-kube-api-access-9wg6z\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.378759 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.378652    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.378759 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.378712    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-metrics-certs\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.379010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.378788    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028e3ae6-35b2-486b-a0cb-faa76e8e9009-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.379010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.378828    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wg6z\" (UniqueName: \"kubernetes.io/projected/028e3ae6-35b2-486b-a0cb-faa76e8e9009-kube-api-access-9wg6z\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.379517 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.379490    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028e3ae6-35b2-486b-a0cb-faa76e8e9009-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.381415 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.381384    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.381512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.381427    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-metrics-certs\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.387239 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.387211    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wg6z\" (UniqueName: \"kubernetes.io/projected/028e3ae6-35b2-486b-a0cb-faa76e8e9009-kube-api-access-9wg6z\") pod \"maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.438779 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.438740    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:29.715030 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:29.714998    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"]
Sep 07 17:22:29.715827 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:22:29.715795    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028e3ae6_35b2_486b_a0cb_faa76e8e9009.slice/crio-8f3682e2e52a925294c9c30aeba907c0b45cdf0b6412bf38c072d5ca8e4d3f92 WatchSource:0}: Error finding container 8f3682e2e52a925294c9c30aeba907c0b45cdf0b6412bf38c072d5ca8e4d3f92: Status 404 returned error can't find the container with id 8f3682e2e52a925294c9c30aeba907c0b45cdf0b6412bf38c072d5ca8e4d3f92
Sep 07 17:22:30.073912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:30.073880    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr" event={"ID":"028e3ae6-35b2-486b-a0cb-faa76e8e9009","Type":"ContainerStarted","Data":"8f3682e2e52a925294c9c30aeba907c0b45cdf0b6412bf38c072d5ca8e4d3f92"}
Sep 07 17:22:31.080901 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:31.080861    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr" event={"ID":"028e3ae6-35b2-486b-a0cb-faa76e8e9009","Type":"ContainerStarted","Data":"06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620"}
Sep 07 17:22:31.081373 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:31.081001    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:31.103021 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:31.102965    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr" podStartSLOduration=1.768652383 podStartE2EDuration="2.102949871s" totalImagesPullingTime="334.297488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:31.101725676 +0000 UTC m=+1562.742280491" watchObservedRunningTime="2026-09-07 17:22:31.102949871 +0000 UTC m=+1562.743504666"
Sep 07 17:22:35.154276 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:35.154240    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:22:37.093160 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:37.093129    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:22:43.096725 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:43.096678    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 17:22:43.097105 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:43.096780    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:22:45.165521 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:45.165482    2545 generic.go:356] "Generic (PLEG): container finished" podID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerID="652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0" exitCode=0
Sep 07 17:22:45.165521 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:45.165525    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" event={"ID":"6371d90e-f761-42e6-b113-c8fe71247cfa","Type":"ContainerDied","Data":"652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"}
Sep 07 17:22:45.165977 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:45.165937    2545 scope.go:117] "RemoveContainer" containerID="652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"
Sep 07 17:22:45.167031 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:45.166999    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:45.167108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:45.167070    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:45.167108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:45.167102    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:46.172938 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:46.172903    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" event={"ID":"6371d90e-f761-42e6-b113-c8fe71247cfa","Type":"ContainerStarted","Data":"e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c"}
Sep 07 17:22:46.774630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:46.774586    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:46.774858 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:46.774831    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 07 17:22:46.774936 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:46.774916    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 07 17:22:47.775263 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:47.775220    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 07 17:22:47.775702 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:47.775279    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 07 17:22:48.774834 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:48.774795    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 07 17:22:48.775020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:48.774850    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 07 17:22:49.775455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:49.775413    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 07 17:22:49.775867 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:49.775475    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 07 17:22:50.775461 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:50.775419    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 07 17:22:50.775854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:50.775481    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 07 17:22:51.778463 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:51.778430    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:51.778870 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:51.778718    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:22:51.779520 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:22:51.779501    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:23:13.751786 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:13.751750    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:23:35.476323 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:35.476241    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:23:39.712012 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.711959    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"]
Sep 07 17:23:39.714283 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.714265    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.719033 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.719008    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-dad805-openshift-default-dockercfg-c74r8\""
Sep 07 17:23:39.734098 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.734069    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"]
Sep 07 17:23:39.811307 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811270    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-data\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811307 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811315    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-token\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811352    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-credential-socket\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811379    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-certs\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811410    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-socket\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811441    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/085ce0e3-8001-4319-a20a-6a22736f3bfb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811473    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c52lt\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-kube-api-access-c52lt\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811513    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-envoy\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.811585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.811555    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-podinfo\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.912777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912738    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-data\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.912777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912774    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-token\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912796    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-credential-socket\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912814    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-certs\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912837    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-socket\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912861    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/085ce0e3-8001-4319-a20a-6a22736f3bfb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912883    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c52lt\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-kube-api-access-c52lt\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912912    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-envoy\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913037 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.912927    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-podinfo\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.913190    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-credential-socket\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.913285    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-data\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.913308    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-certs\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.913355    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-socket\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.913811 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.913789    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/085ce0e3-8001-4319-a20a-6a22736f3bfb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.915620 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.915591    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-envoy\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.915818 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.915799    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-podinfo\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.924013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.923988    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-token\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:39.925341 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:39.925318    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c52lt\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-kube-api-access-c52lt\") pod \"e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") " pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:40.024634 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.024545    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:40.304857 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.304831    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"]
Sep 07 17:23:40.306595 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:23:40.306568    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085ce0e3_8001_4319_a20a_6a22736f3bfb.slice/crio-96cb11fec42036601742940cc2e50b1014b36b3d664dc4a47c73b3e05e8e224e WatchSource:0}: Error finding container 96cb11fec42036601742940cc2e50b1014b36b3d664dc4a47c73b3e05e8e224e: Status 404 returned error can't find the container with id 96cb11fec42036601742940cc2e50b1014b36b3d664dc4a47c73b3e05e8e224e
Sep 07 17:23:40.308740 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.308709    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:23:40.308816 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.308771    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:23:40.308816 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.308796    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:23:40.464593 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.464531    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" event={"ID":"085ce0e3-8001-4319-a20a-6a22736f3bfb","Type":"ContainerStarted","Data":"8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"}
Sep 07 17:23:40.464781 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.464619    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" event={"ID":"085ce0e3-8001-4319-a20a-6a22736f3bfb","Type":"ContainerStarted","Data":"96cb11fec42036601742940cc2e50b1014b36b3d664dc4a47c73b3e05e8e224e"}
Sep 07 17:23:40.488916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:40.488861    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podStartSLOduration=1.488842443 podStartE2EDuration="1.488842443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:23:40.488443958 +0000 UTC m=+1632.128998776" watchObservedRunningTime="2026-09-07 17:23:40.488842443 +0000 UTC m=+1632.129397231"
Sep 07 17:23:41.025253 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:41.025211    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:41.030572 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:41.030520    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:41.469832 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:41.469801    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:41.470851 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:41.470832    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:23:51.161698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:23:51.161659    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:24:01.594656 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:01.594619    2545 generic.go:356] "Generic (PLEG): container finished" podID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerID="8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549" exitCode=0
Sep 07 17:24:01.595074 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:01.594702    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" event={"ID":"085ce0e3-8001-4319-a20a-6a22736f3bfb","Type":"ContainerDied","Data":"8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"}
Sep 07 17:24:01.595218 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:01.595200    2545 scope.go:117] "RemoveContainer" containerID="8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"
Sep 07 17:24:01.596292 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:01.596266    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:24:01.596347 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:01.596334    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:24:01.596384 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:01.596369    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:24:02.602367 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:02.602328    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" event={"ID":"085ce0e3-8001-4319-a20a-6a22736f3bfb","Type":"ContainerStarted","Data":"3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c"}
Sep 07 17:24:03.024902 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:03.024809    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:24:03.025080 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:03.025041    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 17:24:03.025157 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:03.025106    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 17:24:04.025204 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:04.025159    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 17:24:04.025663 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:04.025222    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 17:24:05.025663 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:05.025625    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 17:24:05.026065 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:05.025688    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 17:24:06.025422 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:06.025372    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 17:24:06.025634 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:06.025445    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 17:24:07.025606 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:07.025567    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 17:24:07.025989 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:07.025623    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 17:24:08.025910 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:08.025817    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 17:24:08.025910 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:08.025878    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 17:24:09.029513 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:09.029484    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:24:09.029976 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:09.029774    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:24:09.030362 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:09.030344    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:24:19.333915 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:19.333882    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:24:21.480260 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:21.480226    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"]
Sep 07 17:24:21.480643 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:21.480478    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" containerID="cri-o://3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c" gracePeriod=30
Sep 07 17:24:24.032726 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:24.032681    2545 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:24:24.033092 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:24.032744    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:24:26.724831 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.724807    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:24:26.735741 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.735704    2545 generic.go:356] "Generic (PLEG): container finished" podID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerID="3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c" exitCode=0
Sep 07 17:24:26.735881 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.735744    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" event={"ID":"085ce0e3-8001-4319-a20a-6a22736f3bfb","Type":"ContainerDied","Data":"3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c"}
Sep 07 17:24:26.735881 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.735815    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc" event={"ID":"085ce0e3-8001-4319-a20a-6a22736f3bfb","Type":"ContainerDied","Data":"96cb11fec42036601742940cc2e50b1014b36b3d664dc4a47c73b3e05e8e224e"}
Sep 07 17:24:26.735881 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.735758    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"
Sep 07 17:24:26.735881 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.735848    2545 scope.go:117] "RemoveContainer" containerID="3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c"
Sep 07 17:24:26.744714 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.744694    2545 scope.go:117] "RemoveContainer" containerID="8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"
Sep 07 17:24:26.752823 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.752795    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-certs\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.752947 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.752842    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/085ce0e3-8001-4319-a20a-6a22736f3bfb-istiod-ca-cert\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.752947 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.752897    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-token\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.752947 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.752927    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-podinfo\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.753102 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.752973    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-data\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.753102 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753020    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c52lt\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-kube-api-access-c52lt\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.753102 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753067    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-credential-socket\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.753288 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753142    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-envoy\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.753288 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753166    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-socket\") pod \"085ce0e3-8001-4319-a20a-6a22736f3bfb\" (UID: \"085ce0e3-8001-4319-a20a-6a22736f3bfb\") "
Sep 07 17:24:26.754282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753645    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:24:26.754282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753665    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:24:26.754282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753757    2545 scope.go:117] "RemoveContainer" containerID="3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c"
Sep 07 17:24:26.754282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753801    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-data" (OuterVolumeSpecName: "istio-data") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:24:26.754282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.753989    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/085ce0e3-8001-4319-a20a-6a22736f3bfb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:26.754595 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.754329    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:24:26.755984 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:24:26.755753    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c\": container with ID starting with 3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c not found: ID does not exist" containerID="3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c"
Sep 07 17:24:26.755984 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.755792    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c"} err="failed to get container status \"3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c\": rpc error: code = NotFound desc = could not find container \"3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c\": container with ID starting with 3b27a44edf6a777ddd27a936cf0598e34b8917acc73ccdc7a8ec956fb713f96c not found: ID does not exist"
Sep 07 17:24:26.755984 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.755818    2545 scope.go:117] "RemoveContainer" containerID="8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"
Sep 07 17:24:26.756221 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:24:26.756121    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549\": container with ID starting with 8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549 not found: ID does not exist" containerID="8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"
Sep 07 17:24:26.756221 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.756150    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549"} err="failed to get container status \"8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549\": rpc error: code = NotFound desc = could not find container \"8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549\": container with ID starting with 8a26a537524ef5e1f4ebc9e369a64c5c209771e04c79ec98158ef53e28dcb549 not found: ID does not exist"
Sep 07 17:24:26.756645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.756611    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:24:26.756870 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.756842    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-kube-api-access-c52lt" (OuterVolumeSpecName: "kube-api-access-c52lt") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "kube-api-access-c52lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:26.757030 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.757001    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-token" (OuterVolumeSpecName: "istio-token") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:26.757130 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.757074    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "085ce0e3-8001-4319-a20a-6a22736f3bfb" (UID: "085ce0e3-8001-4319-a20a-6a22736f3bfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:24:26.853967 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.853932    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c52lt\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-kube-api-access-c52lt\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.853967 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.853969    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.853987    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.854002    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.854016    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.854029    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/085ce0e3-8001-4319-a20a-6a22736f3bfb-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.854044    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.854056    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:26.854173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:26.854068    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/085ce0e3-8001-4319-a20a-6a22736f3bfb-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:24:27.054464 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:27.054388    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"]
Sep 07 17:24:27.062396 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:27.062367    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc"]
Sep 07 17:24:28.892602 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:28.892557    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" path="/var/lib/kubelet/pods/085ce0e3-8001-4319-a20a-6a22736f3bfb/volumes"
Sep 07 17:24:29.205369 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:29.205294    2545 scope.go:117] "RemoveContainer" containerID="ad4cfc8b2e2595f7247ae4842791691035813baf15a662420967e87ec107b470"
Sep 07 17:24:41.147564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:41.147511    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:24:50.545319 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:24:50.545282    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:25:40.714052 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:40.714017    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"]
Sep 07 17:25:40.714615 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:40.714229    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr" podUID="028e3ae6-35b2-486b-a0cb-faa76e8e9009" containerName="maas-api" containerID="cri-o://06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620" gracePeriod=30
Sep 07 17:25:40.963900 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:40.963874    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:25:41.114637 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.114600    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-metrics-certs\") pod \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") "
Sep 07 17:25:41.114637 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.114640    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wg6z\" (UniqueName: \"kubernetes.io/projected/028e3ae6-35b2-486b-a0cb-faa76e8e9009-kube-api-access-9wg6z\") pod \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") "
Sep 07 17:25:41.114919 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.114716    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-maas-api-tls\") pod \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") "
Sep 07 17:25:41.114919 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.114747    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028e3ae6-35b2-486b-a0cb-faa76e8e9009-openshift-service-ca\") pod \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\" (UID: \"028e3ae6-35b2-486b-a0cb-faa76e8e9009\") "
Sep 07 17:25:41.115305 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.115273    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028e3ae6-35b2-486b-a0cb-faa76e8e9009-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "028e3ae6-35b2-486b-a0cb-faa76e8e9009" (UID: "028e3ae6-35b2-486b-a0cb-faa76e8e9009"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:41.117426 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.117371    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "028e3ae6-35b2-486b-a0cb-faa76e8e9009" (UID: "028e3ae6-35b2-486b-a0cb-faa76e8e9009"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:25:41.117931 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.117900    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "028e3ae6-35b2-486b-a0cb-faa76e8e9009" (UID: "028e3ae6-35b2-486b-a0cb-faa76e8e9009"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:25:41.118234 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.118206    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028e3ae6-35b2-486b-a0cb-faa76e8e9009-kube-api-access-9wg6z" (OuterVolumeSpecName: "kube-api-access-9wg6z") pod "028e3ae6-35b2-486b-a0cb-faa76e8e9009" (UID: "028e3ae6-35b2-486b-a0cb-faa76e8e9009"). InnerVolumeSpecName "kube-api-access-9wg6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:41.134482 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.134449    2545 generic.go:356] "Generic (PLEG): container finished" podID="028e3ae6-35b2-486b-a0cb-faa76e8e9009" containerID="06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620" exitCode=0
Sep 07 17:25:41.134649 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.134494    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"
Sep 07 17:25:41.134649 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.134549    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr" event={"ID":"028e3ae6-35b2-486b-a0cb-faa76e8e9009","Type":"ContainerDied","Data":"06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620"}
Sep 07 17:25:41.134649 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.134602    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr" event={"ID":"028e3ae6-35b2-486b-a0cb-faa76e8e9009","Type":"ContainerDied","Data":"8f3682e2e52a925294c9c30aeba907c0b45cdf0b6412bf38c072d5ca8e4d3f92"}
Sep 07 17:25:41.134649 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.134624    2545 scope.go:117] "RemoveContainer" containerID="06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620"
Sep 07 17:25:41.144963 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.144941    2545 scope.go:117] "RemoveContainer" containerID="06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620"
Sep 07 17:25:41.145325 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:25:41.145304    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620\": container with ID starting with 06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620 not found: ID does not exist" containerID="06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620"
Sep 07 17:25:41.145389 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.145335    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620"} err="failed to get container status \"06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620\": rpc error: code = NotFound desc = could not find container \"06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620\": container with ID starting with 06df5721d4fa191c00eb4703fbf9d3f34f22e36d82722d34657071fff3e3e620 not found: ID does not exist"
Sep 07 17:25:41.166465 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.166432    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"]
Sep 07 17:25:41.204169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.204133    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fac82d-5ff5676cd4-bsmqr"]
Sep 07 17:25:41.215756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.215729    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-metrics-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.215756 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.215754    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wg6z\" (UniqueName: \"kubernetes.io/projected/028e3ae6-35b2-486b-a0cb-faa76e8e9009-kube-api-access-9wg6z\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.215871 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.215764    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/028e3ae6-35b2-486b-a0cb-faa76e8e9009-maas-api-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.215871 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:41.215777    2545 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/028e3ae6-35b2-486b-a0cb-faa76e8e9009-openshift-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:42.888449 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:42.888404    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028e3ae6-35b2-486b-a0cb-faa76e8e9009" path="/var/lib/kubelet/pods/028e3ae6-35b2-486b-a0cb-faa76e8e9009/volumes"
Sep 07 17:25:45.644143 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:45.644104    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:25:47.831258 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:47.831229    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"]
Sep 07 17:25:47.831645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:47.831421    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" containerID="cri-o://e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c" gracePeriod=30
Sep 07 17:25:51.781217 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:51.781167    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:25:51.781619 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:51.781255    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:25:53.079516 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.079489    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:25:53.200044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.199957    2545 generic.go:356] "Generic (PLEG): container finished" podID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerID="e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c" exitCode=0
Sep 07 17:25:53.200044 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.199999    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"
Sep 07 17:25:53.200229 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.200040    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" event={"ID":"6371d90e-f761-42e6-b113-c8fe71247cfa","Type":"ContainerDied","Data":"e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c"}
Sep 07 17:25:53.200229 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.200095    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh" event={"ID":"6371d90e-f761-42e6-b113-c8fe71247cfa","Type":"ContainerDied","Data":"93c5aedab629c681f7634a7cace8e6c7dca5e09ab22f707e5b3622b30d2cf876"}
Sep 07 17:25:53.200229 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.200119    2545 scope.go:117] "RemoveContainer" containerID="e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c"
Sep 07 17:25:53.208929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.208910    2545 scope.go:117] "RemoveContainer" containerID="652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"
Sep 07 17:25:53.217171 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.217153    2545 scope.go:117] "RemoveContainer" containerID="e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c"
Sep 07 17:25:53.217473 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:25:53.217451    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c\": container with ID starting with e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c not found: ID does not exist" containerID="e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c"
Sep 07 17:25:53.217569 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.217488    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c"} err="failed to get container status \"e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c\": rpc error: code = NotFound desc = could not find container \"e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c\": container with ID starting with e557331c4c5a1c10572acf77385a18952d6ae87eb0fd9ecf712b68a46f74033c not found: ID does not exist"
Sep 07 17:25:53.217569 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.217513    2545 scope.go:117] "RemoveContainer" containerID="652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"
Sep 07 17:25:53.217826 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:25:53.217808    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0\": container with ID starting with 652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0 not found: ID does not exist" containerID="652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"
Sep 07 17:25:53.217870 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.217833    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0"} err="failed to get container status \"652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0\": rpc error: code = NotFound desc = could not find container \"652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0\": container with ID starting with 652dd4c8c681e3fa5ca17f025aa7593877d75f3d3d88f164822324d042ec12b0 not found: ID does not exist"
Sep 07 17:25:53.223101 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223083    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-data\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.223186 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223139    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6371d90e-f761-42e6-b113-c8fe71247cfa-istiod-ca-cert\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.223186 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223168    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-token\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.223297 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223244    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-certs\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.223408 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223385    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:53.223487 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223398    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-podinfo\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.223487 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223438    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-credential-socket\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.223715 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223505    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:53.223715 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223679    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:53.223715 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223687    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6371d90e-f761-42e6-b113-c8fe71247cfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:53.223935 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223908    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgbh5\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-kube-api-access-dgbh5\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.224061 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223966    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-envoy\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.224061 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.223998    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-socket\") pod \"6371d90e-f761-42e6-b113-c8fe71247cfa\" (UID: \"6371d90e-f761-42e6-b113-c8fe71247cfa\") "
Sep 07 17:25:53.224275 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.224256    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.224355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.224276    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6371d90e-f761-42e6-b113-c8fe71247cfa-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.224355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.224289    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.224355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.224301    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.224355 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.224332    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:53.225620 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.225589    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:25:53.225620 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.225614    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:53.225773 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.225710    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-kube-api-access-dgbh5" (OuterVolumeSpecName: "kube-api-access-dgbh5") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "kube-api-access-dgbh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:53.225940 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.225926    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6371d90e-f761-42e6-b113-c8fe71247cfa" (UID: "6371d90e-f761-42e6-b113-c8fe71247cfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:53.325108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.325065    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgbh5\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-kube-api-access-dgbh5\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.325108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.325098    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.325108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.325108    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6371d90e-f761-42e6-b113-c8fe71247cfa-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.325108 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.325116    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.325383 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.325125    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6371d90e-f761-42e6-b113-c8fe71247cfa-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:25:53.524051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.524018    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"]
Sep 07 17:25:53.528032 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:53.528005    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh"]
Sep 07 17:25:54.888263 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:25:54.888220    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" path="/var/lib/kubelet/pods/6371d90e-f761-42e6-b113-c8fe71247cfa/volumes"
Sep 07 17:26:01.259247 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:01.259207    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:26:06.076995 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:06.076953    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"]
Sep 07 17:26:06.077496 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:06.077185    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" containerID="cri-o://1f75727d1d05ada5b6573327c3e262f3b59706e8cf5e285c793fe0659f99a2e5" gracePeriod=30
Sep 07 17:26:07.818020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:07.817983    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:26:07.818391 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:07.818042    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:26:11.304141 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.304100    2545 generic.go:356] "Generic (PLEG): container finished" podID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerID="1f75727d1d05ada5b6573327c3e262f3b59706e8cf5e285c793fe0659f99a2e5" exitCode=0
Sep 07 17:26:11.304551 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.304156    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" event={"ID":"af0ab6c6-20c5-4fab-b91e-df9025cb6edc","Type":"ContainerDied","Data":"1f75727d1d05ada5b6573327c3e262f3b59706e8cf5e285c793fe0659f99a2e5"}
Sep 07 17:26:11.304551 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.304236    2545 scope.go:117] "RemoveContainer" containerID="4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f"
Sep 07 17:26:11.324765 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:26:11.324739    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f\": container with ID starting with 4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f not found: ID does not exist" containerID="4167ff543f0c9fb607a8c343cf06620429c665590f4760b97aa411418849ff9f"
Sep 07 17:26:11.327754 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.327734    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:26:11.362581 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362491    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-certs\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362581 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362548    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k77fb\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-kube-api-access-k77fb\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362587    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-data\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362628    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-socket\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362652    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-credential-socket\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362783    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-token\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362817    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:11.362941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362838    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istiod-ca-cert\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362895    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-envoy\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.362941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362908    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:11.362941 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362932    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-podinfo\") pod \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\" (UID: \"af0ab6c6-20c5-4fab-b91e-df9025cb6edc\") "
Sep 07 17:26:11.363231 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362925    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:11.363231 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.363207    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:26:11.363325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.363227    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.363325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.362936    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-data" (OuterVolumeSpecName: "istio-data") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:11.363325 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.363246    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.365354 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.365325    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:26:11.365469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.365353    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-kube-api-access-k77fb" (OuterVolumeSpecName: "kube-api-access-k77fb") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "kube-api-access-k77fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:11.365469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.365440    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:11.365469 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.365455    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-token" (OuterVolumeSpecName: "istio-token") pod "af0ab6c6-20c5-4fab-b91e-df9025cb6edc" (UID: "af0ab6c6-20c5-4fab-b91e-df9025cb6edc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:11.464236 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464198    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.464236 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464227    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.464236 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464237    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k77fb\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-kube-api-access-k77fb\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.464460 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464247    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.464460 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464256    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.464460 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464263    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:11.464460 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:11.464272    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af0ab6c6-20c5-4fab-b91e-df9025cb6edc-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:12.311254 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:12.311223    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"
Sep 07 17:26:12.311833 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:12.311277    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl" event={"ID":"af0ab6c6-20c5-4fab-b91e-df9025cb6edc","Type":"ContainerDied","Data":"b03d3e3f000d61da45936d35c12dcab9e61f08cfb2d38d2c5449ec9bf739304a"}
Sep 07 17:26:12.311833 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:12.311341    2545 scope.go:117] "RemoveContainer" containerID="1f75727d1d05ada5b6573327c3e262f3b59706e8cf5e285c793fe0659f99a2e5"
Sep 07 17:26:12.333706 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:12.333675    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"]
Sep 07 17:26:12.337750 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:12.337723    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl"]
Sep 07 17:26:12.888521 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:12.888491    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" path="/var/lib/kubelet/pods/af0ab6c6-20c5-4fab-b91e-df9025cb6edc/volumes"
Sep 07 17:26:16.928060 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:16.928024    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"]
Sep 07 17:26:16.928476 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:16.928256    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq" podUID="ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" containerName="maas-api" containerID="cri-o://394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69" gracePeriod=30
Sep 07 17:26:17.174212 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.174188    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:26:17.211772 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.211679    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-metrics-certs\") pod \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") "
Sep 07 17:26:17.211929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.211829    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55jqs\" (UniqueName: \"kubernetes.io/projected/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-kube-api-access-55jqs\") pod \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") "
Sep 07 17:26:17.211929 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.211900    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-maas-api-tls\") pod \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") "
Sep 07 17:26:17.212492 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.211940    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-openshift-service-ca\") pod \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\" (UID: \"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f\") "
Sep 07 17:26:17.212679 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.212637    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" (UID: "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:26:17.214748 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.214719    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-kube-api-access-55jqs" (OuterVolumeSpecName: "kube-api-access-55jqs") pod "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" (UID: "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f"). InnerVolumeSpecName "kube-api-access-55jqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:17.214871 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.214858    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" (UID: "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:26:17.215172 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.215153    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" (UID: "ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:26:17.312722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.312686    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55jqs\" (UniqueName: \"kubernetes.io/projected/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-kube-api-access-55jqs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.312722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.312725    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-maas-api-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.312914 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.312735    2545 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-openshift-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.312914 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.312747    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f-metrics-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.342312 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.342277    2545 generic.go:356] "Generic (PLEG): container finished" podID="ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" containerID="394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69" exitCode=0
Sep 07 17:26:17.342470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.342321    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"
Sep 07 17:26:17.342470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.342367    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq" event={"ID":"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f","Type":"ContainerDied","Data":"394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69"}
Sep 07 17:26:17.342470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.342414    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq" event={"ID":"ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f","Type":"ContainerDied","Data":"c9461b323eceaa5dd69ab7367baa2a3539394030c8652074bba0d0f3d73e3c7c"}
Sep 07 17:26:17.342470 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.342438    2545 scope.go:117] "RemoveContainer" containerID="394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69"
Sep 07 17:26:17.351959 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.351944    2545 scope.go:117] "RemoveContainer" containerID="394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69"
Sep 07 17:26:17.352238 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:26:17.352220    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69\": container with ID starting with 394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69 not found: ID does not exist" containerID="394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69"
Sep 07 17:26:17.352292 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.352247    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69"} err="failed to get container status \"394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69\": rpc error: code = NotFound desc = could not find container \"394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69\": container with ID starting with 394afc3b75a607b3a41cc4f83bb17a28aa2ff2c7a862f725f50970f5c24e3b69 not found: ID does not exist"
Sep 07 17:26:17.366927 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.366905    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"]
Sep 07 17:26:17.372894 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:17.372871    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3973bf-77449cffcc-hbvjq"]
Sep 07 17:26:18.888308 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:18.888274    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" path="/var/lib/kubelet/pods/ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f/volumes"
Sep 07 17:26:19.544969 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:19.544931    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:26:24.063568 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:24.063469    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"]
Sep 07 17:26:24.379916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:24.379814    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy" containerID="cri-o://22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d" gracePeriod=30
Sep 07 17:26:29.047661 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.047619    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:26:29.237697 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.237658    2545 scope.go:117] "RemoveContainer" containerID="db6ab06eaeea63bf998ce06e0035e1abd1f722e662960c6123bb267f9f682e5e"
Sep 07 17:26:29.627885 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.627855    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:26:29.719343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719248    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-envoy\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719300    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-credential-socket\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719343 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719329    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-socket\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719372    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-podinfo\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719403    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-certs\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719428    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istiod-ca-cert\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719459    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-data\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719596    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-token\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719670 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719649    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nngs9\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-kube-api-access-nngs9\") pod \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\" (UID: \"0fdf70a1-0111-4c75-8bcf-3e162a1602ad\") "
Sep 07 17:26:29.719993 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719747    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:29.719993 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719786    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:29.719993 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719787    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:29.719993 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719896    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:26:29.719993 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719982    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:29.720259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.719991    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-credential-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.720259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.720013    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.720259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.720027    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-data\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.721569 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.721527    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:26:29.721746 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.721727    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:29.721746 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.721735    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:26:29.721848 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.721839    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-kube-api-access-nngs9" (OuterVolumeSpecName: "kube-api-access-nngs9") pod "0fdf70a1-0111-4c75-8bcf-3e162a1602ad" (UID: "0fdf70a1-0111-4c75-8bcf-3e162a1602ad"). InnerVolumeSpecName "kube-api-access-nngs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:29.820745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.820704    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-workload-socket\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.820745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.820740    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-podinfo\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.820745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.820749    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istiod-ca-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.820745 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.820758    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.821010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.820766    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nngs9\" (UniqueName: \"kubernetes.io/projected/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-kube-api-access-nngs9\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:29.821010 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:29.820776    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdf70a1-0111-4c75-8bcf-3e162a1602ad-istio-envoy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:26:30.411835 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.411794    2545 generic.go:356] "Generic (PLEG): container finished" podID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerID="22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d" exitCode=0
Sep 07 17:26:30.412267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.411845    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"
Sep 07 17:26:30.412267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.411874    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" event={"ID":"0fdf70a1-0111-4c75-8bcf-3e162a1602ad","Type":"ContainerDied","Data":"22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d"}
Sep 07 17:26:30.412267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.411924    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v" event={"ID":"0fdf70a1-0111-4c75-8bcf-3e162a1602ad","Type":"ContainerDied","Data":"6df2872276029a414cbebfd7313c37686736e282d93facb0851f727a060acde9"}
Sep 07 17:26:30.412267 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.411944    2545 scope.go:117] "RemoveContainer" containerID="22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d"
Sep 07 17:26:30.421312 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.421291    2545 scope.go:117] "RemoveContainer" containerID="66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"
Sep 07 17:26:30.429451 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.429427    2545 scope.go:117] "RemoveContainer" containerID="22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d"
Sep 07 17:26:30.429803 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:26:30.429779    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d\": container with ID starting with 22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d not found: ID does not exist" containerID="22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d"
Sep 07 17:26:30.429865 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.429812    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d"} err="failed to get container status \"22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d\": rpc error: code = NotFound desc = could not find container \"22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d\": container with ID starting with 22641c4c519de6cce4ff67396716523b2192cca459363b3ea185d6c32344d97d not found: ID does not exist"
Sep 07 17:26:30.429865 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.429830    2545 scope.go:117] "RemoveContainer" containerID="66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"
Sep 07 17:26:30.430108 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:26:30.430091    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015\": container with ID starting with 66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015 not found: ID does not exist" containerID="66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"
Sep 07 17:26:30.430162 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.430111    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015"} err="failed to get container status \"66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015\": rpc error: code = NotFound desc = could not find container \"66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015\": container with ID starting with 66dc5aab6a982e58ba26de5d47ae253ebdda7d0cab1cd9d0ca59d7214714b015 not found: ID does not exist"
Sep 07 17:26:30.434689 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.434664    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"]
Sep 07 17:26:30.440988 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.440962    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v"]
Sep 07 17:26:30.887876 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:26:30.887842    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" path="/var/lib/kubelet/pods/0fdf70a1-0111-4c75-8bcf-3e162a1602ad/volumes"
Sep 07 17:27:29.271689 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:27:29.271655    2545 scope.go:117] "RemoveContainer" containerID="56a5f2be3fa24bc0b7e60b0db1061c8f3cdf3b628d5a418b1ff08c133be2cd2a"
Sep 07 17:27:29.279896 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:27:29.279875    2545 scope.go:117] "RemoveContainer" containerID="d9fdf815f4f8666fb1e4553de74b37fea8ef6b20a9235a43e470a70622e09474"
Sep 07 17:27:48.540374 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:27:48.540329    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:28:15.439494 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:15.439457    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:28:23.436567 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:23.436131    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:28:29.304850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:29.304815    2545 scope.go:117] "RemoveContainer" containerID="791255da0659e43b16e34f08968ebf205b9e3d1841fb3800a7303a4ef8281076"
Sep 07 17:28:29.312974 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:29.312952    2545 scope.go:117] "RemoveContainer" containerID="4b1e81554bc770e15b4f134b18237cd50c64e900cb0e7d02c80b26f8fce21982"
Sep 07 17:28:30.646455 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:30.646415    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:28:37.550498 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:37.550455    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:28:56.360975 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:28:56.360937    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:29:06.238200 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:29:06.238157    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:30:35.840916 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:30:35.840876    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:30:42.440844 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:30:42.440806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:30:51.243925 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:30:51.243832    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:31:07.739510 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:07.739464    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:31:18.516019 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.515985    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"]
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516259    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516269    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516282    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516287    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516293    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" containerName="maas-api"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516298    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" containerName="maas-api"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516306    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516312    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516326    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028e3ae6-35b2-486b-a0cb-faa76e8e9009" containerName="maas-api"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516331    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="028e3ae6-35b2-486b-a0cb-faa76e8e9009" containerName="maas-api"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516337    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516342    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516351    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516356    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy"
Sep 07 17:31:18.516393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516399    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516406    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516414    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516419    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdf70a1-0111-4c75-8bcf-3e162a1602ad" containerName="istio-proxy"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516425    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516431    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3b9bc7-2ac0-4411-ab54-9c970a4c4c9f" containerName="maas-api"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516436    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516442    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="028e3ae6-35b2-486b-a0cb-faa76e8e9009" containerName="maas-api"
Sep 07 17:31:18.516954 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.516447    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy"
Sep 07 17:31:18.519353 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.519324    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.522085 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.522060    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-267c53da-kserve-self-signed-certs\""
Sep 07 17:31:18.531088 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.531067    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"]
Sep 07 17:31:18.602287 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.602254    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-model-cache\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.602474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.602302    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-home\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.602474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.602333    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-dshm\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.602474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.602384    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-tmp-dir\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.602474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.602412    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52xcc\" (UniqueName: \"kubernetes.io/projected/96e2a900-ae73-4941-b606-3e68751aed7e-kube-api-access-52xcc\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.602474 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.602448    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e2a900-ae73-4941-b606-3e68751aed7e-tls-certs\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.703685 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.703645    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-model-cache\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.703873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.703702    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-home\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.703873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.703745    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-dshm\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.703873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.703773    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-tmp-dir\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.703873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.703795    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52xcc\" (UniqueName: \"kubernetes.io/projected/96e2a900-ae73-4941-b606-3e68751aed7e-kube-api-access-52xcc\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.703873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.703836    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e2a900-ae73-4941-b606-3e68751aed7e-tls-certs\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.704145 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.704008    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-model-cache\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.704145 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.704044    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-home\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.704145 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.704138    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-tmp-dir\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.705933 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.705913    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-dshm\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.706211 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.706192    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e2a900-ae73-4941-b606-3e68751aed7e-tls-certs\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.714730 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.714704    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52xcc\" (UniqueName: \"kubernetes.io/projected/96e2a900-ae73-4941-b606-3e68751aed7e-kube-api-access-52xcc\") pod \"e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") " pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:18.828339 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:18.828316    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:19.105622 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:19.105594    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"]
Sep 07 17:31:19.107574 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:31:19.107515    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96e2a900_ae73_4941_b606_3e68751aed7e.slice/crio-fc49d9b3a8f3632b78d8b12ac2c4c837ae62e592ff38891d34e7add313a558ee WatchSource:0}: Error finding container fc49d9b3a8f3632b78d8b12ac2c4c837ae62e592ff38891d34e7add313a558ee: Status 404 returned error can't find the container with id fc49d9b3a8f3632b78d8b12ac2c4c837ae62e592ff38891d34e7add313a558ee
Sep 07 17:31:19.810315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:19.810276    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b" event={"ID":"96e2a900-ae73-4941-b606-3e68751aed7e","Type":"ContainerStarted","Data":"a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02"}
Sep 07 17:31:19.810775 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:19.810325    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b" event={"ID":"96e2a900-ae73-4941-b606-3e68751aed7e","Type":"ContainerStarted","Data":"fc49d9b3a8f3632b78d8b12ac2c4c837ae62e592ff38891d34e7add313a558ee"}
Sep 07 17:31:19.829393 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:19.829342    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b" podStartSLOduration=1.8293231410000002 podStartE2EDuration="1.829323141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:31:19.829239897 +0000 UTC m=+2091.469794714" watchObservedRunningTime="2026-09-07 17:31:19.829323141 +0000 UTC m=+2091.469877937"
Sep 07 17:31:21.340259 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:21.340217    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:31:28.829206 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:28.829169    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:28.829607 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:28.829220    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:28.841698 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:28.841671    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:31:28.872981 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:31:28.872953    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:32:00.039257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:00.039216    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:00.103585 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:00.103548    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"]
Sep 07 17:32:07.449994 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:07.449960    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:15.122638 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.122599    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b" podUID="96e2a900-ae73-4941-b606-3e68751aed7e" containerName="main" containerID="cri-o://a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02" gracePeriod=45
Sep 07 17:32:15.364034 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.364009    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:32:15.481668 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481571    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e2a900-ae73-4941-b606-3e68751aed7e-tls-certs\") pod \"96e2a900-ae73-4941-b606-3e68751aed7e\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") "
Sep 07 17:32:15.481668 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481644    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-model-cache\") pod \"96e2a900-ae73-4941-b606-3e68751aed7e\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") "
Sep 07 17:32:15.481903 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481680    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-dshm\") pod \"96e2a900-ae73-4941-b606-3e68751aed7e\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") "
Sep 07 17:32:15.481903 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481715    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52xcc\" (UniqueName: \"kubernetes.io/projected/96e2a900-ae73-4941-b606-3e68751aed7e-kube-api-access-52xcc\") pod \"96e2a900-ae73-4941-b606-3e68751aed7e\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") "
Sep 07 17:32:15.481903 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481741    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-home\") pod \"96e2a900-ae73-4941-b606-3e68751aed7e\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") "
Sep 07 17:32:15.481903 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481764    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-tmp-dir\") pod \"96e2a900-ae73-4941-b606-3e68751aed7e\" (UID: \"96e2a900-ae73-4941-b606-3e68751aed7e\") "
Sep 07 17:32:15.482131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.481925    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-model-cache" (OuterVolumeSpecName: "model-cache") pod "96e2a900-ae73-4941-b606-3e68751aed7e" (UID: "96e2a900-ae73-4941-b606-3e68751aed7e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:15.482131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.482026    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-home" (OuterVolumeSpecName: "home") pod "96e2a900-ae73-4941-b606-3e68751aed7e" (UID: "96e2a900-ae73-4941-b606-3e68751aed7e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:15.482131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.482082    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-model-cache\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:15.482131 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.482107    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "96e2a900-ae73-4941-b606-3e68751aed7e" (UID: "96e2a900-ae73-4941-b606-3e68751aed7e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:15.483867 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.483848    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e2a900-ae73-4941-b606-3e68751aed7e-kube-api-access-52xcc" (OuterVolumeSpecName: "kube-api-access-52xcc") pod "96e2a900-ae73-4941-b606-3e68751aed7e" (UID: "96e2a900-ae73-4941-b606-3e68751aed7e"). InnerVolumeSpecName "kube-api-access-52xcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:32:15.483867 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.483858    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-dshm" (OuterVolumeSpecName: "dshm") pod "96e2a900-ae73-4941-b606-3e68751aed7e" (UID: "96e2a900-ae73-4941-b606-3e68751aed7e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:32:15.484019 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.483844    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e2a900-ae73-4941-b606-3e68751aed7e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "96e2a900-ae73-4941-b606-3e68751aed7e" (UID: "96e2a900-ae73-4941-b606-3e68751aed7e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:32:15.583137 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.583097    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-dshm\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:15.583137 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.583132    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52xcc\" (UniqueName: \"kubernetes.io/projected/96e2a900-ae73-4941-b606-3e68751aed7e-kube-api-access-52xcc\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:15.583137 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.583142    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-home\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:15.583372 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.583151    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e2a900-ae73-4941-b606-3e68751aed7e-tmp-dir\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:15.583372 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:15.583159    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e2a900-ae73-4941-b606-3e68751aed7e-tls-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:16.084169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.084126    2545 generic.go:356] "Generic (PLEG): container finished" podID="96e2a900-ae73-4941-b606-3e68751aed7e" containerID="a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02" exitCode=0
Sep 07 17:32:16.084169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.084170    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"
Sep 07 17:32:16.084447 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.084208    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b" event={"ID":"96e2a900-ae73-4941-b606-3e68751aed7e","Type":"ContainerDied","Data":"a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02"}
Sep 07 17:32:16.084447 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.084253    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b" event={"ID":"96e2a900-ae73-4941-b606-3e68751aed7e","Type":"ContainerDied","Data":"fc49d9b3a8f3632b78d8b12ac2c4c837ae62e592ff38891d34e7add313a558ee"}
Sep 07 17:32:16.084447 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.084277    2545 scope.go:117] "RemoveContainer" containerID="a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02"
Sep 07 17:32:16.093233 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.093216    2545 scope.go:117] "RemoveContainer" containerID="a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02"
Sep 07 17:32:16.093571 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:32:16.093529    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02\": container with ID starting with a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02 not found: ID does not exist" containerID="a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02"
Sep 07 17:32:16.093639 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.093585    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02"} err="failed to get container status \"a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02\": rpc error: code = NotFound desc = could not find container \"a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02\": container with ID starting with a813ecbce1d465075f0c89650eeea9586156aa67b33903cc81382a2861d0be02 not found: ID does not exist"
Sep 07 17:32:16.106394 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.106369    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"]
Sep 07 17:32:16.110991 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.110967    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-267c53da-kserve-54bc9cf5f9-2md8b"]
Sep 07 17:32:16.849921 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.849883    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"]
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850219    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850233    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0ab6c6-20c5-4fab-b91e-df9025cb6edc" containerName="istio-proxy"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850243    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e2a900-ae73-4941-b606-3e68751aed7e" containerName="main"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850250    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e2a900-ae73-4941-b606-3e68751aed7e" containerName="main"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850260    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850266    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6371d90e-f761-42e6-b113-c8fe71247cfa" containerName="istio-proxy"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850275    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy"
Sep 07 17:32:16.850300 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850280    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy"
Sep 07 17:32:16.850578 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850337    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="085ce0e3-8001-4319-a20a-6a22736f3bfb" containerName="istio-proxy"
Sep 07 17:32:16.850578 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.850346    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e2a900-ae73-4941-b606-3e68751aed7e" containerName="main"
Sep 07 17:32:16.854638 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.854612    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:16.858769 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.858744    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:32:16.858912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.858817    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 17:32:16.858912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.858818    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:32:16.858912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.858868    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:32:16.858912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.858823    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:32:16.867152 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.867124    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"]
Sep 07 17:32:16.888865 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.888831    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e2a900-ae73-4941-b606-3e68751aed7e" path="/var/lib/kubelet/pods/96e2a900-ae73-4941-b606-3e68751aed7e/volumes"
Sep 07 17:32:16.994760 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.994703    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-maas-api-tls\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:16.994974 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.994790    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-metrics-certs\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:16.994974 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.994831    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5h6j\" (UniqueName: \"kubernetes.io/projected/8a79add5-f44e-4c17-93b9-d5d596d76b97-kube-api-access-d5h6j\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:16.994974 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:16.994850    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a79add5-f44e-4c17-93b9-d5d596d76b97-openshift-service-ca\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.095899 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.095860    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-metrics-certs\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.096082 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.095910    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5h6j\" (UniqueName: \"kubernetes.io/projected/8a79add5-f44e-4c17-93b9-d5d596d76b97-kube-api-access-d5h6j\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.096181 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.096161    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a79add5-f44e-4c17-93b9-d5d596d76b97-openshift-service-ca\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.096282 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.096264    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-maas-api-tls\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.097019 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.096989    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a79add5-f44e-4c17-93b9-d5d596d76b97-openshift-service-ca\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.098645 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.098613    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-metrics-certs\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.098873 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.098855    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-maas-api-tls\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.117257 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.117198    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5h6j\" (UniqueName: \"kubernetes.io/projected/8a79add5-f44e-4c17-93b9-d5d596d76b97-kube-api-access-d5h6j\") pod \"maas-api-65dbf959f5-dzpcp\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.166564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.166508    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:17.440962 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.440937    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"]
Sep 07 17:32:17.442730 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:32:17.442701    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a79add5_f44e_4c17_93b9_d5d596d76b97.slice/crio-8a1744908987d793685247315454b01b1137e2b9e45d6d4d650a14d2a78dd0e1 WatchSource:0}: Error finding container 8a1744908987d793685247315454b01b1137e2b9e45d6d4d650a14d2a78dd0e1: Status 404 returned error can't find the container with id 8a1744908987d793685247315454b01b1137e2b9e45d6d4d650a14d2a78dd0e1
Sep 07 17:32:17.444015 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.443997    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:32:17.545148 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:17.545113    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:18.103169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:18.103076    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp" event={"ID":"8a79add5-f44e-4c17-93b9-d5d596d76b97","Type":"ContainerStarted","Data":"2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c"}
Sep 07 17:32:18.103169 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:18.103138    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp" event={"ID":"8a79add5-f44e-4c17-93b9-d5d596d76b97","Type":"ContainerStarted","Data":"8a1744908987d793685247315454b01b1137e2b9e45d6d4d650a14d2a78dd0e1"}
Sep 07 17:32:18.103683 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:18.103212    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:18.127850 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:18.127796    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp" podStartSLOduration=1.738460146 podStartE2EDuration="2.127778044s" totalImagesPullingTime="389.317898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:32:18.126976077 +0000 UTC m=+2149.767530902" watchObservedRunningTime="2026-09-07 17:32:18.127778044 +0000 UTC m=+2149.768332839"
Sep 07 17:32:24.114959 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.114929    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:24.298121 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.298084    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"]
Sep 07 17:32:24.298315 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.298273    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp" podUID="8a79add5-f44e-4c17-93b9-d5d596d76b97" containerName="maas-api" containerID="cri-o://2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c" gracePeriod=30
Sep 07 17:32:24.335457 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.335425    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"]
Sep 07 17:32:24.338630 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.338612    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.350364 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.350332    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"]
Sep 07 17:32:24.358849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.358821    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17326710-e4f3-4be7-81ce-3233a72e297b-openshift-service-ca\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.359020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.358859    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17326710-e4f3-4be7-81ce-3233a72e297b-maas-api-tls\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.359020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.358947    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vmq\" (UniqueName: \"kubernetes.io/projected/17326710-e4f3-4be7-81ce-3233a72e297b-kube-api-access-62vmq\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.359020 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.358997    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17326710-e4f3-4be7-81ce-3233a72e297b-metrics-certs\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.460023 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.459982    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17326710-e4f3-4be7-81ce-3233a72e297b-metrics-certs\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.460213 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.460038    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17326710-e4f3-4be7-81ce-3233a72e297b-openshift-service-ca\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.460213 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.460076    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17326710-e4f3-4be7-81ce-3233a72e297b-maas-api-tls\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.460213 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.460145    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vmq\" (UniqueName: \"kubernetes.io/projected/17326710-e4f3-4be7-81ce-3233a72e297b-kube-api-access-62vmq\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.460904 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.460878    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17326710-e4f3-4be7-81ce-3233a72e297b-openshift-service-ca\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.462854 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.462828    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17326710-e4f3-4be7-81ce-3233a72e297b-metrics-certs\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.462942 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.462846    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17326710-e4f3-4be7-81ce-3233a72e297b-maas-api-tls\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.470049 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.469804    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vmq\" (UniqueName: \"kubernetes.io/projected/17326710-e4f3-4be7-81ce-3233a72e297b-kube-api-access-62vmq\") pod \"maas-api-79b64964bc-5r8t4\" (UID: \"17326710-e4f3-4be7-81ce-3233a72e297b\") " pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.542965 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.542935    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:24.560580 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.560523    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-metrics-certs\") pod \"8a79add5-f44e-4c17-93b9-d5d596d76b97\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") "
Sep 07 17:32:24.560749 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.560620    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5h6j\" (UniqueName: \"kubernetes.io/projected/8a79add5-f44e-4c17-93b9-d5d596d76b97-kube-api-access-d5h6j\") pod \"8a79add5-f44e-4c17-93b9-d5d596d76b97\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") "
Sep 07 17:32:24.560749 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.560662    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a79add5-f44e-4c17-93b9-d5d596d76b97-openshift-service-ca\") pod \"8a79add5-f44e-4c17-93b9-d5d596d76b97\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") "
Sep 07 17:32:24.560749 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.560713    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-maas-api-tls\") pod \"8a79add5-f44e-4c17-93b9-d5d596d76b97\" (UID: \"8a79add5-f44e-4c17-93b9-d5d596d76b97\") "
Sep 07 17:32:24.561055 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.561025    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a79add5-f44e-4c17-93b9-d5d596d76b97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a79add5-f44e-4c17-93b9-d5d596d76b97" (UID: "8a79add5-f44e-4c17-93b9-d5d596d76b97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:32:24.562722 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.562698    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a79add5-f44e-4c17-93b9-d5d596d76b97" (UID: "8a79add5-f44e-4c17-93b9-d5d596d76b97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:32:24.562848 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.562746    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a79add5-f44e-4c17-93b9-d5d596d76b97" (UID: "8a79add5-f44e-4c17-93b9-d5d596d76b97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:32:24.562848 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.562795    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a79add5-f44e-4c17-93b9-d5d596d76b97-kube-api-access-d5h6j" (OuterVolumeSpecName: "kube-api-access-d5h6j") pod "8a79add5-f44e-4c17-93b9-d5d596d76b97" (UID: "8a79add5-f44e-4c17-93b9-d5d596d76b97"). InnerVolumeSpecName "kube-api-access-d5h6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:32:24.662191 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.662103    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-maas-api-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:24.662191 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.662133    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a79add5-f44e-4c17-93b9-d5d596d76b97-metrics-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:24.662191 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.662144    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5h6j\" (UniqueName: \"kubernetes.io/projected/8a79add5-f44e-4c17-93b9-d5d596d76b97-kube-api-access-d5h6j\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:24.662191 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.662155    2545 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a79add5-f44e-4c17-93b9-d5d596d76b97-openshift-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\""
Sep 07 17:32:24.678589 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.678557    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:24.959205 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:24.959120    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"]
Sep 07 17:32:24.962499 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:32:24.962471    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17326710_e4f3_4be7_81ce_3233a72e297b.slice/crio-c1fd6b2eb43d620997c15682b435f2740e316bd342b10e22b652645b5649f30e WatchSource:0}: Error finding container c1fd6b2eb43d620997c15682b435f2740e316bd342b10e22b652645b5649f30e: Status 404 returned error can't find the container with id c1fd6b2eb43d620997c15682b435f2740e316bd342b10e22b652645b5649f30e
Sep 07 17:32:25.138294 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.138262    2545 generic.go:356] "Generic (PLEG): container finished" podID="8a79add5-f44e-4c17-93b9-d5d596d76b97" containerID="2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c" exitCode=0
Sep 07 17:32:25.138791 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.138319    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"
Sep 07 17:32:25.138791 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.138348    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp" event={"ID":"8a79add5-f44e-4c17-93b9-d5d596d76b97","Type":"ContainerDied","Data":"2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c"}
Sep 07 17:32:25.138791 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.138398    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp" event={"ID":"8a79add5-f44e-4c17-93b9-d5d596d76b97","Type":"ContainerDied","Data":"8a1744908987d793685247315454b01b1137e2b9e45d6d4d650a14d2a78dd0e1"}
Sep 07 17:32:25.138791 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.138429    2545 scope.go:117] "RemoveContainer" containerID="2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c"
Sep 07 17:32:25.139777 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.139751    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4" event={"ID":"17326710-e4f3-4be7-81ce-3233a72e297b","Type":"ContainerStarted","Data":"c1fd6b2eb43d620997c15682b435f2740e316bd342b10e22b652645b5649f30e"}
Sep 07 17:32:25.139888 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.139806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:25.147173 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.147158    2545 scope.go:117] "RemoveContainer" containerID="2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c"
Sep 07 17:32:25.147442 ip-10-0-128-63 kubenswrapper[2545]: E0907 17:32:25.147420    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c\": container with ID starting with 2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c not found: ID does not exist" containerID="2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c"
Sep 07 17:32:25.147490 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.147452    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c"} err="failed to get container status \"2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c\": rpc error: code = NotFound desc = could not find container \"2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c\": container with ID starting with 2196643da5b2fd3776e27322fda9bf6636d1bb0aae01bcfeec5fa0314c23c87c not found: ID does not exist"
Sep 07 17:32:25.157495 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.157469    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"]
Sep 07 17:32:25.163860 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:25.163835    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-dzpcp"]
Sep 07 17:32:26.145897 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:26.145856    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4" event={"ID":"17326710-e4f3-4be7-81ce-3233a72e297b","Type":"ContainerStarted","Data":"cc43904cf68eba0899fd32fa15b10dbe7ed00a9dc848369d99536d5003fcd9e8"}
Sep 07 17:32:26.146318 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:26.145924    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:26.166762 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:26.166707    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4" podStartSLOduration=1.839205094 podStartE2EDuration="2.166689757s" totalImagesPullingTime="327.484663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:32:26.16466242 +0000 UTC m=+2157.805217234" watchObservedRunningTime="2026-09-07 17:32:26.166689757 +0000 UTC m=+2157.807244549"
Sep 07 17:32:26.887847 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:26.887818    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a79add5-f44e-4c17-93b9-d5d596d76b97" path="/var/lib/kubelet/pods/8a79add5-f44e-4c17-93b9-d5d596d76b97/volumes"
Sep 07 17:32:32.159912 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:32.159876    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79b64964bc-5r8t4"
Sep 07 17:32:32.846654 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:32.846619    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:39.049847 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:39.049806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:46.353178 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:46.353138    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6dsjq"]
Sep 07 17:32:54.403426 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:54.403396    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5qxmb_8e4868c5-3b08-4c75-961e-0a85785ca09b/server/0.log"
Sep 07 17:32:54.871762 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:54.871739    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-qq962_b0f248fd-499a-4ecc-a6f0-710b90e8c972/manager/0.log"
Sep 07 17:32:54.877872 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:54.877847    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-qq962_b0f248fd-499a-4ecc-a6f0-710b90e8c972/copy-manifests/0.log"
Sep 07 17:32:55.205564 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:55.205458    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79b64964bc-5r8t4_17326710-e4f3-4be7-81ce-3233a72e297b/maas-api/0.log"
Sep 07 17:32:55.422581 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:55.422549    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813355-77n67_650974b6-0fc5-4f0d-9196-1899fcf46e12/cleanup/0.log"
Sep 07 17:32:56.972725 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:56.972690    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-6dsjq_f7edb08d-7a57-4850-bbb1-e5f60f80eac9/limitador/0.log"
Sep 07 17:32:57.550771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:57.550740    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-f56qm_7b150a20-eebe-49fe-8931-54c747d1ee34/discovery/0.log"
Sep 07 17:32:58.903849 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:32:58.903820    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7tqpg_ff8228f7-38ac-4f36-b625-17e0cf4e4b3f/main/0.log"
Sep 07 17:33:07.831051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:07.831010    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nffqs_eada764a-cb73-4632-940a-c6741d20b9e9/global-pull-secret-syncer/0.log"
Sep 07 17:33:07.999454 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:07.999418    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hqdcj_5ca8bec1-41d5-4b8e-8076-a1457603064a/konnectivity-agent/0.log"
Sep 07 17:33:08.058032 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:08.058001    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-63.ec2.internal_07df7873c55aad720a5c1b311be3ff60/haproxy/0.log"
Sep 07 17:33:13.337298 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:13.337266    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-6dsjq_f7edb08d-7a57-4850-bbb1-e5f60f80eac9/limitador/0.log"
Sep 07 17:33:15.253016 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:15.252981    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8627g_a7ec2fd0-dcbc-4283-8853-3a83f78d0233/node-exporter/0.log"
Sep 07 17:33:15.288512 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:15.288465    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8627g_a7ec2fd0-dcbc-4283-8853-3a83f78d0233/kube-rbac-proxy/0.log"
Sep 07 17:33:15.319804 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:15.319777    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8627g_a7ec2fd0-dcbc-4283-8853-3a83f78d0233/init-textfile/0.log"
Sep 07 17:33:17.271276 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.271245    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"]
Sep 07 17:33:17.271658 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.271604    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a79add5-f44e-4c17-93b9-d5d596d76b97" containerName="maas-api"
Sep 07 17:33:17.271658 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.271617    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a79add5-f44e-4c17-93b9-d5d596d76b97" containerName="maas-api"
Sep 07 17:33:17.271741 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.271686    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a79add5-f44e-4c17-93b9-d5d596d76b97" containerName="maas-api"
Sep 07 17:33:17.274840 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.274819    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.277793 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.277770    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-brnxc\"/\"kube-root-ca.crt\""
Sep 07 17:33:17.277927 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.277819    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-brnxc\"/\"default-dockercfg-6bd8x\""
Sep 07 17:33:17.278692 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.278674    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-brnxc\"/\"openshift-service-ca.crt\""
Sep 07 17:33:17.287719 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.287693    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"]
Sep 07 17:33:17.302965 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.302939    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-lib-modules\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.303095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.302975    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdrs\" (UniqueName: \"kubernetes.io/projected/28bddcbc-091f-4e7f-80bb-ea5c930389ba-kube-api-access-zvdrs\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.303095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.303000    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-podres\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.303095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.303020    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-sys\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.303095 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.303061    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-proc\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.380877 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.380848    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-qp5vf_4d308b19-f8af-43ed-b344-2d49561ec367/networking-console-plugin/0.log"
Sep 07 17:33:17.403582 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403556    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-lib-modules\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.403771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403590    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdrs\" (UniqueName: \"kubernetes.io/projected/28bddcbc-091f-4e7f-80bb-ea5c930389ba-kube-api-access-zvdrs\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.403771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403610    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-podres\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.403771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403631    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-sys\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.403771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-proc\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.403771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403736    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-sys\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.403771 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403752    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-lib-modules\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.404013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403752    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-proc\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.404013 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.403755    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28bddcbc-091f-4e7f-80bb-ea5c930389ba-podres\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.414248 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.414225    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdrs\" (UniqueName: \"kubernetes.io/projected/28bddcbc-091f-4e7f-80bb-ea5c930389ba-kube-api-access-zvdrs\") pod \"perf-node-gather-daemonset-7kv94\" (UID: \"28bddcbc-091f-4e7f-80bb-ea5c930389ba\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.585228 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.585195    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:17.859059 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:17.859030    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"]
Sep 07 17:33:17.860960 ip-10-0-128-63 kubenswrapper[2545]: W0907 17:33:17.860930    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod28bddcbc_091f_4e7f_80bb_ea5c930389ba.slice/crio-3c7ed48477d4c930f076e6227446c8596379d44d093be433a2ba20b2211e0725 WatchSource:0}: Error finding container 3c7ed48477d4c930f076e6227446c8596379d44d093be433a2ba20b2211e0725: Status 404 returned error can't find the container with id 3c7ed48477d4c930f076e6227446c8596379d44d093be433a2ba20b2211e0725
Sep 07 17:33:18.397751 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:18.397706    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94" event={"ID":"28bddcbc-091f-4e7f-80bb-ea5c930389ba","Type":"ContainerStarted","Data":"a06cefbf2cc2cdfb4353021641e19f4626cbd939f31caa3f7e7de7933110f424"}
Sep 07 17:33:18.398150 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:18.397790    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94" event={"ID":"28bddcbc-091f-4e7f-80bb-ea5c930389ba","Type":"ContainerStarted","Data":"3c7ed48477d4c930f076e6227446c8596379d44d093be433a2ba20b2211e0725"}
Sep 07 17:33:18.398150 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:18.397862    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:18.419235 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:18.419186    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94" podStartSLOduration=1.419169816 podStartE2EDuration="1.419169816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:33:18.417443205 +0000 UTC m=+2210.057997998" watchObservedRunningTime="2026-09-07 17:33:18.419169816 +0000 UTC m=+2210.059724612"
Sep 07 17:33:20.499268 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:20.499235    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvgw9_2ae057be-ab5b-4946-9d28-13a52462ef3a/dns/0.log"
Sep 07 17:33:20.521396 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:20.521366    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvgw9_2ae057be-ab5b-4946-9d28-13a52462ef3a/kube-rbac-proxy/0.log"
Sep 07 17:33:20.546657 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:20.546617    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4j6sg_8a3e3dff-1419-40e4-be56-bf9a303ed82d/dns-node-resolver/0.log"
Sep 07 17:33:21.146290 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:21.146251    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5859566cbd-zhczw_0d507fd7-b41f-4429-8329-59be0e1aaaf3/registry/0.log"
Sep 07 17:33:21.192121 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:21.192088    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ctfcw_5e483962-770d-4578-b4b2-e770dff93296/node-ca/0.log"
Sep 07 17:33:22.498710 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:22.498676    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-f56qm_7b150a20-eebe-49fe-8931-54c747d1ee34/discovery/0.log"
Sep 07 17:33:23.613194 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:23.613164    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hxb6x_5f67366e-3648-417f-9eac-c78536eea527/serve-healthcheck-canary/0.log"
Sep 07 17:33:24.322201 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:24.322169    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvhqn_630180ce-c496-42cd-82ba-12657a097968/kube-rbac-proxy/0.log"
Sep 07 17:33:24.352923 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:24.352895    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvhqn_630180ce-c496-42cd-82ba-12657a097968/exporter/0.log"
Sep 07 17:33:24.375419 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:24.375374    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvhqn_630180ce-c496-42cd-82ba-12657a097968/extractor/0.log"
Sep 07 17:33:24.411326 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:24.411300    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-7kv94"
Sep 07 17:33:26.940887 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:26.940857    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5qxmb_8e4868c5-3b08-4c75-961e-0a85785ca09b/server/0.log"
Sep 07 17:33:27.246605 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:27.246499    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-qq962_b0f248fd-499a-4ecc-a6f0-710b90e8c972/manager/0.log"
Sep 07 17:33:27.272636 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:27.272606    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-qq962_b0f248fd-499a-4ecc-a6f0-710b90e8c972/copy-manifests/0.log"
Sep 07 17:33:28.394051 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:28.394023    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-f56qm_7b150a20-eebe-49fe-8931-54c747d1ee34/discovery/0.log"
Sep 07 17:33:28.788699 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:28.788610    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74c754dcfc-xbb6l_2167b5a0-d9d9-4a4a-b8c5-031f3cdb407f/manager/0.log"
Sep 07 17:33:28.811697 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:28.811670    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lkz5v_be1a58dc-b90c-4a2b-9cc3-a100121b2fb5/openshift-lws-operator/0.log"
Sep 07 17:33:30.303788 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:30.303755    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-f56qm_7b150a20-eebe-49fe-8931-54c747d1ee34/discovery/0.log"
Sep 07 17:33:34.070996 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:34.070965    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-2kpz2_d8823593-2552-445d-9b1e-da8907bb9e77/migrator/0.log"
Sep 07 17:33:34.102914 ip-10-0-128-63 kubenswrapper[2545]: I0907 17:33:34.102886    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-2kpz2_d8823593-2552-445d-9b1e-da8907bb9e77/graceful-termination/0.log"