Sep 09 21:38:44.018135 ip-10-0-137-189 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 21:38:44.404748 ip-10-0-137-189 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:38:44.404748 ip-10-0-137-189 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 21:38:44.404748 ip-10-0-137-189 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:38:44.404748 ip-10-0-137-189 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 21:38:44.404748 ip-10-0-137-189 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:38:44.405577 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.404857    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 21:38:44.409536 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409513    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:38:44.409536 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409532    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:38:44.409536 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409537    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:38:44.409536 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409542    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409546    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409551    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409556    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409559    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409563    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409567    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409571    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409576    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409580    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409583    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409587    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409591    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409595    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409598    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409602    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409607    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409611    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409615    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:38:44.409793 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409621    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409627    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409632    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409636    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409640    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409644    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409647    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409661    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409665    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409669    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409673    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409677    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409681    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409686    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409690    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409696    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409700    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409704    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409709    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409713    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:38:44.410596 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409717    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409721    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409726    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409731    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409735    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409740    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409744    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409748    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409752    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409756    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409760    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409767    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409773    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409778    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409782    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409787    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409792    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409797    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409801    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:38:44.411488 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409806    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409826    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409830    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409834    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409839    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409843    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409847    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409851    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409857    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409862    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409866    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409870    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409874    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409878    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409883    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409887    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409894    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409900    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409908    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409912    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:38:44.412414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409916    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409920    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409924    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409928    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409933    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409939    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409943    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409947    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409951    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409955    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409961    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409966    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409970    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409974    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409979    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409984    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409989    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.409993    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411161    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411171    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:38:44.413290 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411177    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411181    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411186    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411190    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411194    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411199    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411204    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411209    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411213    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411218    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411222    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411227    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411232    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411237    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411241    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411245    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411249    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411254    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411258    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411263    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:38:44.414153 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411267    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411271    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411275    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411280    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411284    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411288    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411292    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411298    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411304    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411308    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411312    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411316    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411321    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411325    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411330    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411334    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411338    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411342    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411346    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411350    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:38:44.414780 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411354    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411358    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411362    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411367    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411372    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411377    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411381    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411385    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411389    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411393    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411398    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411402    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411406    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411410    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411414    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411419    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411423    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411427    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411431    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411435    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:38:44.415382 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411439    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411443    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411447    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411451    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411455    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411460    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411464    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411468    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411472    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411476    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411480    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411484    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411488    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411492    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411496    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411499    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411503    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411509    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411513    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:38:44.415924 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411520    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411525    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411530    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411534    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411539    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411543    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411549    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411554    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411558    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411562    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411566    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411570    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411574    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411578    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411585    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411590    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411595    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.411600    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412262    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:38:44.416448 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412271    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412275    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412279    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412283    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412286    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412290    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412294    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412299    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412303    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412307    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412311    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412316    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412320    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412324    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412328    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412332    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412336    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412340    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412344    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412347    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412351    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:38:44.417093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412355    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412359    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412363    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412369    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412375    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412379    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412383    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412388    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412392    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412396    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412401    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412405    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412409    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412413    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412416    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412420    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412425    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412428    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412437    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:38:44.417615 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412442    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412446    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412450    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412454    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412463    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412468    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412475    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412480    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412485    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412489    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412493    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412497    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412502    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412506    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412510    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412514    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412518    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412523    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412527    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:38:44.418182 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412531    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412535    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412539    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412544    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412548    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412553    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412557    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412561    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412565    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412569    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412573    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412577    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412581    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412586    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412590    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412596    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412600    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412604    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412609    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412613    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:38:44.418684 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412618    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412622    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412627    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412631    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412635    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412639    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412643    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412647    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412651    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412655    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412659    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412664    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412668    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412672    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412676    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412681    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412685    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412689    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.412693    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412844    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412910    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 21:38:44.419202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412921    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412928    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412936    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412941    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412949    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412955    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412961    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412966    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412971    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412976    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412990    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412995    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.412999    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413004    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413008    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413013    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413020    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413024    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413029    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413034    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413040    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413045    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413051    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 21:38:44.419721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413055    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413061    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413066    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413070    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413075    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413080    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413084    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413091    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413096    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413100    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413105    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413109    2560 flags.go:64] FLAG: --enable-server="true"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413117    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413128    2560 flags.go:64] FLAG: --event-burst="100"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413133    2560 flags.go:64] FLAG: --event-qps="50"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413137    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413142    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413147    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413153    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413157    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413169    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413175    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413179    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413185    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413190    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 21:38:44.420340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413194    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413198    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413203    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413207    2560 flags.go:64] FLAG: --feature-gates=""
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413213    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413218    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413223    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413227    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413232    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413237    2560 flags.go:64] FLAG: --help="false"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413242    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413247    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413251    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413256    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413262    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413267    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413272    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413276    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413281    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413287    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413291    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413296    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413300    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413304    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 21:38:44.421061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413308    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413313    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413317    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413322    2560 flags.go:64] FLAG: --lock-file=""
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413329    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413334    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413339    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413347    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413352    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413356    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413360    2560 flags.go:64] FLAG: --logging-format="text"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413365    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413371    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413375    2560 flags.go:64] FLAG: --manifest-url=""
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413380    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413387    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413391    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413398    2560 flags.go:64] FLAG: --max-pods="110"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413404    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413409    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413414    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413419    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413424    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413428    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413433    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 21:38:44.421658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413445    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413449    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413457    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413462    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413466    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413474    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413479    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413484    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413489    2560 flags.go:64] FLAG: --port="10250"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413494    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413498    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d4cd9011d8db4cfe"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413504    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413509    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413514    2560 flags.go:64] FLAG: --register-node="true"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413519    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413524    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413529    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413533    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413538    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413544    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413549    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413554    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413558    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413562    2560 flags.go:64] FLAG: --runonce="false"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413567    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 21:38:44.422303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413572    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413579    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413584    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413589    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413594    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413599    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413604    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413608    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413613    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413619    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413624    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413628    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413633    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413638    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413646    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413651    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413656    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413666    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413670    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413675    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413687    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413692    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413697    2560 flags.go:64] FLAG: --v="2"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413703    2560 flags.go:64] FLAG: --version="false"
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413709    2560 flags.go:64] FLAG: --vmodule=""
Sep 09 21:38:44.422938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413715    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.413720    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413948    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413956    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413961    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413966    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413973    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413979    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413985    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413990    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413994    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.413998    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414002    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414007    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414011    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414015    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414021    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414025    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414028    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414033    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:38:44.423537 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414036    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414040    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414044    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414049    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414061    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414065    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414069    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414073    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414077    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414082    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414086    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414090    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414094    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414098    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414102    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414106    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414110    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414114    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414118    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:38:44.424093 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414122    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414128    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414132    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414136    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414140    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414144    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414149    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414152    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414156    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414162    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414166    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414170    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414174    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414180    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414185    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414190    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414195    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414200    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414204    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414209    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:38:44.424563 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414213    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414218    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414222    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414227    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414231    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414237    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414244    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414249    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414254    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414258    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414262    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414266    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414270    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414277    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414282    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414286    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414290    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414294    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414298    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:38:44.425142 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414303    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414307    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414313    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414317    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414322    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414326    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414330    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414334    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414338    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414342    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414346    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414350    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414355    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414358    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414363    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414367    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414378    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414382    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414386    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414390    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:38:44.425604 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414394    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414398    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.414402    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.415133    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.422600    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.422617    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.422638    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.422647    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422708    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422714    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422717    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422719    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422722    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422724    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422727    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:38:44.426134 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422730    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422733    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422735    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422738    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422740    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422743    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422745    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422748    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422750    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422753    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422757    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422760    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422763    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422766    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422768    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422770    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422773    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422775    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422778    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422780    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:38:44.426510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422783    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422785    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422795    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422798    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422800    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422803    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422806    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422824    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422827    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422829    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422832    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422835    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422837    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422840    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422842    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422845    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422847    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422850    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422853    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422855    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:38:44.427017 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422858    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422860    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422863    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422865    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422867    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422870    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422873    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422875    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422877    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422880    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422882    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422885    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422887    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422890    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422893    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422901    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422904    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422908    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422912    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:38:44.427533 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422915    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422917    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422920    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422923    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422925    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422928    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422931    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422933    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422935    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422939    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422942    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422944    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422947    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422949    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422952    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422954    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422957    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422960    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422962    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422965    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:38:44.428013 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422967    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422970    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422972    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422975    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422977    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422980    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422982    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422986    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422988    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.422997    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423001    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423003    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423006    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.423011    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:38:44.428510 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423168    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423173    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423177    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423180    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423182    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423185    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423187    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423190    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423192    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423195    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423197    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423200    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423202    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423204    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423207    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423215    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423219    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423222    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423225    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:38:44.428887 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423228    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423231    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423233    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423236    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423238    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423241    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423244    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423247    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423249    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423257    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423260    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423263    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423265    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423267    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423270    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423272    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423275    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423277    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423279    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423282    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:38:44.429349 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423284    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423289    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423291    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423293    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423296    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423298    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423301    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423303    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423306    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423308    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423310    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423314    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423318    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423320    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423323    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423325    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423328    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423331    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423334    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:38:44.429950 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423336    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423339    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423346    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423349    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423352    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423354    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423356    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423359    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423361    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423363    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423366    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423368    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423370    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423373    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423375    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423377    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423380    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423382    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423385    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:38:44.430434 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423389    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423392    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423395    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423398    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423400    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423402    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423405    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423407    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423409    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423412    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423414    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423416    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423419    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423422    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423424    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423426    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423434    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423437    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423439    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423442    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:38:44.430906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:44.423444    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.423448    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.423575    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.427009    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.427833    2560 server.go:1019] "Starting client certificate rotation"
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.427934    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.427968    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 21:38:44.431416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.431245    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 21:38:44.435060 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.435041    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 21:38:44.444373 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.444351    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 09 21:38:44.448783 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.448764    2560 log.go:25] "Validated CRI v1 image API"
Sep 09 21:38:44.449660 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.449642    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 21:38:44.453222 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.453200    2560 fs.go:135] Filesystem UUIDs: map[575f44ef-58ad-4fe8-be88-ea4911c3ae5b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8a0aba32-b08a-464b-b221-ca0aa262caa6:/dev/nvme0n1p3]
Sep 09 21:38:44.453285 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.453222    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 21:38:44.458322 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.458205    2560 manager.go:216] Machine: {Timestamp:2026-09-09 21:38:44.456967879 +0000 UTC m=+0.324282444 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3085429 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f4fdf01defc84ab4e03f4cb0c7062 SystemUUID:ec2f4fdf-01de-fc84-ab4e-03f4cb0c7062 BootID:5e4d9654-01d0-4608-99e6-a0640871457d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:9a:1e:4e:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:9a:1e:4e:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:8b:13:b3:1e:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 21:38:44.458322 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.458316    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 21:38:44.458430 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.458404    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 21:38:44.459915 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.459897    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 21:38:44.461370 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.461340    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 21:38:44.461520 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.461374    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 21:38:44.462105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.462093    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 21:38:44.462138 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.462108    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 21:38:44.462138 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.462117    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 21:38:44.463824 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.463802    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 21:38:44.464984 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.464973    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 21:38:44.467820 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.467795    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 21:38:44.467943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.467933    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 21:38:44.467987 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.467965    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 21:38:44.467987 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.467976    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 21:38:44.468073 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.467997    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 21:38:44.468073 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.468024    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 09 21:38:44.468073 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.468034    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 21:38:44.468415 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.468402    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 21:38:44.468470 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.468420    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 21:38:44.470702 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.470688    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 21:38:44.473105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473091    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 21:38:44.473160 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473123    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 21:38:44.473296 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473287    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 21:38:44.473328 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473302    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 21:38:44.473359 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473328    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 21:38:44.473359 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473334    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 21:38:44.473359 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473343    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 21:38:44.473359 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473351    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 21:38:44.473936 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473917    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 21:38:44.473936 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473937    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 21:38:44.473936 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473944    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 21:38:44.474030 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473950    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 21:38:44.474030 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473964    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 21:38:44.474030 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.473972    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 21:38:44.475409 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.475395    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 21:38:44.475470 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.475412    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 21:38:44.477397 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.477353    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 21:38:44.477494 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.477449    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 21:38:44.479674 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.479659    2560 server.go:1268] "Started kubelet"
Sep 09 21:38:44.479789 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.479761    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 21:38:44.479884 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.479801    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 21:38:44.479940 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.479892    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 21:38:44.479940 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.479856    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 21:38:44.480541 ip-10-0-137-189 systemd[1]: Started Kubernetes Kubelet.
Sep 09 21:38:44.481477 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.481461    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 21:38:44.482485 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.482466    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 21:38:44.484629 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.484602    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 21:38:44.485757 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.485733    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wt5cq"
Sep 09 21:38:44.486962 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.486945    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 21:38:44.486962 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.486958    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 21:38:44.487088 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.487058    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:44.487673 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487564    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 21:38:44.487673 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487607    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 21:38:44.487673 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487628    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 21:38:44.487861 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487719    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 21:38:44.487861 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487728    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 21:38:44.487861 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487739    2560 factory.go:55] Registering systemd factory
Sep 09 21:38:44.487861 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487767    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 09 21:38:44.488047 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.487996    2560 factory.go:153] Registering CRI-O factory
Sep 09 21:38:44.488047 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.488011    2560 factory.go:223] Registration of the crio container factory successfully
Sep 09 21:38:44.488127 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.488065    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 21:38:44.488127 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.488083    2560 factory.go:103] Registering Raw factory
Sep 09 21:38:44.488211 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.488133    2560 manager.go:1196] Started watching for new ooms in manager
Sep 09 21:38:44.488368 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.487418    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-189.ec2.internal.18d3c4db9b5c64f1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-189.ec2.internal,UID:ip-10-0-137-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-189.ec2.internal,},FirstTimestamp:2026-09-09 21:38:44.479624433 +0000 UTC m=+0.346938997,LastTimestamp:2026-09-09 21:38:44.479624433 +0000 UTC m=+0.346938997,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-189.ec2.internal,}"
Sep 09 21:38:44.488733 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.488720    2560 manager.go:349] Starting recovery of all containers
Sep 09 21:38:44.492442 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.492423    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wt5cq"
Sep 09 21:38:44.498738 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.498714    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:44.501019 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.501004    2560 manager.go:354] Recovery completed
Sep 09 21:38:44.501069 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.501020    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-189.ec2.internal\" not found" node="ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.505852 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.505838    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.507626 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.507608    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.507699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.507650    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.507699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.507660    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.508360 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.508344    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 21:38:44.508360 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.508357    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 21:38:44.508461 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.508358    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.508461 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.508377    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 21:38:44.509202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.509185    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.509270 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.509213    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.509270 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.509223    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.509658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.509647    2560 policy_none.go:49] "None policy: Start"
Sep 09 21:38:44.509686 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.509664    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 21:38:44.509686 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.509674    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 21:38:44.510668 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.510658    2560 policy_none.go:47] "Start"
Sep 09 21:38:44.556449 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.556431    2560 manager.go:337] "Starting Device Plugin manager"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.556482    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.556496    2560 server.go:87] "Starting device plugin registration server"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.556850    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.556861    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.556951    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.557045    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.557054    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.557612    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 21:38:44.565280 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.557656    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:44.595785 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.595746    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 21:38:44.597104 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.597088    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 21:38:44.597191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.597144    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 21:38:44.597191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.597174    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 21:38:44.597288 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.597222    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 21:38:44.599494 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.599476    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:44.657757 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.657653    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.659092 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.659073    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.659204 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.659104    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.659204 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.659121    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.659204 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.659144    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.667220 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.667200    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.667348 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.667230    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-189.ec2.internal\": node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:44.682104 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.682082    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:44.697692 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.697661    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"]
Sep 09 21:38:44.697826 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.697731    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.699263 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.699248    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.699346 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.699278    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.699346 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.699297    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.700511 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.700499    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.700645 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.700633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.700695 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.700660    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.701288 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.701272    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.701361 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.701302    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.701361 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.701312    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.701361 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.701280    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.701460 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.701375    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.701460 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.701386    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.702408 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.702396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.702474 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.702418    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:38:44.703055 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.703039    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:38:44.703114 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.703064    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:38:44.703114 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.703074    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:38:44.729667 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.729635    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-189.ec2.internal\" not found" node="ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.734331 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.734308    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-189.ec2.internal\" not found" node="ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.783169 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.783136    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:44.790224 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.790198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1926bfff66bd4bd5a020ed2b08e0a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal\" (UID: \"7b1926bfff66bd4bd5a020ed2b08e0a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.790294 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.790231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/abe920e35dcb9eb57e7250baf75a38c8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-189.ec2.internal\" (UID: \"abe920e35dcb9eb57e7250baf75a38c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.790294 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.790250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1926bfff66bd4bd5a020ed2b08e0a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal\" (UID: \"7b1926bfff66bd4bd5a020ed2b08e0a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.883579 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.883528    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:44.890920 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.890894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1926bfff66bd4bd5a020ed2b08e0a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal\" (UID: \"7b1926bfff66bd4bd5a020ed2b08e0a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.891059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.890933    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1926bfff66bd4bd5a020ed2b08e0a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal\" (UID: \"7b1926bfff66bd4bd5a020ed2b08e0a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.891059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.890941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1926bfff66bd4bd5a020ed2b08e0a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal\" (UID: \"7b1926bfff66bd4bd5a020ed2b08e0a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.891059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.890975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/abe920e35dcb9eb57e7250baf75a38c8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-189.ec2.internal\" (UID: \"abe920e35dcb9eb57e7250baf75a38c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.891059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.891008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1926bfff66bd4bd5a020ed2b08e0a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal\" (UID: \"7b1926bfff66bd4bd5a020ed2b08e0a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.891059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:44.891012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/abe920e35dcb9eb57e7250baf75a38c8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-189.ec2.internal\" (UID: \"abe920e35dcb9eb57e7250baf75a38c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:44.984420 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:44.984358    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:45.033897 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.033865    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:45.037784 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.037703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:45.084980 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.084934    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:45.185489 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.185449    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:45.286085 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.285998    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-189.ec2.internal\" not found"
Sep 09 21:38:45.289916 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.289899    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:45.387134 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.387093    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:45.396593 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.396564    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 21:38:45.398578 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.398560    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal"
Sep 09 21:38:45.407864 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.407841    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 21:38:45.428058 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.428017    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 21:38:45.428264 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.428242    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 21:38:45.428321 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.428244    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 21:38:45.428321 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.428242    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 21:38:45.468376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.468343    2560 apiserver.go:52] "Watching apiserver"
Sep 09 21:38:45.484047 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.484014    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 21:38:45.484483 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.484458    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-6xrgb","openshift-multus/multus-2c9pz","openshift-multus/network-metrics-daemon-xmtrr","openshift-network-diagnostics/network-check-target-6g6lp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm","openshift-dns/node-resolver-pzrbv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal","openshift-multus/multus-additional-cni-plugins-6pwpl","openshift-network-operator/iptables-alerter-x7pnf","openshift-ovn-kubernetes/ovnkube-node-dp6d5","kube-system/global-pull-secret-syncer-wln9x","kube-system/konnectivity-agent-f7jxd","kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9sscb"]
Sep 09 21:38:45.486073 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.486052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:45.486161 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.486121    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:38:45.487286 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.487267    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 21:38:45.487368 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.487328    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.488524 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.488502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:45.488627 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.488592    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:45.489461 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.489436    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.489554 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.489520    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 21:38:45.489932 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.489914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.490155 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.490135    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.490257 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.490241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pwz2d\""
Sep 09 21:38:45.492449 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.491914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.492449 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.492431    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.492593 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.492447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hczq7\""
Sep 09 21:38:45.492923 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.492905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.493334 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493315    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 21:38:45.493493 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:45.493556 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0563449-2eaa-4a6c-9bad-0adf5f89972c-host\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.493614 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0563449-2eaa-4a6c-9bad-0adf5f89972c-serviceca\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.493661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w54qk\" (UniqueName: \"kubernetes.io/projected/f0563449-2eaa-4a6c-9bad-0adf5f89972c-kube-api-access-w54qk\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.493744 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlbrf\" (UniqueName: \"kubernetes.io/projected/8511045c-ea59-4fae-8704-f6e3c9fb5931-kube-api-access-vlbrf\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:45.493800 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.493785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:45.494305 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.494261    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 21:33:45 +0000 UTC" deadline="2028-05-07 07:01:39.868109241 +0000 UTC"
Sep 09 21:38:45.494366 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.494306    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14529h22m54.373807415s"
Sep 09 21:38:45.494597 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.494541    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.494712 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.494639    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.495261 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.494868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.495261 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.495011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sllv9\""
Sep 09 21:38:45.496278 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.496262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.496533 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.496510    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 21:38:45.496842 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.496824    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.496931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.496897    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2qpx5\""
Sep 09 21:38:45.497223 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.497207    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.497273 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.497219    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 21:38:45.497273 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.497207    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 21:38:45.497729 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.497714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.497842 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.497827    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 21:38:45.498113 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.498095    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jk262\""
Sep 09 21:38:45.498191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.498183    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 21:38:45.499215 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.499197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.499536 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.499512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h5c9m\""
Sep 09 21:38:45.499736 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.499714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.499977 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.499961    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.500059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.500022    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 21:38:45.500427 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.500413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.500498 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.500478    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:45.501130 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.501115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.501130 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.501134    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 21:38:45.501302 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.501198    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 21:38:45.501433 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.501417    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.501588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.501574    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 21:38:45.501739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.501725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.502079 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.502061    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 21:38:45.502158 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.502062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t2scw\""
Sep 09 21:38:45.503218 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.503197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.503424 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.503407    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 21:38:45.503701 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.503685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 21:38:45.503778 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.503737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dsvkz\""
Sep 09 21:38:45.504759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.504744    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvrhq\""
Sep 09 21:38:45.505070 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.505054    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 21:38:45.505131 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.505054    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:38:45.519869 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.519846    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qzb9"
Sep 09 21:38:45.527655 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.527634    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qzb9"
Sep 09 21:38:45.588679 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.588654    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 21:38:45.594152 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-run-netns\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594289 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-cni-bin\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594289 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-env-overrides\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594289 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-modprobe-d\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.594289 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-socket-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.594289 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-daemon-config\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.594289 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-ovn\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-netns\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70a8523f-369e-42d2-9cd2-63887cba73ba-konnectivity-ca\") pod \"konnectivity-agent-f7jxd\" (UID: \"70a8523f-369e-42d2-9cd2-63887cba73ba\") " pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-cnibin\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovnkube-script-lib\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0563449-2eaa-4a6c-9bad-0adf5f89972c-serviceca\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.594570 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-hosts-file\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovn-node-metrics-cert\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.594581    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594599    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-var-lib-kubelet\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-socket-dir-parent\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.594658    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:38:46.094634623 +0000 UTC m=+1.961949198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlbrf\" (UniqueName: \"kubernetes.io/projected/8511045c-ea59-4fae-8704-f6e3c9fb5931-kube-api-access-vlbrf\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-cni-netd\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-systemd\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-sys\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-lib-modules\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-var-lib-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.594992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.594986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovnkube-config\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-cni-bin\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0563449-2eaa-4a6c-9bad-0adf5f89972c-serviceca\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-kubelet\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-slash\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysconfig\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ae5ea9b-9a01-4422-978e-ed5996f049d3-tmp\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-registration-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-hostroot\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-etc-kubernetes\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8w5\" (UniqueName: \"kubernetes.io/projected/e149c329-52fa-47fb-8159-ae243ecb1eab-kube-api-access-hc8w5\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0563449-2eaa-4a6c-9bad-0adf5f89972c-host\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w54qk\" (UniqueName: \"kubernetes.io/projected/f0563449-2eaa-4a6c-9bad-0adf5f89972c-kube-api-access-w54qk\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr4n9\" (UniqueName: \"kubernetes.io/projected/980ea599-e626-41a3-819e-fb3058869c07-kube-api-access-rr4n9\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0563449-2eaa-4a6c-9bad-0adf5f89972c-host\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-log-socket\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.595405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-sys-fs\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysctl-conf\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5f750cd-1fbf-4b72-9d6e-86229e40242e-cni-binary-copy\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-systemd-units\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-kubernetes\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-device-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbb8n\" (UniqueName: \"kubernetes.io/projected/007ecd66-abce-4977-b594-bf48e4f8358b-kube-api-access-dbb8n\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-k8s-cni-cncf-io\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-system-cni-dir\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5x2x\" (UniqueName: \"kubernetes.io/projected/fe69ae00-c16f-4248-9d9c-74166f95c82d-kube-api-access-j5x2x\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-conf-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.595980 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.595966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssh7t\" (UniqueName: \"kubernetes.io/projected/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-kube-api-access-ssh7t\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-kubelet\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8b67\" (UniqueName: \"kubernetes.io/projected/0ae5ea9b-9a01-4422-978e-ed5996f049d3-kube-api-access-p8b67\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-cnibin\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-tuned\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvsgt\" (UniqueName: \"kubernetes.io/projected/e5f750cd-1fbf-4b72-9d6e-86229e40242e-kube-api-access-tvsgt\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e149c329-52fa-47fb-8159-ae243ecb1eab-iptables-alerter-script\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fef28b72-2502-4a45-bd66-f7dc329645ce-kubelet-config\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fef28b72-2502-4a45-bd66-f7dc329645ce-dbus\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-tmp-dir\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-node-log\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysctl-d\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-host\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.596479 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70a8523f-369e-42d2-9cd2-63887cba73ba-agent-certs\") pod \"konnectivity-agent-f7jxd\" (UID: \"70a8523f-369e-42d2-9cd2-63887cba73ba\") " pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-run\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-system-cni-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-cni-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-cni-multus\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e149c329-52fa-47fb-8159-ae243ecb1eab-host-slash\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-systemd\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-etc-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.597027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.596468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-multus-certs\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.600542 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.600519    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 21:38:45.600846 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.600825    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:38:45.600951 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.600854    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:38:45.600951 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.600870    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:45.601031 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.600968    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:38:46.100948427 +0000 UTC m=+1.968263002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:45.604138 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.604118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlbrf\" (UniqueName: \"kubernetes.io/projected/8511045c-ea59-4fae-8704-f6e3c9fb5931-kube-api-access-vlbrf\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:45.604216 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.604134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w54qk\" (UniqueName: \"kubernetes.io/projected/f0563449-2eaa-4a6c-9bad-0adf5f89972c-kube-api-access-w54qk\") pod \"node-ca-6xrgb\" (UID: \"f0563449-2eaa-4a6c-9bad-0adf5f89972c\") " pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.645656 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.645616    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1926bfff66bd4bd5a020ed2b08e0a1.slice/crio-2a92712b3bf4e97ec4e604289271abf789b5198d25033cfdbd0154572e925dae WatchSource:0}: Error finding container 2a92712b3bf4e97ec4e604289271abf789b5198d25033cfdbd0154572e925dae: Status 404 returned error can't find the container with id 2a92712b3bf4e97ec4e604289271abf789b5198d25033cfdbd0154572e925dae
Sep 09 21:38:45.650019 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.650001    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:38:45.697602 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssh7t\" (UniqueName: \"kubernetes.io/projected/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-kube-api-access-ssh7t\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.697602 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-kubelet\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8b67\" (UniqueName: \"kubernetes.io/projected/0ae5ea9b-9a01-4422-978e-ed5996f049d3-kube-api-access-p8b67\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-cnibin\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-tuned\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvsgt\" (UniqueName: \"kubernetes.io/projected/e5f750cd-1fbf-4b72-9d6e-86229e40242e-kube-api-access-tvsgt\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e149c329-52fa-47fb-8159-ae243ecb1eab-iptables-alerter-script\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-kubelet\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fef28b72-2502-4a45-bd66-f7dc329645ce-kubelet-config\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-cnibin\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fef28b72-2502-4a45-bd66-f7dc329645ce-dbus\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fef28b72-2502-4a45-bd66-f7dc329645ce-kubelet-config\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-tmp-dir\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fef28b72-2502-4a45-bd66-f7dc329645ce-dbus\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.697894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-node-log\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysctl-d\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-host\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-node-log\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.697995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70a8523f-369e-42d2-9cd2-63887cba73ba-agent-certs\") pod \"konnectivity-agent-f7jxd\" (UID: \"70a8523f-369e-42d2-9cd2-63887cba73ba\") " pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-run\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-system-cni-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-cni-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-cni-multus\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-host\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e149c329-52fa-47fb-8159-ae243ecb1eab-host-slash\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-tmp-dir\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-systemd\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-etc-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-multus-certs\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-run-netns\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-cni-bin\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-cni-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.698719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-env-overrides\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-modprobe-d\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-run\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-socket-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-cni-multus\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-daemon-config\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e149c329-52fa-47fb-8159-ae243ecb1eab-host-slash\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-systemd\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e149c329-52fa-47fb-8159-ae243ecb1eab-iptables-alerter-script\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-cni-bin\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-ovn\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-multus-certs\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysctl-d\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-netns\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.699543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-run-netns\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-system-cni-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70a8523f-369e-42d2-9cd2-63887cba73ba-konnectivity-ca\") pod \"konnectivity-agent-f7jxd\" (UID: \"70a8523f-369e-42d2-9cd2-63887cba73ba\") " pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-cnibin\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovnkube-script-lib\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-socket-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-etc-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-hosts-file\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-netns\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-modprobe-d\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.698691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovn-node-metrics-cert\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-var-lib-kubelet\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-socket-dir-parent\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-cni-netd\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-systemd\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.700372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-daemon-config\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-sys\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-sys\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-lib-modules\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-var-lib-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovnkube-config\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-cni-bin\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-hosts-file\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699933    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-socket-dir-parent\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-var-lib-kubelet\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-cni-netd\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700024    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70a8523f-369e-42d2-9cd2-63887cba73ba-konnectivity-ca\") pod \"konnectivity-agent-f7jxd\" (UID: \"70a8523f-369e-42d2-9cd2-63887cba73ba\") " pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-systemd\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-env-overrides\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-cnibin\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.701182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-kubelet\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovnkube-script-lib\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-var-lib-openvswitch\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.699796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-lib-modules\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-kubelet\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-slash\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysconfig\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ae5ea9b-9a01-4422-978e-ed5996f049d3-tmp\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-registration-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-hostroot\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-etc-kubernetes\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8w5\" (UniqueName: \"kubernetes.io/projected/e149c329-52fa-47fb-8159-ae243ecb1eab-kube-api-access-hc8w5\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr4n9\" (UniqueName: \"kubernetes.io/projected/980ea599-e626-41a3-819e-fb3058869c07-kube-api-access-rr4n9\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovnkube-config\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-log-socket\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-sys-fs\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700933    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-hostroot\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-var-lib-cni-bin\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysctl-conf\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5f750cd-1fbf-4b72-9d6e-86229e40242e-cni-binary-copy\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-systemd-units\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-registration-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-slash\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-kubernetes\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-device-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysconfig\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbb8n\" (UniqueName: \"kubernetes.io/projected/007ecd66-abce-4977-b594-bf48e4f8358b-kube-api-access-dbb8n\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70a8523f-369e-42d2-9cd2-63887cba73ba-agent-certs\") pod \"konnectivity-agent-f7jxd\" (UID: \"70a8523f-369e-42d2-9cd2-63887cba73ba\") " pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-k8s-cni-cncf-io\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-system-cni-dir\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.702943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-etc-kubernetes\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-log-socket\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.700850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-run-ovn\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5x2x\" (UniqueName: \"kubernetes.io/projected/fe69ae00-c16f-4248-9d9c-74166f95c82d-kube-api-access-j5x2x\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-conf-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-multus-conf-dir\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701435    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-device-dir\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/007ecd66-abce-4977-b594-bf48e4f8358b-sys-fs\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5f750cd-1fbf-4b72-9d6e-86229e40242e-host-run-k8s-cni-cncf-io\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980ea599-e626-41a3-819e-fb3058869c07-system-cni-dir\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.701617    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-sysctl-conf\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:45.701681    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:38:46.201663583 +0000 UTC m=+2.068978150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.701755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-kubernetes\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.702146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5f750cd-1fbf-4b72-9d6e-86229e40242e-cni-binary-copy\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.703822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.702317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980ea599-e626-41a3-819e-fb3058869c07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.704669 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.702400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe69ae00-c16f-4248-9d9c-74166f95c82d-systemd-units\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.704669 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.704537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ae5ea9b-9a01-4422-978e-ed5996f049d3-etc-tuned\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.704669 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.704605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ae5ea9b-9a01-4422-978e-ed5996f049d3-tmp\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.705787 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.705760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe69ae00-c16f-4248-9d9c-74166f95c82d-ovn-node-metrics-cert\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.706306 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.706284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssh7t\" (UniqueName: \"kubernetes.io/projected/3c9d4ca5-2fba-402c-976a-ea2c2d1a285f-kube-api-access-ssh7t\") pod \"node-resolver-pzrbv\" (UID: \"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f\") " pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.706691 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.706675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8b67\" (UniqueName: \"kubernetes.io/projected/0ae5ea9b-9a01-4422-978e-ed5996f049d3-kube-api-access-p8b67\") pod \"tuned-9sscb\" (UID: \"0ae5ea9b-9a01-4422-978e-ed5996f049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.707842 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.707798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvsgt\" (UniqueName: \"kubernetes.io/projected/e5f750cd-1fbf-4b72-9d6e-86229e40242e-kube-api-access-tvsgt\") pod \"multus-2c9pz\" (UID: \"e5f750cd-1fbf-4b72-9d6e-86229e40242e\") " pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.709488 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.709466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr4n9\" (UniqueName: \"kubernetes.io/projected/980ea599-e626-41a3-819e-fb3058869c07-kube-api-access-rr4n9\") pod \"multus-additional-cni-plugins-6pwpl\" (UID: \"980ea599-e626-41a3-819e-fb3058869c07\") " pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.709739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.709711    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5x2x\" (UniqueName: \"kubernetes.io/projected/fe69ae00-c16f-4248-9d9c-74166f95c82d-kube-api-access-j5x2x\") pod \"ovnkube-node-dp6d5\" (UID: \"fe69ae00-c16f-4248-9d9c-74166f95c82d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.709858 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.709841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbb8n\" (UniqueName: \"kubernetes.io/projected/007ecd66-abce-4977-b594-bf48e4f8358b-kube-api-access-dbb8n\") pod \"aws-ebs-csi-driver-node-b5cdm\" (UID: \"007ecd66-abce-4977-b594-bf48e4f8358b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.709938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.709921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8w5\" (UniqueName: \"kubernetes.io/projected/e149c329-52fa-47fb-8159-ae243ecb1eab-kube-api-access-hc8w5\") pod \"iptables-alerter-x7pnf\" (UID: \"e149c329-52fa-47fb-8159-ae243ecb1eab\") " pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.804933 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.804855    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:45.826632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.826588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6xrgb"
Sep 09 21:38:45.835453 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.835428    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0563449_2eaa_4a6c_9bad_0adf5f89972c.slice/crio-3cad477593ec3db664f3b606d616ba41240267263143fd5921730678ef462a87 WatchSource:0}: Error finding container 3cad477593ec3db664f3b606d616ba41240267263143fd5921730678ef462a87: Status 404 returned error can't find the container with id 3cad477593ec3db664f3b606d616ba41240267263143fd5921730678ef462a87
Sep 09 21:38:45.840839 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.840823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm"
Sep 09 21:38:45.848716 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.848689    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007ecd66_abce_4977_b594_bf48e4f8358b.slice/crio-7710c7139eceb6304254f84ee544fdb753c30c0d7fab1382a8faa79873a203a9 WatchSource:0}: Error finding container 7710c7139eceb6304254f84ee544fdb753c30c0d7fab1382a8faa79873a203a9: Status 404 returned error can't find the container with id 7710c7139eceb6304254f84ee544fdb753c30c0d7fab1382a8faa79873a203a9
Sep 09 21:38:45.859039 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.859016    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pzrbv"
Sep 09 21:38:45.867113 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.867090    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9d4ca5_2fba_402c_976a_ea2c2d1a285f.slice/crio-6fc9b3a6f8148594badbb0d15e7981a8fc3b16ebaddba27af2f5cbc0ba31f0e9 WatchSource:0}: Error finding container 6fc9b3a6f8148594badbb0d15e7981a8fc3b16ebaddba27af2f5cbc0ba31f0e9: Status 404 returned error can't find the container with id 6fc9b3a6f8148594badbb0d15e7981a8fc3b16ebaddba27af2f5cbc0ba31f0e9
Sep 09 21:38:45.872581 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.872553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2c9pz"
Sep 09 21:38:45.879976 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.879951    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f750cd_1fbf_4b72_9d6e_86229e40242e.slice/crio-91c71716987181b5ced754b2b9a08995316558bf36a3c959ca00c2b316f1ed91 WatchSource:0}: Error finding container 91c71716987181b5ced754b2b9a08995316558bf36a3c959ca00c2b316f1ed91: Status 404 returned error can't find the container with id 91c71716987181b5ced754b2b9a08995316558bf36a3c959ca00c2b316f1ed91
Sep 09 21:38:45.887702 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.887679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6pwpl"
Sep 09 21:38:45.894955 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.894927    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980ea599_e626_41a3_819e_fb3058869c07.slice/crio-86fd2b72039d0185cf189c7f5fa0f01ec8dae7185f3bddd0395ed0c21e4a95b8 WatchSource:0}: Error finding container 86fd2b72039d0185cf189c7f5fa0f01ec8dae7185f3bddd0395ed0c21e4a95b8: Status 404 returned error can't find the container with id 86fd2b72039d0185cf189c7f5fa0f01ec8dae7185f3bddd0395ed0c21e4a95b8
Sep 09 21:38:45.900506 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.900489    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7pnf"
Sep 09 21:38:45.907716 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.907692    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode149c329_52fa_47fb_8159_ae243ecb1eab.slice/crio-f17cb6efa84f1c3abed55fde79309b7a4a8f1700ad41f77e8939343ee275241b WatchSource:0}: Error finding container f17cb6efa84f1c3abed55fde79309b7a4a8f1700ad41f77e8939343ee275241b: Status 404 returned error can't find the container with id f17cb6efa84f1c3abed55fde79309b7a4a8f1700ad41f77e8939343ee275241b
Sep 09 21:38:45.920551 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.920528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:38:45.928388 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.928361    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe69ae00_c16f_4248_9d9c_74166f95c82d.slice/crio-04cbc3654566f824bba111dceb8d744f4a6d28de6cbb1d6e93986b7f4e32cdd1 WatchSource:0}: Error finding container 04cbc3654566f824bba111dceb8d744f4a6d28de6cbb1d6e93986b7f4e32cdd1: Status 404 returned error can't find the container with id 04cbc3654566f824bba111dceb8d744f4a6d28de6cbb1d6e93986b7f4e32cdd1
Sep 09 21:38:45.940917 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.940891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:38:45.948105 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.948058    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a8523f_369e_42d2_9cd2_63887cba73ba.slice/crio-5a20d051367d5a56b1ef2639b70c4c66c0e6441f8ebeb5857fd01647e663747d WatchSource:0}: Error finding container 5a20d051367d5a56b1ef2639b70c4c66c0e6441f8ebeb5857fd01647e663747d: Status 404 returned error can't find the container with id 5a20d051367d5a56b1ef2639b70c4c66c0e6441f8ebeb5857fd01647e663747d
Sep 09 21:38:45.949830 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:45.949788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sscb"
Sep 09 21:38:45.957766 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:45.957743    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae5ea9b_9a01_4422_978e_ed5996f049d3.slice/crio-5d635219fdbb35625e3dc932ec6c3c8ebbcd95fa9fb036a43e05167d39740fc2 WatchSource:0}: Error finding container 5d635219fdbb35625e3dc932ec6c3c8ebbcd95fa9fb036a43e05167d39740fc2: Status 404 returned error can't find the container with id 5d635219fdbb35625e3dc932ec6c3c8ebbcd95fa9fb036a43e05167d39740fc2
Sep 09 21:38:46.103604 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:46.103516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:46.103604 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:46.103583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:46.103802 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:46.103693    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:46.103802 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:46.103696    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:38:46.103802 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:46.103717    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:38:46.103802 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:46.103729    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:46.103802 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:46.103755    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:38:47.103737963 +0000 UTC m=+2.971052532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:46.103802 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:46.103772    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:38:47.103763077 +0000 UTC m=+2.971077630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:47.440268 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:38:47.440047    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe920e35dcb9eb57e7250baf75a38c8.slice/crio-ba01eef91b7763a93850054d4c77f9cd32e9a5552f56d620cf77ab2a12096ec6 WatchSource:0}: Error finding container ba01eef91b7763a93850054d4c77f9cd32e9a5552f56d620cf77ab2a12096ec6: Status 404 returned error can't find the container with id ba01eef91b7763a93850054d4c77f9cd32e9a5552f56d620cf77ab2a12096ec6
Sep 09 21:38:47.516737 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.516708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:47.516901 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:47.516835    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:47.516977 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:47.516904    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:38:48.516887275 +0000 UTC m=+3.071546995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:47.608783 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.608748    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:47.705498 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.705408    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:47.842635 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.842552    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 21:33:46 +0000 UTC" deadline="2028-04-05 18:58:38.346341307 +0000 UTC"
Sep 09 21:38:47.842635 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.842632    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13773h19m50.503713656s"
Sep 09 21:38:47.924614 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.924553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal" event={"ID":"abe920e35dcb9eb57e7250baf75a38c8","Type":"ContainerStarted","Data":"ba01eef91b7763a93850054d4c77f9cd32e9a5552f56d620cf77ab2a12096ec6"}
Sep 09 21:38:47.943392 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.943348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f7jxd" event={"ID":"70a8523f-369e-42d2-9cd2-63887cba73ba","Type":"ContainerStarted","Data":"5a20d051367d5a56b1ef2639b70c4c66c0e6441f8ebeb5857fd01647e663747d"}
Sep 09 21:38:47.949236 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.949195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"04cbc3654566f824bba111dceb8d744f4a6d28de6cbb1d6e93986b7f4e32cdd1"}
Sep 09 21:38:47.967505 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.967329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7pnf" event={"ID":"e149c329-52fa-47fb-8159-ae243ecb1eab","Type":"ContainerStarted","Data":"f17cb6efa84f1c3abed55fde79309b7a4a8f1700ad41f77e8939343ee275241b"}
Sep 09 21:38:47.973015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.972901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerStarted","Data":"86fd2b72039d0185cf189c7f5fa0f01ec8dae7185f3bddd0395ed0c21e4a95b8"}
Sep 09 21:38:47.975387 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.975315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pzrbv" event={"ID":"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f","Type":"ContainerStarted","Data":"6fc9b3a6f8148594badbb0d15e7981a8fc3b16ebaddba27af2f5cbc0ba31f0e9"}
Sep 09 21:38:47.981005 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.980886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm" event={"ID":"007ecd66-abce-4977-b594-bf48e4f8358b","Type":"ContainerStarted","Data":"7710c7139eceb6304254f84ee544fdb753c30c0d7fab1382a8faa79873a203a9"}
Sep 09 21:38:47.983862 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:47.983784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal" event={"ID":"7b1926bfff66bd4bd5a020ed2b08e0a1","Type":"ContainerStarted","Data":"2a92712b3bf4e97ec4e604289271abf789b5198d25033cfdbd0154572e925dae"}
Sep 09 21:38:48.012321 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.012277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sscb" event={"ID":"0ae5ea9b-9a01-4422-978e-ed5996f049d3","Type":"ContainerStarted","Data":"5d635219fdbb35625e3dc932ec6c3c8ebbcd95fa9fb036a43e05167d39740fc2"}
Sep 09 21:38:48.027704 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.027658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2c9pz" event={"ID":"e5f750cd-1fbf-4b72-9d6e-86229e40242e","Type":"ContainerStarted","Data":"91c71716987181b5ced754b2b9a08995316558bf36a3c959ca00c2b316f1ed91"}
Sep 09 21:38:48.035032 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.034992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6xrgb" event={"ID":"f0563449-2eaa-4a6c-9bad-0adf5f89972c","Type":"ContainerStarted","Data":"3cad477593ec3db664f3b606d616ba41240267263143fd5921730678ef462a87"}
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.423741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.423825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.423975    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.424001    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.424016    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.424079    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:38:50.424059324 +0000 UTC m=+4.978719050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.424553    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:48.424687 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.424614    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:38:50.424589677 +0000 UTC m=+4.979249398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:48.525616 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.524962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:48.525616 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.525174    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:48.525616 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.525241    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:38:50.525222027 +0000 UTC m=+5.079881765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:48.843421 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.843297    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 21:33:46 +0000 UTC" deadline="2028-05-25 10:32:08.882999996 +0000 UTC"
Sep 09 21:38:48.843421 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.843336    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14964h53m20.039669024s"
Sep 09 21:38:48.910848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.910812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:48.911053 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.910963    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:48.911377 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.911353    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:48.911529 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.911458    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:48.911608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:48.911538    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:48.911683 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:48.911607    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:38:49.108190 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:49.107849    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:38:50.442342 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:50.442296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:50.442874 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:50.442379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:50.442874 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.442528    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:50.442874 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.442592    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:38:54.442572429 +0000 UTC m=+8.997232169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:50.443188 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.443036    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:38:50.443188 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.443064    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:38:50.443188 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.443078    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:50.443188 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.443129    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:38:54.443113544 +0000 UTC m=+8.997773285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:50.543362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:50.543319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:50.543614 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.543573    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:50.543683 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.543642    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:38:54.543624253 +0000 UTC m=+9.098283986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:50.911204 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:50.911123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:50.911365 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.911282    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:50.911734 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:50.911713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:50.911836 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.911819    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:50.911897 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:50.911884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:50.911986 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:50.911968    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:38:52.911066 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:52.910639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:52.911066 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:52.910767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:52.911066 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:52.910775    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:38:52.911066 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:52.910885    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:52.911066 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:52.910928    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:52.911066 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:52.911006    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:54.480698 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:54.480657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:54.481105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:54.480750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:54.481105 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.480917    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:38:54.481105 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.480936    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:38:54.481105 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.480949    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:54.481105 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.481014    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:39:02.480994831 +0000 UTC m=+17.035654564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:38:54.481420 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.481403    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:54.481475 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.481457    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:02.481441014 +0000 UTC m=+17.036100745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:38:54.581320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:54.581288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:54.581517 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.581493    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:54.581640 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.581624    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:39:02.58159884 +0000 UTC m=+17.136258560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:38:54.910758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:54.910665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:54.910758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:54.910703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:54.910956 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.910833    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:54.910956 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:54.910905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:54.910956 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.910904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:54.911083 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:54.910974    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:38:56.910548 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:56.910513    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:56.910548 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:56.910544    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:56.911156 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:56.910568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:56.911156 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:56.910646    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:56.911156 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:56.910768    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:56.911156 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:56.910845    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:38:58.910950 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:58.910909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:38:58.911349 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:58.910913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:38:58.911349 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:58.911035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:38:58.911349 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:38:58.911045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:38:58.911349 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:58.911136    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:38:58.911349 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:38:58.911213    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:00.910418 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:00.910380    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:00.910418 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:00.910412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:00.910940 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:00.910392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:00.910940 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:00.910527    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:00.910940 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:00.910693    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:00.910940 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:00.910782    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:02.546793 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:02.546704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:02.546793 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:02.546768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:02.547237 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.546843    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:39:02.547237 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.546878    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:39:02.547237 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.546893    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:39:02.547237 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.546902    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:39:02.547237 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.546919    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:18.546901737 +0000 UTC m=+33.101561455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:39:02.547237 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.546940    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:39:18.546928124 +0000 UTC m=+33.101587855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:39:02.647946 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:02.647907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:02.648111 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.648085    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:39:02.648192 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.648161    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:39:18.648144276 +0000 UTC m=+33.202803994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:39:02.911043 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:02.910954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:02.911206 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:02.910954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:02.911206 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.911098    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:02.911334 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.911197    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:02.911334 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:02.910965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:02.911512 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:02.911338    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:04.910346 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:04.910305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:04.910841 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:04.910326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:04.910841 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:04.910446    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:04.910841 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:04.910459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:04.910841 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:04.910591    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:04.910841 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:04.910682    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:06.911441 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:06.910947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:06.912063 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:06.911564    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:06.912063 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:06.911015    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:06.912063 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:06.912007    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:06.912321 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:06.912297    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:06.912457 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:06.912400    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:07.094848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.094516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal" event={"ID":"abe920e35dcb9eb57e7250baf75a38c8","Type":"ContainerStarted","Data":"24702762aa4dd07b5949acdca16038b2db8a8e192bf4967e2728105ac850d9fd"}
Sep 09 21:39:07.096713 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.096214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f7jxd" event={"ID":"70a8523f-369e-42d2-9cd2-63887cba73ba","Type":"ContainerStarted","Data":"b681f493f4955149f012cf914849193d6f111c656827047cf69d08c1d55dd652"}
Sep 09 21:39:07.099207 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.099180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"8340b1e42cd86bc732a086e5865306cfdb1e971a67cbe11e127490d4ea533443"}
Sep 09 21:39:07.099311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.099244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"29ff94698f6ed3b0cd70a798f9a3c0ecd61d38857e98872057fbc497666cc9c9"}
Sep 09 21:39:07.099311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.099274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"0d89ec3bac6c7f2ce8328aa7a3106f9dd04791e7e7423bb2f721e5fbbe14b950"}
Sep 09 21:39:07.099311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.099302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"25f11e0620db656b737a164a5c7af2e4f5fb181fb8fcfcd97a636a715fec2bd3"}
Sep 09 21:39:07.099439 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.099330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"a8714eca051c230d9431e35498453182499748237622c006b144d1aa14f63ea9"}
Sep 09 21:39:07.102261 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.101629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerStarted","Data":"b61e7f24da8af6fca2653d880ed2e1d7c954a5e610be508bcfcd732f3085bcf9"}
Sep 09 21:39:07.103296 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.103278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pzrbv" event={"ID":"3c9d4ca5-2fba-402c-976a-ea2c2d1a285f","Type":"ContainerStarted","Data":"517c41c5680bd2c6adb985ef4fd896424e0dba4a1f2b4d686b15ba06b2a2f6ed"}
Sep 09 21:39:07.105487 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.105438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm" event={"ID":"007ecd66-abce-4977-b594-bf48e4f8358b","Type":"ContainerStarted","Data":"2f84c18ea2a67f6915fb70bc27c1dd134281e2117ae4e41838c6bdd057c57f72"}
Sep 09 21:39:07.110932 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.108598    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-189.ec2.internal" podStartSLOduration=21.108581404 podStartE2EDuration="21.108581404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:07.108518071 +0000 UTC m=+21.663177812" watchObservedRunningTime="2026-09-09 21:39:07.108581404 +0000 UTC m=+21.663241145"
Sep 09 21:39:07.113050 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.113025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sscb" event={"ID":"0ae5ea9b-9a01-4422-978e-ed5996f049d3","Type":"ContainerStarted","Data":"bb16e7fd3b67de43bccb89258acd9025d1f7aeb1a42c1efe3262f2d136f57c99"}
Sep 09 21:39:07.114432 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.114409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2c9pz" event={"ID":"e5f750cd-1fbf-4b72-9d6e-86229e40242e","Type":"ContainerStarted","Data":"02902d4e8c49e6298c35e6b618eeef688485381d268eaff1b656b39bf12a2498"}
Sep 09 21:39:07.115553 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.115534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6xrgb" event={"ID":"f0563449-2eaa-4a6c-9bad-0adf5f89972c","Type":"ContainerStarted","Data":"985804af889ff78b757ba30677030bcab8a02d49528d585d424946d0fa13409f"}
Sep 09 21:39:07.122875 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.122819    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pzrbv" podStartSLOduration=1.901723345 podStartE2EDuration="21.122805875s" totalImagesPullingTime="19.22108253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:07.12219289 +0000 UTC m=+21.676852650" watchObservedRunningTime="2026-09-09 21:39:07.122805875 +0000 UTC m=+21.677465615"
Sep 09 21:39:07.153430 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.153337    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f7jxd" podStartSLOduration=2.043134439 podStartE2EDuration="21.153321923s" totalImagesPullingTime="19.110187484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:07.153142808 +0000 UTC m=+21.707802547" watchObservedRunningTime="2026-09-09 21:39:07.153321923 +0000 UTC m=+21.707981662"
Sep 09 21:39:07.167626 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.167576    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sscb" podStartSLOduration=2.036002076 podStartE2EDuration="21.167558964s" totalImagesPullingTime="19.131556888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:07.167175574 +0000 UTC m=+21.721835313" watchObservedRunningTime="2026-09-09 21:39:07.167558964 +0000 UTC m=+21.722218703"
Sep 09 21:39:07.179668 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.179627    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6xrgb" podStartSLOduration=2.928474129 podStartE2EDuration="22.179611212s" totalImagesPullingTime="19.251137083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:07.179054291 +0000 UTC m=+21.733714229" watchObservedRunningTime="2026-09-09 21:39:07.179611212 +0000 UTC m=+21.734270951"
Sep 09 21:39:07.200050 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:07.200006    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2c9pz" podStartSLOduration=1.702969218 podStartE2EDuration="21.19998777s" totalImagesPullingTime="19.497018552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:07.19985024 +0000 UTC m=+21.754509979" watchObservedRunningTime="2026-09-09 21:39:07.19998777 +0000 UTC m=+21.754647511"
Sep 09 21:39:08.120629 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.120591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"6c34a7c1b85032e78128b10cfb22bcd64f1919016467a24ae0db1be4033860e7"}
Sep 09 21:39:08.122145 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.122122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7pnf" event={"ID":"e149c329-52fa-47fb-8159-ae243ecb1eab","Type":"ContainerStarted","Data":"f6a46d7d1d884728e8c27488c28c636c490cf41d2ba3f98c839e59d63203d9e6"}
Sep 09 21:39:08.123587 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.123566    2560 generic.go:356] "Generic (PLEG): container finished" podID="980ea599-e626-41a3-819e-fb3058869c07" containerID="b61e7f24da8af6fca2653d880ed2e1d7c954a5e610be508bcfcd732f3085bcf9" exitCode=0
Sep 09 21:39:08.123665 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.123633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerDied","Data":"b61e7f24da8af6fca2653d880ed2e1d7c954a5e610be508bcfcd732f3085bcf9"}
Sep 09 21:39:08.125188 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.125159    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b1926bfff66bd4bd5a020ed2b08e0a1" containerID="88b893f43a774ada96faf86f27b9511db965ebe85b87b60cec3a8124dc44119c" exitCode=0
Sep 09 21:39:08.125305 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.125256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal" event={"ID":"7b1926bfff66bd4bd5a020ed2b08e0a1","Type":"ContainerDied","Data":"88b893f43a774ada96faf86f27b9511db965ebe85b87b60cec3a8124dc44119c"}
Sep 09 21:39:08.136515 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.136452    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7pnf" podStartSLOduration=2.957318439 podStartE2EDuration="22.136434504s" totalImagesPullingTime="19.179116065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:08.135975909 +0000 UTC m=+22.690635649" watchObservedRunningTime="2026-09-09 21:39:08.136434504 +0000 UTC m=+22.691094244"
Sep 09 21:39:08.910493 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.910450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:08.910720 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.910452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:08.910720 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:08.910565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:08.910720 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:08.910451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:08.910720 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:08.910634    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:08.910865 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:08.910716    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:09.080644 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.080605    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 21:39:09.129955 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.129917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm" event={"ID":"007ecd66-abce-4977-b594-bf48e4f8358b","Type":"ContainerStarted","Data":"111a64ecc51cf788066ca6ec126348609e10308a2f623ef17b6217bd787e2c6f"}
Sep 09 21:39:09.132322 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.132292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal" event={"ID":"7b1926bfff66bd4bd5a020ed2b08e0a1","Type":"ContainerStarted","Data":"9053bef9f22f9867a12ed86114b66bc9e5c82100b793e9f17c5438635f4c500d"}
Sep 09 21:39:09.146499 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.146425    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-189.ec2.internal" podStartSLOduration=23.146407227 podStartE2EDuration="23.146407227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:09.145805105 +0000 UTC m=+23.700464845" watchObservedRunningTime="2026-09-09 21:39:09.146407227 +0000 UTC m=+23.701066967"
Sep 09 21:39:09.883854 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.883525    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T21:39:09.080629482Z","UUID":"41fc63df-9445-40d3-85fb-df93e049e17f","Handler":null,"Name":"","Endpoint":""}
Sep 09 21:39:09.885429 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.885400    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 21:39:09.885608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:09.885444    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 21:39:10.140620 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:10.140530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"c65798e585a32a88411a89047da38f28178677b5a423b4aba798265dde6c0cbd"}
Sep 09 21:39:10.910510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:10.910477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:10.910510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:10.910511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:10.910787 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:10.910483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:10.910787 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:10.910639    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:10.910787 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:10.910721    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:10.910953 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:10.910795    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:11.145691 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:11.145653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm" event={"ID":"007ecd66-abce-4977-b594-bf48e4f8358b","Type":"ContainerStarted","Data":"0216e3969b9b75c5fbf0d5a8af4df5775d286b4e6b86773b8a097e6c0a3b9f21"}
Sep 09 21:39:11.161218 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:11.161105    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5cdm" podStartSLOduration=3.082247863 podStartE2EDuration="25.161085014s" totalImagesPullingTime="22.078837151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:11.159633444 +0000 UTC m=+25.714293197" watchObservedRunningTime="2026-09-09 21:39:11.161085014 +0000 UTC m=+25.715744754"
Sep 09 21:39:11.509266 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:11.508906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:39:11.509649 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:11.509627    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:39:12.148256 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:12.148224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:39:12.148851 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:12.148815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f7jxd"
Sep 09 21:39:12.910825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:12.910654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:12.910985 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:12.910751    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:12.910985 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:12.910930    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:12.910985 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:12.910751    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:12.911122 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:12.910985    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:12.911122 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:12.911037    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:13.153661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.153570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" event={"ID":"fe69ae00-c16f-4248-9d9c-74166f95c82d","Type":"ContainerStarted","Data":"741d89c08a2fa745c67dda41d5bddb709e7a6e45f579e60f50ae7373d9a3cf18"}
Sep 09 21:39:13.154093 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.153835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:39:13.154093 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.153902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:39:13.155759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.155727    2560 generic.go:356] "Generic (PLEG): container finished" podID="980ea599-e626-41a3-819e-fb3058869c07" containerID="a0638869c4d9e5f08d5008815021b4e1d9af740b28b0c2630b018ec8cd862b4a" exitCode=0
Sep 09 21:39:13.155900 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.155813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerDied","Data":"a0638869c4d9e5f08d5008815021b4e1d9af740b28b0c2630b018ec8cd862b4a"}
Sep 09 21:39:13.169976 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.169950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:39:13.170328 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.170312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:39:13.177019 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:13.176977    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5" podStartSLOduration=7.981117341 podStartE2EDuration="27.176962551s" totalImagesPullingTime="19.19584521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:13.175907692 +0000 UTC m=+27.730567432" watchObservedRunningTime="2026-09-09 21:39:13.176962551 +0000 UTC m=+27.731622291"
Sep 09 21:39:14.160755 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.160664    2560 generic.go:356] "Generic (PLEG): container finished" podID="980ea599-e626-41a3-819e-fb3058869c07" containerID="3358117ef4e9ea606ce262bcc1e2632a88f83ef4855086d8d4738f6a9124ec58" exitCode=0
Sep 09 21:39:14.161318 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.160755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerDied","Data":"3358117ef4e9ea606ce262bcc1e2632a88f83ef4855086d8d4738f6a9124ec58"}
Sep 09 21:39:14.161318 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.161281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:39:14.569575 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.569299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6g6lp"]
Sep 09 21:39:14.569750 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.569684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:14.569828 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:14.569799    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:14.573180 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.573149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmtrr"]
Sep 09 21:39:14.573273 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.573213    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wln9x"]
Sep 09 21:39:14.573328 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.573281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:14.573376 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:14.573355    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:14.573441 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:14.573417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:14.573527 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:14.573512    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:15.165318 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:15.165279    2560 generic.go:356] "Generic (PLEG): container finished" podID="980ea599-e626-41a3-819e-fb3058869c07" containerID="ff951520ac5f6f8a36e4584a932a1fc7a5840e4d39a44e7d581f85596ae3d44f" exitCode=0
Sep 09 21:39:15.165809 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:15.165376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerDied","Data":"ff951520ac5f6f8a36e4584a932a1fc7a5840e4d39a44e7d581f85596ae3d44f"}
Sep 09 21:39:15.911808 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:15.911732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:15.911934 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:15.911824    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:16.910850 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:16.910814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:16.911182 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:16.910917    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:16.911182 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:16.910945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:16.911182 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:16.910992    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:17.910343 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:17.910245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:17.910534 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:17.910399    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:18.567734 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:18.567681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:18.567759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.567889    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.567922    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.567893    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.567934    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2h6lh for pod openshift-network-diagnostics/network-check-target-6g6lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.567998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh podName:f4b19889-ba73-45f7-9187-16a6c0e4b62c nodeName:}" failed. No retries permitted until 2026-09-09 21:39:50.567983597 +0000 UTC m=+65.122643316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h6lh" (UniqueName: "kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh") pod "network-check-target-6g6lp" (UID: "f4b19889-ba73-45f7-9187-16a6c0e4b62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:39:18.568165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.568044    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:50.568006585 +0000 UTC m=+65.122666303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:39:18.668296 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:18.668249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:18.668484 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.668411    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:39:18.668541 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.668507    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret podName:fef28b72-2502-4a45-bd66-f7dc329645ce nodeName:}" failed. No retries permitted until 2026-09-09 21:39:50.668491927 +0000 UTC m=+65.223151664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret") pod "global-pull-secret-syncer-wln9x" (UID: "fef28b72-2502-4a45-bd66-f7dc329645ce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:39:18.910501 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:18.910395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:18.910501 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:18.910410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:18.910722 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.910547    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6g6lp" podUID="f4b19889-ba73-45f7-9187-16a6c0e4b62c"
Sep 09 21:39:18.910722 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:18.910588    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wln9x" podUID="fef28b72-2502-4a45-bd66-f7dc329645ce"
Sep 09 21:39:19.911010 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:19.910934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:19.911516 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:19.911081    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:39:20.200755 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.200724    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-189.ec2.internal" event="NodeReady"
Sep 09 21:39:20.200902 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.200883    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 21:39:20.241615 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.241579    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7lq6q"]
Sep 09 21:39:20.257961 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.257930    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kj5j7"]
Sep 09 21:39:20.258092 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.258055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.260288 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.260265    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 21:39:20.260288 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.260282    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 21:39:20.260727 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.260705    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8h77q\""
Sep 09 21:39:20.267977 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.267960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lq6q"]
Sep 09 21:39:20.268044 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.267993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kj5j7"]
Sep 09 21:39:20.268079 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.268067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.269918 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.269902    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 21:39:20.270227 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.270212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 21:39:20.270315 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.270254    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bllts\""
Sep 09 21:39:20.270315 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.270287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 21:39:20.382099 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.382071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fc55085-829c-4a40-b719-86ca6d1298d3-tmp-dir\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.382232 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.382104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc7565b4-ce85-43af-81e3-0995211429a8-cert\") pod \"ingress-canary-kj5j7\" (UID: \"fc7565b4-ce85-43af-81e3-0995211429a8\") " pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.382232 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.382125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fc55085-829c-4a40-b719-86ca6d1298d3-config-volume\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.382232 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.382154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.382232 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.382177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpps\" (UniqueName: \"kubernetes.io/projected/7fc55085-829c-4a40-b719-86ca6d1298d3-kube-api-access-qkpps\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.382232 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.382194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckpwr\" (UniqueName: \"kubernetes.io/projected/fc7565b4-ce85-43af-81e3-0995211429a8-kube-api-access-ckpwr\") pod \"ingress-canary-kj5j7\" (UID: \"fc7565b4-ce85-43af-81e3-0995211429a8\") " pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.483401 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fc55085-829c-4a40-b719-86ca6d1298d3-tmp-dir\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.483401 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc7565b4-ce85-43af-81e3-0995211429a8-cert\") pod \"ingress-canary-kj5j7\" (UID: \"fc7565b4-ce85-43af-81e3-0995211429a8\") " pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.483678 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fc55085-829c-4a40-b719-86ca6d1298d3-config-volume\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.483678 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.483871 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fc55085-829c-4a40-b719-86ca6d1298d3-tmp-dir\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.483933 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpps\" (UniqueName: \"kubernetes.io/projected/7fc55085-829c-4a40-b719-86ca6d1298d3-kube-api-access-qkpps\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.483933 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.483930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckpwr\" (UniqueName: \"kubernetes.io/projected/fc7565b4-ce85-43af-81e3-0995211429a8-kube-api-access-ckpwr\") pod \"ingress-canary-kj5j7\" (UID: \"fc7565b4-ce85-43af-81e3-0995211429a8\") " pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.484035 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:20.483937    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:20.484035 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:20.483999    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:20.983977349 +0000 UTC m=+35.538637069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:20.484245 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.484221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fc55085-829c-4a40-b719-86ca6d1298d3-config-volume\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.488370 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.488239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc7565b4-ce85-43af-81e3-0995211429a8-cert\") pod \"ingress-canary-kj5j7\" (UID: \"fc7565b4-ce85-43af-81e3-0995211429a8\") " pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.492362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.492332    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpps\" (UniqueName: \"kubernetes.io/projected/7fc55085-829c-4a40-b719-86ca6d1298d3-kube-api-access-qkpps\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.492525 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.492503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckpwr\" (UniqueName: \"kubernetes.io/projected/fc7565b4-ce85-43af-81e3-0995211429a8-kube-api-access-ckpwr\") pod \"ingress-canary-kj5j7\" (UID: \"fc7565b4-ce85-43af-81e3-0995211429a8\") " pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.576606 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.576573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kj5j7"
Sep 09 21:39:20.881815 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.881786    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kj5j7"]
Sep 09 21:39:20.896776 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:39:20.896746    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7565b4_ce85_43af_81e3_0995211429a8.slice/crio-90e14d1096d5bb09eda481a5ed0a71788d8facacb1371d40f875c8ce6bcdd740 WatchSource:0}: Error finding container 90e14d1096d5bb09eda481a5ed0a71788d8facacb1371d40f875c8ce6bcdd740: Status 404 returned error can't find the container with id 90e14d1096d5bb09eda481a5ed0a71788d8facacb1371d40f875c8ce6bcdd740
Sep 09 21:39:20.910712 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.910683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:20.910872 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.910854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:20.913731 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.913709    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 21:39:20.914247 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.913746    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 21:39:20.914247 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.913745    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6js7k\""
Sep 09 21:39:20.914247 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.913846    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 21:39:20.987629 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:20.987581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:20.987792 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:20.987727    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:20.987792 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:20.987791    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:21.987776042 +0000 UTC m=+36.542435763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:21.181683 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.181584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kj5j7" event={"ID":"fc7565b4-ce85-43af-81e3-0995211429a8","Type":"ContainerStarted","Data":"90e14d1096d5bb09eda481a5ed0a71788d8facacb1371d40f875c8ce6bcdd740"}
Sep 09 21:39:21.184408 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.184369    2560 generic.go:356] "Generic (PLEG): container finished" podID="980ea599-e626-41a3-819e-fb3058869c07" containerID="51f0c5703abf619148aaecdcee5eaac8c14c928e1403c4abe2717ce1ef254fc2" exitCode=0
Sep 09 21:39:21.184558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.184416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerDied","Data":"51f0c5703abf619148aaecdcee5eaac8c14c928e1403c4abe2717ce1ef254fc2"}
Sep 09 21:39:21.910962 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.910926    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:21.913575 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.913551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 21:39:21.913726 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.913594    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-znm4z\""
Sep 09 21:39:21.993147 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:21.993106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:21.993862 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:21.993242    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:21.993862 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:21.993327    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:23.993305778 +0000 UTC m=+38.547965512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:22.190892 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:22.190793    2560 generic.go:356] "Generic (PLEG): container finished" podID="980ea599-e626-41a3-819e-fb3058869c07" containerID="4df34a8d3f512d66108a2431270105048e24c86fe0d2d75db1e2f24298e0a0d0" exitCode=0
Sep 09 21:39:22.190892 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:22.190854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerDied","Data":"4df34a8d3f512d66108a2431270105048e24c86fe0d2d75db1e2f24298e0a0d0"}
Sep 09 21:39:23.198269 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:23.198027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" event={"ID":"980ea599-e626-41a3-819e-fb3058869c07","Type":"ContainerStarted","Data":"c135aa38b79cb603db8a21cf808622fe0f2a565f44b3ecbc3d6208c0490d0a47"}
Sep 09 21:39:23.219647 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:23.219583    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6pwpl" podStartSLOduration=6.991078936 podStartE2EDuration="37.21956017s" totalImagesPullingTime="30.228481234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:23.218211335 +0000 UTC m=+37.772871093" watchObservedRunningTime="2026-09-09 21:39:23.21956017 +0000 UTC m=+37.774219920"
Sep 09 21:39:24.009311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:24.009277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:24.009485 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:24.009418    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:24.009539 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:24.009513    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:28.009492282 +0000 UTC m=+42.564152024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:24.202534 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:24.202426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kj5j7" event={"ID":"fc7565b4-ce85-43af-81e3-0995211429a8","Type":"ContainerStarted","Data":"9d8c807b7879f59beaee2891557b1c5d5ae582a3a9f3a6861df47636a9ec2f54"}
Sep 09 21:39:24.216024 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:24.215964    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kj5j7" podStartSLOduration=1.180608048 podStartE2EDuration="4.215944569s" totalImagesPullingTime="3.035336521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:24.215554922 +0000 UTC m=+38.770214663" watchObservedRunningTime="2026-09-09 21:39:24.215944569 +0000 UTC m=+38.770604310"
Sep 09 21:39:28.038425 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:28.038373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:28.038825 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:28.038562    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:28.038825 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:28.038636    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:36.038619231 +0000 UTC m=+50.593278962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:36.093915 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:36.093868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:36.094406 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:36.094031    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:36.094406 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:36.094110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:39:52.094092585 +0000 UTC m=+66.648752324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:45.176543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:45.176505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp6d5"
Sep 09 21:39:50.596866 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.596816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:50.597554 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.596885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:39:50.601640 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.601616    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 21:39:50.602809 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.602795    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 21:39:50.607411 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:50.607393    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:39:50.607524 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:50.607489    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:40:54.607451225 +0000 UTC m=+129.162110968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : secret "metrics-daemon-secret" not found
Sep 09 21:39:50.609010 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.608996    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 21:39:50.620640 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.620621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h6lh\" (UniqueName: \"kubernetes.io/projected/f4b19889-ba73-45f7-9187-16a6c0e4b62c-kube-api-access-2h6lh\") pod \"network-check-target-6g6lp\" (UID: \"f4b19889-ba73-45f7-9187-16a6c0e4b62c\") " pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:50.627130 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.627106    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6js7k\""
Sep 09 21:39:50.635713 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.635688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:50.697431 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.697398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:50.700991 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.700963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 21:39:50.714148 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.714114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fef28b72-2502-4a45-bd66-f7dc329645ce-original-pull-secret\") pod \"global-pull-secret-syncer-wln9x\" (UID: \"fef28b72-2502-4a45-bd66-f7dc329645ce\") " pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:50.921495 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.921401    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wln9x"
Sep 09 21:39:50.929740 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:50.929710    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6g6lp"]
Sep 09 21:39:50.933405 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:39:50.933378    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b19889_ba73_45f7_9187_16a6c0e4b62c.slice/crio-c14b97ba2181107a6851ae8e546a1c33dceb12a90e79faab9b4699b4df99da5a WatchSource:0}: Error finding container c14b97ba2181107a6851ae8e546a1c33dceb12a90e79faab9b4699b4df99da5a: Status 404 returned error can't find the container with id c14b97ba2181107a6851ae8e546a1c33dceb12a90e79faab9b4699b4df99da5a
Sep 09 21:39:51.206888 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:51.206800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wln9x"]
Sep 09 21:39:51.210350 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:39:51.210326    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef28b72_2502_4a45_bd66_f7dc329645ce.slice/crio-e1c1d6fedbf96f58ad799e64da6b5f3df6098bb7ec2c8dedc3696ccafb973fbd WatchSource:0}: Error finding container e1c1d6fedbf96f58ad799e64da6b5f3df6098bb7ec2c8dedc3696ccafb973fbd: Status 404 returned error can't find the container with id e1c1d6fedbf96f58ad799e64da6b5f3df6098bb7ec2c8dedc3696ccafb973fbd
Sep 09 21:39:51.268566 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:51.268527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wln9x" event={"ID":"fef28b72-2502-4a45-bd66-f7dc329645ce","Type":"ContainerStarted","Data":"e1c1d6fedbf96f58ad799e64da6b5f3df6098bb7ec2c8dedc3696ccafb973fbd"}
Sep 09 21:39:51.269700 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:51.269674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6g6lp" event={"ID":"f4b19889-ba73-45f7-9187-16a6c0e4b62c","Type":"ContainerStarted","Data":"c14b97ba2181107a6851ae8e546a1c33dceb12a90e79faab9b4699b4df99da5a"}
Sep 09 21:39:52.108423 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:52.108386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:39:52.108950 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:52.108591    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:39:52.108950 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:39:52.108681    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:40:24.108657482 +0000 UTC m=+98.663317214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:39:53.940156 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.940114    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"]
Sep 09 21:39:53.942154 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.942122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:53.944311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.944251    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 21:39:53.944311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.944269    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 21:39:53.944551 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.944269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 21:39:53.944975 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.944947    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 21:39:53.951634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.951460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"]
Sep 09 21:39:53.954521 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.954497    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"]
Sep 09 21:39:53.956673 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.956655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:53.959029 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.958995    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 09 21:39:53.959029 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.959022    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 09 21:39:53.959244 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.959056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 09 21:39:53.959244 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.958995    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 09 21:39:53.970412 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:53.970389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"]
Sep 09 21:39:54.125029 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.124995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/381d0a80-9732-4569-aa30-0b0830c74398-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.125239 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzkv\" (UniqueName: \"kubernetes.io/projected/50ad616d-2c7a-45af-bee9-7330ab66628e-kube-api-access-rwzkv\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.125239 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.125239 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50ad616d-2c7a-45af-bee9-7330ab66628e-tmp\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.125239 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-ca\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.125503 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mj9h\" (UniqueName: \"kubernetes.io/projected/381d0a80-9732-4569-aa30-0b0830c74398-kube-api-access-6mj9h\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.125503 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50ad616d-2c7a-45af-bee9-7330ab66628e-klusterlet-config\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.125503 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.125503 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.125409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-hub\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.226532 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50ad616d-2c7a-45af-bee9-7330ab66628e-klusterlet-config\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.226532 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.226768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-hub\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.226768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/381d0a80-9732-4569-aa30-0b0830c74398-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.226768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzkv\" (UniqueName: \"kubernetes.io/projected/50ad616d-2c7a-45af-bee9-7330ab66628e-kube-api-access-rwzkv\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.226768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.226768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.226687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50ad616d-2c7a-45af-bee9-7330ab66628e-tmp\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.227398 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.227065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-ca\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.227398 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.227080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50ad616d-2c7a-45af-bee9-7330ab66628e-tmp\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.227398 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.227124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mj9h\" (UniqueName: \"kubernetes.io/projected/381d0a80-9732-4569-aa30-0b0830c74398-kube-api-access-6mj9h\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.229773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.228293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/381d0a80-9732-4569-aa30-0b0830c74398-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.229919 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.229882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.230805 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.230778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-hub\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.231094 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.231068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.231804 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.231782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/381d0a80-9732-4569-aa30-0b0830c74398-ca\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.232483 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.232442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50ad616d-2c7a-45af-bee9-7330ab66628e-klusterlet-config\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.235753 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.235724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzkv\" (UniqueName: \"kubernetes.io/projected/50ad616d-2c7a-45af-bee9-7330ab66628e-kube-api-access-rwzkv\") pod \"klusterlet-addon-workmgr-78bd5978bd-mcl54\" (UID: \"50ad616d-2c7a-45af-bee9-7330ab66628e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.236035 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.236016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mj9h\" (UniqueName: \"kubernetes.io/projected/381d0a80-9732-4569-aa30-0b0830c74398-kube-api-access-6mj9h\") pod \"cluster-proxy-proxy-agent-68579f7576-l8qjv\" (UID: \"381d0a80-9732-4569-aa30-0b0830c74398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:54.255616 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.255586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:39:54.273269 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:54.273237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:39:55.720437 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:55.720358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"]
Sep 09 21:39:55.723644 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:39:55.723609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ad616d_2c7a_45af_bee9_7330ab66628e.slice/crio-e4fb5bc8c948b75d3a42819156ade2432ca4d0d97e7dca1f583d8ff68ac1f806 WatchSource:0}: Error finding container e4fb5bc8c948b75d3a42819156ade2432ca4d0d97e7dca1f583d8ff68ac1f806: Status 404 returned error can't find the container with id e4fb5bc8c948b75d3a42819156ade2432ca4d0d97e7dca1f583d8ff68ac1f806
Sep 09 21:39:55.723815 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:55.723798    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"]
Sep 09 21:39:55.727752 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:39:55.727720    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod381d0a80_9732_4569_aa30_0b0830c74398.slice/crio-6a453876b9fdc04765e0a4c572d87d444faa1dc2b7ff775267d1a5c5818f6fad WatchSource:0}: Error finding container 6a453876b9fdc04765e0a4c572d87d444faa1dc2b7ff775267d1a5c5818f6fad: Status 404 returned error can't find the container with id 6a453876b9fdc04765e0a4c572d87d444faa1dc2b7ff775267d1a5c5818f6fad
Sep 09 21:39:56.284595 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.284551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6g6lp" event={"ID":"f4b19889-ba73-45f7-9187-16a6c0e4b62c","Type":"ContainerStarted","Data":"b9103e95a9f792c517fc1856e074bf70d8976adfc57b37fd6c1168ed70fd6779"}
Sep 09 21:39:56.284787 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.284637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:39:56.285736 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.285718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54" event={"ID":"50ad616d-2c7a-45af-bee9-7330ab66628e","Type":"ContainerStarted","Data":"e4fb5bc8c948b75d3a42819156ade2432ca4d0d97e7dca1f583d8ff68ac1f806"}
Sep 09 21:39:56.287150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.287129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wln9x" event={"ID":"fef28b72-2502-4a45-bd66-f7dc329645ce","Type":"ContainerStarted","Data":"52e48dd9bff214abcc308466a72e97c65fc395835fb784e1e859869b29acc68a"}
Sep 09 21:39:56.288208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.288184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" event={"ID":"381d0a80-9732-4569-aa30-0b0830c74398","Type":"ContainerStarted","Data":"6a453876b9fdc04765e0a4c572d87d444faa1dc2b7ff775267d1a5c5818f6fad"}
Sep 09 21:39:56.301588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.301532    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6g6lp" podStartSLOduration=66.7935395 podStartE2EDuration="1m11.301510717s" totalImagesPullingTime="4.507971217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:56.300901395 +0000 UTC m=+70.855561136" watchObservedRunningTime="2026-09-09 21:39:56.301510717 +0000 UTC m=+70.856170458"
Sep 09 21:39:56.317878 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:39:56.317830    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wln9x" podStartSLOduration=66.074302307 podStartE2EDuration="1m10.317810386s" totalImagesPullingTime="4.243508079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:39:56.317076653 +0000 UTC m=+70.871736393" watchObservedRunningTime="2026-09-09 21:39:56.317810386 +0000 UTC m=+70.872470117"
Sep 09 21:40:02.312775 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.312736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" event={"ID":"381d0a80-9732-4569-aa30-0b0830c74398","Type":"ContainerStarted","Data":"0e02f4eaf72d8fccf5a9680dc0799ac935dbcbcea3aeb6044978bc98984aedc8"}
Sep 09 21:40:02.312775 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.312781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" event={"ID":"381d0a80-9732-4569-aa30-0b0830c74398","Type":"ContainerStarted","Data":"8dac27739fc5f38587b9c9b736729c7b2855690fc153db5fdcde2eca7ac438c3"}
Sep 09 21:40:02.313299 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.312801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" event={"ID":"381d0a80-9732-4569-aa30-0b0830c74398","Type":"ContainerStarted","Data":"2422362401e8a80365fd3eaa2d389d5a244d81e3da75eb4da76b7dc6b0714909"}
Sep 09 21:40:02.314237 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.314216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54" event={"ID":"50ad616d-2c7a-45af-bee9-7330ab66628e","Type":"ContainerStarted","Data":"960bd8d3455c97fced000794da2aa3f46429ed1a2029853b8fb8be7db1cb990e"}
Sep 09 21:40:02.314446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.314426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:40:02.316189 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.316155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:40:02.331272 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.331213    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" podStartSLOduration=3.56256538 podStartE2EDuration="9.33119664s" totalImagesPullingTime="5.76863126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:40:02.329943072 +0000 UTC m=+76.884602813" watchObservedRunningTime="2026-09-09 21:40:02.33119664 +0000 UTC m=+76.885856380"
Sep 09 21:40:02.345611 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:02.345556    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54" podStartSLOduration=3.568122791 podStartE2EDuration="9.345537893s" totalImagesPullingTime="5.777415102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:40:02.344888587 +0000 UTC m=+76.899548332" watchObservedRunningTime="2026-09-09 21:40:02.345537893 +0000 UTC m=+76.900197633"
Sep 09 21:40:24.130488 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:24.130427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:40:24.130882 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:40:24.130587    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:40:24.130882 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:40:24.130659    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:41:28.130643356 +0000 UTC m=+162.685303074 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:40:27.294627 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:27.294594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6g6lp"
Sep 09 21:40:54.638707 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:40:54.638661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:40:54.639181 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:40:54.638792    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:40:54.639181 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:40:54.638851    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs podName:8511045c-ea59-4fae-8704-f6e3c9fb5931 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:56.638835187 +0000 UTC m=+251.193494910 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs") pod "network-metrics-daemon-xmtrr" (UID: "8511045c-ea59-4fae-8704-f6e3c9fb5931") : secret "metrics-daemon-secret" not found
Sep 09 21:41:23.267596 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:41:23.267539    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7lq6q" podUID="7fc55085-829c-4a40-b719-86ca6d1298d3"
Sep 09 21:41:23.559347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:41:23.559321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:41:24.920189 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:41:24.920147    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xmtrr" podUID="8511045c-ea59-4fae-8704-f6e3c9fb5931"
Sep 09 21:41:28.164741 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:41:28.164706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:41:28.165119 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:41:28.164835    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:41:28.165119 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:41:28.164892    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls podName:7fc55085-829c-4a40-b719-86ca6d1298d3 nodeName:}" failed. No retries permitted until 2026-09-09 21:43:30.164877131 +0000 UTC m=+284.719536849 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls") pod "dns-default-7lq6q" (UID: "7fc55085-829c-4a40-b719-86ca6d1298d3") : secret "dns-default-metrics-tls" not found
Sep 09 21:41:36.910428 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:41:36.910332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:42:01.670539 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:01.670501    2560 generic.go:356] "Generic (PLEG): container finished" podID="50ad616d-2c7a-45af-bee9-7330ab66628e" containerID="960bd8d3455c97fced000794da2aa3f46429ed1a2029853b8fb8be7db1cb990e" exitCode=1
Sep 09 21:42:01.671027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:01.670582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54" event={"ID":"50ad616d-2c7a-45af-bee9-7330ab66628e","Type":"ContainerDied","Data":"960bd8d3455c97fced000794da2aa3f46429ed1a2029853b8fb8be7db1cb990e"}
Sep 09 21:42:01.671027 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:01.670973    2560 scope.go:117] "RemoveContainer" containerID="960bd8d3455c97fced000794da2aa3f46429ed1a2029853b8fb8be7db1cb990e"
Sep 09 21:42:02.314809 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:02.314764    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:42:02.675572 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:02.675460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54" event={"ID":"50ad616d-2c7a-45af-bee9-7330ab66628e","Type":"ContainerStarted","Data":"245ff1b9cf6efd43f8f2298d88d46baa1bcb15417db2dd352b039e34a4e47a89"}
Sep 09 21:42:02.675942 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:02.675703    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:42:02.676317 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:02.676299    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78bd5978bd-mcl54"
Sep 09 21:42:39.514203 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.514166    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5p57q"]
Sep 09 21:42:39.516210 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.516189    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.518261 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.518238    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 21:42:39.518386 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.518267    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 21:42:39.518386 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.518241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jhfz7\""
Sep 09 21:42:39.518555 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.518420    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 21:42:39.522493 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.519279    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 21:42:39.527001 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.526980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5p57q"]
Sep 09 21:42:39.555442 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.555408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.555619 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.555447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/deaa7dd6-71cb-4422-a109-6d140691d606-crio-socket\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.555619 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.555483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa7dd6-71cb-4422-a109-6d140691d606-data-volume\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.555619 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.555566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.555776 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.555676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4b7k\" (UniqueName: \"kubernetes.io/projected/deaa7dd6-71cb-4422-a109-6d140691d606-kube-api-access-p4b7k\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657017 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.656985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/deaa7dd6-71cb-4422-a109-6d140691d606-crio-socket\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657017 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.657022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa7dd6-71cb-4422-a109-6d140691d606-data-volume\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657225 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.657115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/deaa7dd6-71cb-4422-a109-6d140691d606-crio-socket\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657225 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.657159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657343 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.657246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4b7k\" (UniqueName: \"kubernetes.io/projected/deaa7dd6-71cb-4422-a109-6d140691d606-kube-api-access-p4b7k\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657343 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:39.657269    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:39.657343 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.657276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa7dd6-71cb-4422-a109-6d140691d606-data-volume\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657343 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.657289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:39.657343 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:39.657328    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:40.157311707 +0000 UTC m=+234.711971425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:39.657593 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:39.657376    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:42:39.657593 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:39.657447    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:40.157429022 +0000 UTC m=+234.712088754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : configmap "kube-rbac-proxy" not found
Sep 09 21:42:39.665014 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:39.664991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4b7k\" (UniqueName: \"kubernetes.io/projected/deaa7dd6-71cb-4422-a109-6d140691d606-kube-api-access-p4b7k\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:40.161256 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:40.161212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:40.161501 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:40.161277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:40.161501 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:40.161344    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:42:40.161501 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:40.161360    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:40.161501 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:40.161407    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:41.161394078 +0000 UTC m=+235.716053795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : configmap "kube-rbac-proxy" not found
Sep 09 21:42:40.161501 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:40.161420    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:41.161414365 +0000 UTC m=+235.716074083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:41.167916 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:41.167870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:41.168348 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:41.167966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:41.168348 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:41.168032    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:41.168348 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:41.168051    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:42:41.168348 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:41.168097    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:43.168081749 +0000 UTC m=+237.722741482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:41.168348 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:41.168112    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:43.168105561 +0000 UTC m=+237.722765280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : configmap "kube-rbac-proxy" not found
Sep 09 21:42:41.481930 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:41.481851    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pzrbv_3c9d4ca5-2fba-402c-976a-ea2c2d1a285f/dns-node-resolver/0.log"
Sep 09 21:42:42.281530 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:42.281503    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6xrgb_f0563449-2eaa-4a6c-9bad-0adf5f89972c/node-ca/0.log"
Sep 09 21:42:43.082284 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:43.082255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj5j7_fc7565b4-ce85-43af-81e3-0995211429a8/serve-healthcheck-canary/0.log"
Sep 09 21:42:43.183161 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:43.183126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:43.183315 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:43.183206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:43.183315 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:43.183267    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:43.183390 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:43.183345    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:47.183325921 +0000 UTC m=+241.737985638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:43.183718 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:43.183700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/deaa7dd6-71cb-4422-a109-6d140691d606-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:47.210902 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:47.210857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:47.211386 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:47.211014    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:47.211386 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:42:47.211102    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls podName:deaa7dd6-71cb-4422-a109-6d140691d606 nodeName:}" failed. No retries permitted until 2026-09-09 21:42:55.211083015 +0000 UTC m=+249.765742735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5p57q" (UID: "deaa7dd6-71cb-4422-a109-6d140691d606") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:42:55.276737 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.276700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:55.279162 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.279137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/deaa7dd6-71cb-4422-a109-6d140691d606-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5p57q\" (UID: \"deaa7dd6-71cb-4422-a109-6d140691d606\") " pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:55.430831 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.430796    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jhfz7\""
Sep 09 21:42:55.439370 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.439348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5p57q"
Sep 09 21:42:55.710859 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.710825    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5p57q"]
Sep 09 21:42:55.715156 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:42:55.715122    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeaa7dd6_71cb_4422_a109_6d140691d606.slice/crio-ff4436cf4a092bb3432d6be3d86e662f687683f23abc3253eef974c92abeed16 WatchSource:0}: Error finding container ff4436cf4a092bb3432d6be3d86e662f687683f23abc3253eef974c92abeed16: Status 404 returned error can't find the container with id ff4436cf4a092bb3432d6be3d86e662f687683f23abc3253eef974c92abeed16
Sep 09 21:42:55.827446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.827412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5p57q" event={"ID":"deaa7dd6-71cb-4422-a109-6d140691d606","Type":"ContainerStarted","Data":"0205406b496539d4e010823230ce76df4bd1ffe73202f6ae0263bc77ebb02cec"}
Sep 09 21:42:55.827615 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:55.827484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5p57q" event={"ID":"deaa7dd6-71cb-4422-a109-6d140691d606","Type":"ContainerStarted","Data":"ff4436cf4a092bb3432d6be3d86e662f687683f23abc3253eef974c92abeed16"}
Sep 09 21:42:56.688402 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:56.688301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:42:56.690701 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:56.690678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8511045c-ea59-4fae-8704-f6e3c9fb5931-metrics-certs\") pod \"network-metrics-daemon-xmtrr\" (UID: \"8511045c-ea59-4fae-8704-f6e3c9fb5931\") " pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:42:56.713496 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:56.713453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-znm4z\""
Sep 09 21:42:56.722011 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:56.721992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtrr"
Sep 09 21:42:56.832741 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:56.832701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5p57q" event={"ID":"deaa7dd6-71cb-4422-a109-6d140691d606","Type":"ContainerStarted","Data":"ce486297eafddc0a03cbd70146692ab64f2613c1772e804bfba9880942b1f6d9"}
Sep 09 21:42:56.987812 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:56.987719    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmtrr"]
Sep 09 21:42:56.992624 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:42:56.992587    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8511045c_ea59_4fae_8704_f6e3c9fb5931.slice/crio-f59754084955b8707006008a59d3c171bd490ab7abd48bd51158e77db9ffe989 WatchSource:0}: Error finding container f59754084955b8707006008a59d3c171bd490ab7abd48bd51158e77db9ffe989: Status 404 returned error can't find the container with id f59754084955b8707006008a59d3c171bd490ab7abd48bd51158e77db9ffe989
Sep 09 21:42:57.838692 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:57.838651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmtrr" event={"ID":"8511045c-ea59-4fae-8704-f6e3c9fb5931","Type":"ContainerStarted","Data":"f59754084955b8707006008a59d3c171bd490ab7abd48bd51158e77db9ffe989"}
Sep 09 21:42:58.843374 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:58.843334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmtrr" event={"ID":"8511045c-ea59-4fae-8704-f6e3c9fb5931","Type":"ContainerStarted","Data":"bc34406e462a2327b04483cb09c8b4a63c24607cfd40c65372b8cab7474b3553"}
Sep 09 21:42:58.843837 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:58.843392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmtrr" event={"ID":"8511045c-ea59-4fae-8704-f6e3c9fb5931","Type":"ContainerStarted","Data":"76834e260dde7863764b90ad82a24161426e41c59fe69ec2e4402df1412ed790"}
Sep 09 21:42:58.845416 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:58.845394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5p57q" event={"ID":"deaa7dd6-71cb-4422-a109-6d140691d606","Type":"ContainerStarted","Data":"a6c87bab15cd5c514087e0edd7a6198d43daa50a4bf5a8fe94d0b626c89bac74"}
Sep 09 21:42:58.857699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:58.857643    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xmtrr" podStartSLOduration=251.669481631 podStartE2EDuration="4m12.857627519s" totalImagesPullingTime="1.188145888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:42:58.857026398 +0000 UTC m=+253.411686138" watchObservedRunningTime="2026-09-09 21:42:58.857627519 +0000 UTC m=+253.412287258"
Sep 09 21:42:58.874994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:42:58.874946    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5p57q" podStartSLOduration=17.510407463 podStartE2EDuration="19.874925785s" totalImagesPullingTime="2.364518322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:42:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:42:58.873860815 +0000 UTC m=+253.428520549" watchObservedRunningTime="2026-09-09 21:42:58.874925785 +0000 UTC m=+253.429585526"
Sep 09 21:43:00.458169 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.458135    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-764c9dc9c5-64zt9"]
Sep 09 21:43:00.460184 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.460166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.463039 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.463016    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 21:43:00.463159 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.463022    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 21:43:00.463159 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.463138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 21:43:00.463236 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.463172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xvgqt\""
Sep 09 21:43:00.467895 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.467875    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 21:43:00.474769 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.474747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764c9dc9c5-64zt9"]
Sep 09 21:43:00.619399 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/611b09e6-b946-41be-858c-268af2a77fc7-trusted-ca\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619399 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/611b09e6-b946-41be-858c-268af2a77fc7-installation-pull-secrets\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-bound-sa-token\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/611b09e6-b946-41be-858c-268af2a77fc7-image-registry-private-configuration\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-registry-tls\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/611b09e6-b946-41be-858c-268af2a77fc7-ca-trust-extracted\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dhkn\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-kube-api-access-4dhkn\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.619632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.619589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/611b09e6-b946-41be-858c-268af2a77fc7-registry-certificates\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.720829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.720738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-bound-sa-token\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.720829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.720776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/611b09e6-b946-41be-858c-268af2a77fc7-image-registry-private-configuration\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.720829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.720805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-registry-tls\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.721089 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.721063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/611b09e6-b946-41be-858c-268af2a77fc7-ca-trust-extracted\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.721142 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.721119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dhkn\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-kube-api-access-4dhkn\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.721198 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.721167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/611b09e6-b946-41be-858c-268af2a77fc7-registry-certificates\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.721565 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.721348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/611b09e6-b946-41be-858c-268af2a77fc7-trusted-ca\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.721565 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.721405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/611b09e6-b946-41be-858c-268af2a77fc7-installation-pull-secrets\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.721565 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.721542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/611b09e6-b946-41be-858c-268af2a77fc7-ca-trust-extracted\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.722229 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.722199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/611b09e6-b946-41be-858c-268af2a77fc7-registry-certificates\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.722425 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.722408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/611b09e6-b946-41be-858c-268af2a77fc7-trusted-ca\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.723713 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.723686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/611b09e6-b946-41be-858c-268af2a77fc7-installation-pull-secrets\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.723842 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.723819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/611b09e6-b946-41be-858c-268af2a77fc7-image-registry-private-configuration\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.724007 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.723984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-registry-tls\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.730354 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.730323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dhkn\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-kube-api-access-4dhkn\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.730446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.730423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/611b09e6-b946-41be-858c-268af2a77fc7-bound-sa-token\") pod \"image-registry-764c9dc9c5-64zt9\" (UID: \"611b09e6-b946-41be-858c-268af2a77fc7\") " pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:00.770354 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:00.770321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:01.044233 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:01.044143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764c9dc9c5-64zt9"]
Sep 09 21:43:01.048236 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:43:01.048210    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611b09e6_b946_41be_858c_268af2a77fc7.slice/crio-b9cefb07fb25cf5586a91eacc02ba9120df6c3ae2e7962e8ae3c96dfccfafc26 WatchSource:0}: Error finding container b9cefb07fb25cf5586a91eacc02ba9120df6c3ae2e7962e8ae3c96dfccfafc26: Status 404 returned error can't find the container with id b9cefb07fb25cf5586a91eacc02ba9120df6c3ae2e7962e8ae3c96dfccfafc26
Sep 09 21:43:01.858107 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:01.858062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" event={"ID":"611b09e6-b946-41be-858c-268af2a77fc7","Type":"ContainerStarted","Data":"8df5ad8ea6fadc86cdd1c7ade62529641ef9dcff84da6d0304273656fd8620b1"}
Sep 09 21:43:01.858591 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:01.858128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" event={"ID":"611b09e6-b946-41be-858c-268af2a77fc7","Type":"ContainerStarted","Data":"b9cefb07fb25cf5586a91eacc02ba9120df6c3ae2e7962e8ae3c96dfccfafc26"}
Sep 09 21:43:01.858591 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:01.858202    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:01.875243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:01.875192    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podStartSLOduration=1.8751780249999999 podStartE2EDuration="1.875178025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:43:01.873932296 +0000 UTC m=+256.428592035" watchObservedRunningTime="2026-09-09 21:43:01.875178025 +0000 UTC m=+256.429837765"
Sep 09 21:43:20.774917 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:20.774876    2560 patch_prober.go:28] interesting pod/image-registry-764c9dc9c5-64zt9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:43:20.775309 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:20.774951    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:43:22.866992 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:22.866956    2560 patch_prober.go:28] interesting pod/image-registry-764c9dc9c5-64zt9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:43:22.867363 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:22.867007    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:43:26.560379 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:43:26.560332    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7lq6q" podUID="7fc55085-829c-4a40-b719-86ca6d1298d3"
Sep 09 21:43:26.934624 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:26.934537    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:43:28.389537 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.389501    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ph5dk"]
Sep 09 21:43:28.391701 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.391685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.393690 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.393664    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 21:43:28.393901 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.393664    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 21:43:28.393901 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.393843    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 21:43:28.393901 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.393846    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 21:43:28.393901 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.393847    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-258df\""
Sep 09 21:43:28.394350 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.394333    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 21:43:28.394407 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.394369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 21:43:28.514654 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514654 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd180df-88f1-4e75-b85a-e219d24d9d51-metrics-client-ca\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514857 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-textfile\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514857 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-root\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514857 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-tls\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514857 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-sys\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514981 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmmrq\" (UniqueName: \"kubernetes.io/projected/4cd180df-88f1-4e75-b85a-e219d24d9d51-kube-api-access-lmmrq\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.514981 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-accelerators-collector-config\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.515041 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.514997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-wtmp\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615653 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-accelerators-collector-config\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615653 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-wtmp\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd180df-88f1-4e75-b85a-e219d24d9d51-metrics-client-ca\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-textfile\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-root\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-tls\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-sys\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-wtmp\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.615885 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-sys\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.616243 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:43:28.615903    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 21:43:28.616243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.615937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmmrq\" (UniqueName: \"kubernetes.io/projected/4cd180df-88f1-4e75-b85a-e219d24d9d51-kube-api-access-lmmrq\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.616243 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:43:28.615983    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-tls podName:4cd180df-88f1-4e75-b85a-e219d24d9d51 nodeName:}" failed. No retries permitted until 2026-09-09 21:43:29.11595987 +0000 UTC m=+283.670619605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-tls") pod "node-exporter-ph5dk" (UID: "4cd180df-88f1-4e75-b85a-e219d24d9d51") : secret "node-exporter-tls" not found
Sep 09 21:43:28.616243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.616107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-textfile\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.616461 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.616326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd180df-88f1-4e75-b85a-e219d24d9d51-metrics-client-ca\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.616461 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.616330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cd180df-88f1-4e75-b85a-e219d24d9d51-root\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.616461 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.616329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-accelerators-collector-config\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.618236 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.618214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:28.624015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:28.623986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmmrq\" (UniqueName: \"kubernetes.io/projected/4cd180df-88f1-4e75-b85a-e219d24d9d51-kube-api-access-lmmrq\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:29.121373 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:29.121333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-tls\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:29.123771 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:29.123740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd180df-88f1-4e75-b85a-e219d24d9d51-node-exporter-tls\") pod \"node-exporter-ph5dk\" (UID: \"4cd180df-88f1-4e75-b85a-e219d24d9d51\") " pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:29.301085 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:29.301041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ph5dk"
Sep 09 21:43:29.311566 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:43:29.311533    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd180df_88f1_4e75_b85a_e219d24d9d51.slice/crio-deac827dcfa03ef32be5fd154b954a72bc00be9fc81cc2c3f4cafa6d0f5f8dc1 WatchSource:0}: Error finding container deac827dcfa03ef32be5fd154b954a72bc00be9fc81cc2c3f4cafa6d0f5f8dc1: Status 404 returned error can't find the container with id deac827dcfa03ef32be5fd154b954a72bc00be9fc81cc2c3f4cafa6d0f5f8dc1
Sep 09 21:43:29.949499 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:29.949439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph5dk" event={"ID":"4cd180df-88f1-4e75-b85a-e219d24d9d51","Type":"ContainerStarted","Data":"deac827dcfa03ef32be5fd154b954a72bc00be9fc81cc2c3f4cafa6d0f5f8dc1"}
Sep 09 21:43:30.230128 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.230027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:43:30.232920 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.232873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fc55085-829c-4a40-b719-86ca6d1298d3-metrics-tls\") pod \"dns-default-7lq6q\" (UID: \"7fc55085-829c-4a40-b719-86ca6d1298d3\") " pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:43:30.237868 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.237842    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8h77q\""
Sep 09 21:43:30.246637 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.246601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:43:30.546138 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.546053    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lq6q"]
Sep 09 21:43:30.549344 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:43:30.549319    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc55085_829c_4a40_b719_86ca6d1298d3.slice/crio-001e65958edb4d8628bd3712f5f49cb1cbd9d3a9b173332586b1bf82d45ba126 WatchSource:0}: Error finding container 001e65958edb4d8628bd3712f5f49cb1cbd9d3a9b173332586b1bf82d45ba126: Status 404 returned error can't find the container with id 001e65958edb4d8628bd3712f5f49cb1cbd9d3a9b173332586b1bf82d45ba126
Sep 09 21:43:30.774414 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.774377    2560 patch_prober.go:28] interesting pod/image-registry-764c9dc9c5-64zt9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:43:30.774580 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.774428    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:43:30.953945 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.953903    2560 generic.go:356] "Generic (PLEG): container finished" podID="4cd180df-88f1-4e75-b85a-e219d24d9d51" containerID="05d6e703945aadd805cf709c5fabb8ddc7446b24c0821d1b5f4a59b7324b47d8" exitCode=0
Sep 09 21:43:30.954394 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.953990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph5dk" event={"ID":"4cd180df-88f1-4e75-b85a-e219d24d9d51","Type":"ContainerDied","Data":"05d6e703945aadd805cf709c5fabb8ddc7446b24c0821d1b5f4a59b7324b47d8"}
Sep 09 21:43:30.955332 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:30.955306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lq6q" event={"ID":"7fc55085-829c-4a40-b719-86ca6d1298d3","Type":"ContainerStarted","Data":"001e65958edb4d8628bd3712f5f49cb1cbd9d3a9b173332586b1bf82d45ba126"}
Sep 09 21:43:31.962317 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:31.962282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph5dk" event={"ID":"4cd180df-88f1-4e75-b85a-e219d24d9d51","Type":"ContainerStarted","Data":"da74a6f0c8df87839ad8f2378920d6dff6312eddfd59ea049ed9d4beadbe1f53"}
Sep 09 21:43:31.962795 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:31.962345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph5dk" event={"ID":"4cd180df-88f1-4e75-b85a-e219d24d9d51","Type":"ContainerStarted","Data":"7eaff16521d348842f09d9626284490f21f7659a21c4729b31622cea87e1bb7f"}
Sep 09 21:43:31.981124 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:31.981065    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ph5dk" podStartSLOduration=2.92497039 podStartE2EDuration="3.98104145s" totalImagesPullingTime="984.232431ms" totalInitContainerRuntime="71.838629ms" isStatefulPod=true podCreationTimestamp="2026-09-09 21:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:43:31.979050202 +0000 UTC m=+286.533709972" watchObservedRunningTime="2026-09-09 21:43:31.98104145 +0000 UTC m=+286.535701190"
Sep 09 21:43:32.866301 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:32.866268    2560 patch_prober.go:28] interesting pod/image-registry-764c9dc9c5-64zt9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:43:32.866455 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:32.866324    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:43:32.967739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:32.967697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lq6q" event={"ID":"7fc55085-829c-4a40-b719-86ca6d1298d3","Type":"ContainerStarted","Data":"a8729e0b159d3be5c17637d016e5d1b241d8fd7934a4f04b1c23feeb47cc5a45"}
Sep 09 21:43:32.968136 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:32.967756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lq6q" event={"ID":"7fc55085-829c-4a40-b719-86ca6d1298d3","Type":"ContainerStarted","Data":"9b7f1c9a7d87629cac41eae457ec9b20db930ddf74224321f94c7d882d639bdf"}
Sep 09 21:43:32.968136 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:32.968088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:43:32.986443 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:32.986389    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7lq6q" podStartSLOduration=251.416752022 podStartE2EDuration="4m12.986372891s" totalImagesPullingTime="1.569620869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:43:32.985779306 +0000 UTC m=+287.540439051" watchObservedRunningTime="2026-09-09 21:43:32.986372891 +0000 UTC m=+287.541032631"
Sep 09 21:43:40.774555 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:40.774519    2560 patch_prober.go:28] interesting pod/image-registry-764c9dc9c5-64zt9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:43:40.774933 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:40.774578    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:43:40.774933 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:40.774625    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:40.775104 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:40.775072    2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"8df5ad8ea6fadc86cdd1c7ade62529641ef9dcff84da6d0304273656fd8620b1"} pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:43:40.779799 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:40.779766    2560 patch_prober.go:28] interesting pod/image-registry-764c9dc9c5-64zt9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:43:40.779927 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:40.779821    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:43:43.976408 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:43.976374    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7lq6q"
Sep 09 21:43:44.275318 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:44.275236    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" podUID="381d0a80-9732-4569-aa30-0b0830c74398" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 21:43:45.818904 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:45.818876    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 21:43:50.779725 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:50.779696    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:43:54.274978 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:43:54.274934    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" podUID="381d0a80-9732-4569-aa30-0b0830c74398" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 21:44:04.275100 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:04.275055    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" podUID="381d0a80-9732-4569-aa30-0b0830c74398" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 21:44:04.275573 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:04.275131    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv"
Sep 09 21:44:04.275731 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:04.275710    2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0e02f4eaf72d8fccf5a9680dc0799ac935dbcbcea3aeb6044978bc98984aedc8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 09 21:44:04.275778 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:04.275754    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" podUID="381d0a80-9732-4569-aa30-0b0830c74398" containerName="service-proxy" containerID="cri-o://0e02f4eaf72d8fccf5a9680dc0799ac935dbcbcea3aeb6044978bc98984aedc8" gracePeriod=30
Sep 09 21:44:04.836679 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:04.836634    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj5j7_fc7565b4-ce85-43af-81e3-0995211429a8/serve-healthcheck-canary/0.log"
Sep 09 21:44:05.078001 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:05.077960    2560 generic.go:356] "Generic (PLEG): container finished" podID="381d0a80-9732-4569-aa30-0b0830c74398" containerID="0e02f4eaf72d8fccf5a9680dc0799ac935dbcbcea3aeb6044978bc98984aedc8" exitCode=2
Sep 09 21:44:05.078172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:05.078029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" event={"ID":"381d0a80-9732-4569-aa30-0b0830c74398","Type":"ContainerDied","Data":"0e02f4eaf72d8fccf5a9680dc0799ac935dbcbcea3aeb6044978bc98984aedc8"}
Sep 09 21:44:05.078172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:05.078086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68579f7576-l8qjv" event={"ID":"381d0a80-9732-4569-aa30-0b0830c74398","Type":"ContainerStarted","Data":"78140303af1ae99475883de0f6ac78c4adfdd95912461cfb9e5a70dc4920e75a"}
Sep 09 21:44:05.797202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:05.797156    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" podUID="611b09e6-b946-41be-858c-268af2a77fc7" containerName="registry" containerID="cri-o://8df5ad8ea6fadc86cdd1c7ade62529641ef9dcff84da6d0304273656fd8620b1" gracePeriod=30
Sep 09 21:44:07.087193 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:07.087156    2560 generic.go:356] "Generic (PLEG): container finished" podID="611b09e6-b946-41be-858c-268af2a77fc7" containerID="8df5ad8ea6fadc86cdd1c7ade62529641ef9dcff84da6d0304273656fd8620b1" exitCode=0
Sep 09 21:44:07.087608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:07.087242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" event={"ID":"611b09e6-b946-41be-858c-268af2a77fc7","Type":"ContainerDied","Data":"8df5ad8ea6fadc86cdd1c7ade62529641ef9dcff84da6d0304273656fd8620b1"}
Sep 09 21:44:07.087608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:07.087301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9" event={"ID":"611b09e6-b946-41be-858c-268af2a77fc7","Type":"ContainerStarted","Data":"bd04a50a079e9d04859438709c67596cb2b35149122f614d53f4dd0bc97f2d50"}
Sep 09 21:44:07.087608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:07.087416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:44:28.096149 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:44:28.096116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764c9dc9c5-64zt9"
Sep 09 21:47:19.681043 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.681005    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"]
Sep 09 21:47:19.683929 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.683913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.687085 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.687064    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 21:47:19.687667 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.687650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8hfmv\""
Sep 09 21:47:19.687734 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.687652    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:47:19.696169 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.696147    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"]
Sep 09 21:47:19.758080 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.758045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca83ef86-1b17-4986-be89-30cd5a0715db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l72ng\" (UID: \"ca83ef86-1b17-4986-be89-30cd5a0715db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.758249 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.758089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhjd\" (UniqueName: \"kubernetes.io/projected/ca83ef86-1b17-4986-be89-30cd5a0715db-kube-api-access-nmhjd\") pod \"openshift-lws-operator-fd8ccff4c-l72ng\" (UID: \"ca83ef86-1b17-4986-be89-30cd5a0715db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.859376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.859319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca83ef86-1b17-4986-be89-30cd5a0715db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l72ng\" (UID: \"ca83ef86-1b17-4986-be89-30cd5a0715db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.859376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.859385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhjd\" (UniqueName: \"kubernetes.io/projected/ca83ef86-1b17-4986-be89-30cd5a0715db-kube-api-access-nmhjd\") pod \"openshift-lws-operator-fd8ccff4c-l72ng\" (UID: \"ca83ef86-1b17-4986-be89-30cd5a0715db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.859746 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.859721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca83ef86-1b17-4986-be89-30cd5a0715db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l72ng\" (UID: \"ca83ef86-1b17-4986-be89-30cd5a0715db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.872934 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.872896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhjd\" (UniqueName: \"kubernetes.io/projected/ca83ef86-1b17-4986-be89-30cd5a0715db-kube-api-access-nmhjd\") pod \"openshift-lws-operator-fd8ccff4c-l72ng\" (UID: \"ca83ef86-1b17-4986-be89-30cd5a0715db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:19.993080 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:19.992972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"
Sep 09 21:47:20.267301 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:20.267224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng"]
Sep 09 21:47:20.271978 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:47:20.271951    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca83ef86_1b17_4986_be89_30cd5a0715db.slice/crio-03bc68c168911f4b171f423f8af0adccdda90caf00237a0e07d687a40c3c0270 WatchSource:0}: Error finding container 03bc68c168911f4b171f423f8af0adccdda90caf00237a0e07d687a40c3c0270: Status 404 returned error can't find the container with id 03bc68c168911f4b171f423f8af0adccdda90caf00237a0e07d687a40c3c0270
Sep 09 21:47:20.273988 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:20.273969    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:47:20.737682 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:20.737638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng" event={"ID":"ca83ef86-1b17-4986-be89-30cd5a0715db","Type":"ContainerStarted","Data":"03bc68c168911f4b171f423f8af0adccdda90caf00237a0e07d687a40c3c0270"}
Sep 09 21:47:22.746515 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:22.746454    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng" event={"ID":"ca83ef86-1b17-4986-be89-30cd5a0715db","Type":"ContainerStarted","Data":"0560181427eeb538e6b13362c30ccec7b7c2453b3403f4ff3cae840747ab9859"}
Sep 09 21:47:42.831490 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.831342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l72ng" podStartSLOduration=21.457083439 podStartE2EDuration="23.831322389s" totalImagesPullingTime="2.37423895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:47:22.773191639 +0000 UTC m=+517.327851378" watchObservedRunningTime="2026-09-09 21:47:42.831322389 +0000 UTC m=+537.385982140"
Sep 09 21:47:42.832059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.831656    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"]
Sep 09 21:47:42.835107 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.835085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:42.837366 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.837340    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 21:47:42.837518 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.837452    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7txkq\""
Sep 09 21:47:42.837699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.837683    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 21:47:42.838011 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.837991    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 21:47:42.838103 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.838028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 21:47:42.853155 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.853129    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"]
Sep 09 21:47:42.918830 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.918793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3215ea4c-7857-427a-adca-ea9f1b2958d9-manifests\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:42.919002 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.918838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3215ea4c-7857-427a-adca-ea9f1b2958d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:42.919002 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.918856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3215ea4c-7857-427a-adca-ea9f1b2958d9-tmp\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:42.919002 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.918905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3215ea4c-7857-427a-adca-ea9f1b2958d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:42.919002 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:42.918965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z2nz\" (UniqueName: \"kubernetes.io/projected/3215ea4c-7857-427a-adca-ea9f1b2958d9-kube-api-access-8z2nz\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.020090 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.020053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3215ea4c-7857-427a-adca-ea9f1b2958d9-manifests\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.020252 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.020105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3215ea4c-7857-427a-adca-ea9f1b2958d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.020252 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.020127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3215ea4c-7857-427a-adca-ea9f1b2958d9-tmp\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.020252 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.020158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3215ea4c-7857-427a-adca-ea9f1b2958d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.020252 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.020208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z2nz\" (UniqueName: \"kubernetes.io/projected/3215ea4c-7857-427a-adca-ea9f1b2958d9-kube-api-access-8z2nz\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.020588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.020564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3215ea4c-7857-427a-adca-ea9f1b2958d9-manifests\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.022644 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.022622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3215ea4c-7857-427a-adca-ea9f1b2958d9-tmp\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.022757 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.022743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3215ea4c-7857-427a-adca-ea9f1b2958d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.022911 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.022891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3215ea4c-7857-427a-adca-ea9f1b2958d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.028577 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.028551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z2nz\" (UniqueName: \"kubernetes.io/projected/3215ea4c-7857-427a-adca-ea9f1b2958d9-kube-api-access-8z2nz\") pod \"opendatahub-operator-controller-manager-56bc947947-99ng2\" (UID: \"3215ea4c-7857-427a-adca-ea9f1b2958d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.144786 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.144691    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:43.422101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.422014    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"]
Sep 09 21:47:43.426560 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:47:43.426519    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3215ea4c_7857_427a_adca_ea9f1b2958d9.slice/crio-b8158eba924d809069cc0b1e422b599b4ced8681867dbf0209f4cb8a330d88ee WatchSource:0}: Error finding container b8158eba924d809069cc0b1e422b599b4ced8681867dbf0209f4cb8a330d88ee: Status 404 returned error can't find the container with id b8158eba924d809069cc0b1e422b599b4ced8681867dbf0209f4cb8a330d88ee
Sep 09 21:47:43.820576 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:43.820544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2" event={"ID":"3215ea4c-7857-427a-adca-ea9f1b2958d9","Type":"ContainerStarted","Data":"b8158eba924d809069cc0b1e422b599b4ced8681867dbf0209f4cb8a330d88ee"}
Sep 09 21:47:46.835228 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:46.835189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2" event={"ID":"3215ea4c-7857-427a-adca-ea9f1b2958d9","Type":"ContainerStarted","Data":"f22525c5c4a3886abe0fe506fb4494b22965dd39cf74313ad47ed1a5b8a59a25"}
Sep 09 21:47:47.840125 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:47.840087    2560 generic.go:356] "Generic (PLEG): container finished" podID="3215ea4c-7857-427a-adca-ea9f1b2958d9" containerID="f22525c5c4a3886abe0fe506fb4494b22965dd39cf74313ad47ed1a5b8a59a25" exitCode=0
Sep 09 21:47:47.840543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:47.840151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2" event={"ID":"3215ea4c-7857-427a-adca-ea9f1b2958d9","Type":"ContainerDied","Data":"f22525c5c4a3886abe0fe506fb4494b22965dd39cf74313ad47ed1a5b8a59a25"}
Sep 09 21:47:48.845714 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:48.845676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2" event={"ID":"3215ea4c-7857-427a-adca-ea9f1b2958d9","Type":"ContainerStarted","Data":"92a1b14d47fb6718c77fda945868d1620580652fa5ea8d4ef9ca337be2b1e4e8"}
Sep 09 21:47:48.846070 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:48.845818    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:47:48.878154 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:48.878099    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2" podStartSLOduration=2.4333825669999998 podStartE2EDuration="6.878082409s" totalImagesPullingTime="3.385592912s" totalInitContainerRuntime="1.05910693s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:47:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:47:48.8770187 +0000 UTC m=+543.431678441" watchObservedRunningTime="2026-09-09 21:47:48.878082409 +0000 UTC m=+543.432742148"
Sep 09 21:47:59.852209 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:47:59.852178    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56bc947947-99ng2"
Sep 09 21:48:02.840757 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.840720    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"]
Sep 09 21:48:02.847392 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.847366    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:02.852643 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.852621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 21:48:02.852999 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.852977    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 21:48:02.853372 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.853349    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 21:48:02.853490 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.853372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 21:48:02.887797 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.887767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"]
Sep 09 21:48:02.967063 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.967033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tls-certs\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:02.967589 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.967549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tmp\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:02.967708 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:02.967622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x279c\" (UniqueName: \"kubernetes.io/projected/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-kube-api-access-x279c\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.068995 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.068935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x279c\" (UniqueName: \"kubernetes.io/projected/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-kube-api-access-x279c\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.069165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.069010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tls-certs\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.069165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.069076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tmp\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.069165 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:48:03.069130    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 09 21:48:03.069272 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:48:03.069202    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tls-certs podName:5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7 nodeName:}" failed. No retries permitted until 2026-09-09 21:48:03.56918215 +0000 UTC m=+558.123841879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tls-certs") pod "kube-auth-proxy-7b49d8b8f6-v9jxv" (UID: "5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7") : secret "kube-auth-proxy-tls" not found
Sep 09 21:48:03.071510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.071491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tmp\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.104386 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.104306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x279c\" (UniqueName: \"kubernetes.io/projected/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-kube-api-access-x279c\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.573686 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.573650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tls-certs\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.576226 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.576202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7-tls-certs\") pod \"kube-auth-proxy-7b49d8b8f6-v9jxv\" (UID: \"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7\") " pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:03.756329 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:03.756282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"
Sep 09 21:48:04.057703 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.057665    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv"]
Sep 09 21:48:04.067557 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:48:04.067528    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea38d48_03ed_4a20_bdc2_5fbe487a1fc7.slice/crio-e83688822d49ab48e22f29b524428d3de06b57ed07768d2223c95b9bcae2f0cc WatchSource:0}: Error finding container e83688822d49ab48e22f29b524428d3de06b57ed07768d2223c95b9bcae2f0cc: Status 404 returned error can't find the container with id e83688822d49ab48e22f29b524428d3de06b57ed07768d2223c95b9bcae2f0cc
Sep 09 21:48:04.737502 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.737445    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"]
Sep 09 21:48:04.740436 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.740413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.742615 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.742587    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 21:48:04.742789 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.742700    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-shdgb\""
Sep 09 21:48:04.743028 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.743011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 21:48:04.743302 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.743285    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 21:48:04.743378 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.743310    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 21:48:04.757631 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.757601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"]
Sep 09 21:48:04.783038 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.782985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d522de1a-e818-4f7e-b6e9-664218b37fab-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.783219 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.783050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.783219 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.783116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.783219 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.783159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.783219 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.783203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.783409 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.783232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.783409 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.783269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf75j\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-kube-api-access-kf75j\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884348 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf75j\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-kube-api-access-kf75j\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.884876 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.884760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d522de1a-e818-4f7e-b6e9-664218b37fab-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.885197 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.885171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.887618 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.887595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d522de1a-e818-4f7e-b6e9-664218b37fab-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.887776 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.887755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.887816 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.887777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.887816 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.887804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.893361 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.893333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.893510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.893454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf75j\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-kube-api-access-kf75j\") pod \"istiod-openshift-gateway-7b7995d5cd-rstlb\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:04.903317 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:04.903278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv" event={"ID":"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7","Type":"ContainerStarted","Data":"e83688822d49ab48e22f29b524428d3de06b57ed07768d2223c95b9bcae2f0cc"}
Sep 09 21:48:05.049543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:05.049437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:05.350963 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:05.350930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"]
Sep 09 21:48:05.354678 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:48:05.354650    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd522de1a_e818_4f7e_b6e9_664218b37fab.slice/crio-5bf21f65c6ceb4beba3c71dc774a53adaf91f4ca97defa9321a3e9a90592b03d WatchSource:0}: Error finding container 5bf21f65c6ceb4beba3c71dc774a53adaf91f4ca97defa9321a3e9a90592b03d: Status 404 returned error can't find the container with id 5bf21f65c6ceb4beba3c71dc774a53adaf91f4ca97defa9321a3e9a90592b03d
Sep 09 21:48:05.908412 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:05.908374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" event={"ID":"d522de1a-e818-4f7e-b6e9-664218b37fab","Type":"ContainerStarted","Data":"5bf21f65c6ceb4beba3c71dc774a53adaf91f4ca97defa9321a3e9a90592b03d"}
Sep 09 21:48:07.917362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:07.917324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv" event={"ID":"5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7","Type":"ContainerStarted","Data":"227fb3735b17368b8a3c6228fce9a625b32eae55394903147eb517946ddcd78b"}
Sep 09 21:48:07.933674 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:07.933618    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b49d8b8f6-v9jxv" podStartSLOduration=2.940704046 podStartE2EDuration="5.93359787s" totalImagesPullingTime="2.992893824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:48:07.932314301 +0000 UTC m=+562.486974041" watchObservedRunningTime="2026-09-09 21:48:07.93359787 +0000 UTC m=+562.488257610"
Sep 09 21:48:10.935619 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:10.935574    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:48:10.935914 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:10.935649    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:48:11.935804 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:11.935766    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" event={"ID":"d522de1a-e818-4f7e-b6e9-664218b37fab","Type":"ContainerStarted","Data":"c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45"}
Sep 09 21:48:11.936187 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:11.936025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:11.937700 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:11.937672    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-rstlb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 21:48:11.937836 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:11.937726    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" podUID="d522de1a-e818-4f7e-b6e9-664218b37fab" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:48:11.960051 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:11.959987    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" podStartSLOduration=2.38208191 podStartE2EDuration="7.959963615s" totalImagesPullingTime="5.577881705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:48:11.959154529 +0000 UTC m=+566.513814260" watchObservedRunningTime="2026-09-09 21:48:11.959963615 +0000 UTC m=+566.514623357"
Sep 09 21:48:12.941224 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:12.941196    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:20.979272 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:20.979233    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"]
Sep 09 21:48:20.985756 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:20.985733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:20.995959 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:20.995932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"]
Sep 09 21:48:21.116705 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qs8s\" (UniqueName: \"kubernetes.io/projected/629adda4-95ac-4a77-a462-a53d0899ac95-kube-api-access-9qs8s\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.116705 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/629adda4-95ac-4a77-a462-a53d0899ac95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.116910 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.116910 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.116910 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/629adda4-95ac-4a77-a462-a53d0899ac95-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.116910 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.116910 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.116893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/629adda4-95ac-4a77-a462-a53d0899ac95-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.217848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.217804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.217848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.217844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.218105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.217873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/629adda4-95ac-4a77-a462-a53d0899ac95-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.218105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.217895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.218105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.218032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/629adda4-95ac-4a77-a462-a53d0899ac95-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.218254 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.218124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qs8s\" (UniqueName: \"kubernetes.io/projected/629adda4-95ac-4a77-a462-a53d0899ac95-kube-api-access-9qs8s\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.218254 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.218162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/629adda4-95ac-4a77-a462-a53d0899ac95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.218807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.218783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/629adda4-95ac-4a77-a462-a53d0899ac95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.220516 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.220491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.220600 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.220492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.220797 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.220781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/629adda4-95ac-4a77-a462-a53d0899ac95-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.220913 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.220895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/629adda4-95ac-4a77-a462-a53d0899ac95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.229634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.229577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qs8s\" (UniqueName: \"kubernetes.io/projected/629adda4-95ac-4a77-a462-a53d0899ac95-kube-api-access-9qs8s\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.230692 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.230675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/629adda4-95ac-4a77-a462-a53d0899ac95-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8rd2r\" (UID: \"629adda4-95ac-4a77-a462-a53d0899ac95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.295339 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.295304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:21.572632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.572606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"]
Sep 09 21:48:21.575282 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:48:21.575253    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629adda4_95ac_4a77_a462_a53d0899ac95.slice/crio-60224ccdefe018474b27381f129c349c0495310ec03694489c673533e82d208b WatchSource:0}: Error finding container 60224ccdefe018474b27381f129c349c0495310ec03694489c673533e82d208b: Status 404 returned error can't find the container with id 60224ccdefe018474b27381f129c349c0495310ec03694489c673533e82d208b
Sep 09 21:48:21.577256 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.577218    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:48:21.577334 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.577289    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:48:21.976542 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.976414    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r" event={"ID":"629adda4-95ac-4a77-a462-a53d0899ac95","Type":"ContainerStarted","Data":"1c72c952053d3a5e796e8477b18642708c9507ca4b5b731f7bc05d86cab91d09"}
Sep 09 21:48:21.976542 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.976507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r" event={"ID":"629adda4-95ac-4a77-a462-a53d0899ac95","Type":"ContainerStarted","Data":"60224ccdefe018474b27381f129c349c0495310ec03694489c673533e82d208b"}
Sep 09 21:48:21.977384 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:21.977349    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:22.025951 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:22.025890    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r" podStartSLOduration=2.025867421 podStartE2EDuration="2.025867421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:48:22.02481659 +0000 UTC m=+576.579476331" watchObservedRunningTime="2026-09-09 21:48:22.025867421 +0000 UTC m=+576.580527161"
Sep 09 21:48:22.981702 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:22.981666    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8rd2r"
Sep 09 21:48:23.063529 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.063493    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"]
Sep 09 21:48:23.064026 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.063709    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" podUID="d522de1a-e818-4f7e-b6e9-664218b37fab" containerName="discovery" containerID="cri-o://c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45" gracePeriod=30
Sep 09 21:48:23.301327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.301299    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:23.436838 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436793    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-dns-cert\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.436838 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436842    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf75j\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-kube-api-access-kf75j\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.437101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-token\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.437101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436883    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-kubeconfig\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.437101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436902    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-cacerts\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.437101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436960    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d522de1a-e818-4f7e-b6e9-664218b37fab-local-certs\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.437101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.436982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-ca-configmap\") pod \"d522de1a-e818-4f7e-b6e9-664218b37fab\" (UID: \"d522de1a-e818-4f7e-b6e9-664218b37fab\") "
Sep 09 21:48:23.437490 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.437412    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:48:23.439521 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.439494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:48:23.439521 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.439501    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d522de1a-e818-4f7e-b6e9-664218b37fab-local-certs" (OuterVolumeSpecName: "local-certs") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:48:23.439767 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.439741    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-cacerts" (OuterVolumeSpecName: "cacerts") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:48:23.439865 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.439829    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-token" (OuterVolumeSpecName: "istio-token") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:48:23.439865 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.439834    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:48:23.439955 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.439869    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-kube-api-access-kf75j" (OuterVolumeSpecName: "kube-api-access-kf75j") pod "d522de1a-e818-4f7e-b6e9-664218b37fab" (UID: "d522de1a-e818-4f7e-b6e9-664218b37fab"). InnerVolumeSpecName "kube-api-access-kf75j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538273    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-cacerts\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538305    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d522de1a-e818-4f7e-b6e9-664218b37fab-local-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538317    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-ca-configmap\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538328    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-csr-dns-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538339    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf75j\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-kube-api-access-kf75j\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538346    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.538362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.538354    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d522de1a-e818-4f7e-b6e9-664218b37fab-istio-kubeconfig\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:48:23.986225 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.986190    2560 generic.go:356] "Generic (PLEG): container finished" podID="d522de1a-e818-4f7e-b6e9-664218b37fab" containerID="c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45" exitCode=0
Sep 09 21:48:23.986376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.986235    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"
Sep 09 21:48:23.986376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.986270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" event={"ID":"d522de1a-e818-4f7e-b6e9-664218b37fab","Type":"ContainerDied","Data":"c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45"}
Sep 09 21:48:23.986376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.986324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb" event={"ID":"d522de1a-e818-4f7e-b6e9-664218b37fab","Type":"ContainerDied","Data":"5bf21f65c6ceb4beba3c71dc774a53adaf91f4ca97defa9321a3e9a90592b03d"}
Sep 09 21:48:23.986376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.986347    2560 scope.go:117] "RemoveContainer" containerID="c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45"
Sep 09 21:48:23.996513 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.996490    2560 scope.go:117] "RemoveContainer" containerID="c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45"
Sep 09 21:48:23.996846 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:48:23.996814    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45\": container with ID starting with c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45 not found: ID does not exist" containerID="c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45"
Sep 09 21:48:23.996899 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:23.996857    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45"} err="failed to get container status \"c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45\": rpc error: code = NotFound desc = could not find container \"c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45\": container with ID starting with c1adcf59bc3db019c470350b1d849c3271bb2b4533af4b909fe1a8f936069a45 not found: ID does not exist"
Sep 09 21:48:24.003563 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:24.003539    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"]
Sep 09 21:48:24.010285 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:24.010261    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rstlb"]
Sep 09 21:48:25.915480 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:48:25.915433    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d522de1a-e818-4f7e-b6e9-664218b37fab" path="/var/lib/kubelet/pods/d522de1a-e818-4f7e-b6e9-664218b37fab/volumes"
Sep 09 21:49:29.758124 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.758079    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-cprsg"]
Sep 09 21:49:29.758651 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.758345    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d522de1a-e818-4f7e-b6e9-664218b37fab" containerName="discovery"
Sep 09 21:49:29.758651 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.758356    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d522de1a-e818-4f7e-b6e9-664218b37fab" containerName="discovery"
Sep 09 21:49:29.758651 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.758401    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d522de1a-e818-4f7e-b6e9-664218b37fab" containerName="discovery"
Sep 09 21:49:29.760213 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.760197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:29.763034 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.763009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 21:49:29.763187 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.763043    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 21:49:29.763841 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.763823    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vk2pj\""
Sep 09 21:49:29.771950 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.771928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-cprsg"]
Sep 09 21:49:29.848521 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.848485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92hhs\" (UniqueName: \"kubernetes.io/projected/bb237aa2-8e39-41cf-8a99-ff006b7b0646-kube-api-access-92hhs\") pod \"authorino-operator-76b478bd78-cprsg\" (UID: \"bb237aa2-8e39-41cf-8a99-ff006b7b0646\") " pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:29.949832 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.949789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hhs\" (UniqueName: \"kubernetes.io/projected/bb237aa2-8e39-41cf-8a99-ff006b7b0646-kube-api-access-92hhs\") pod \"authorino-operator-76b478bd78-cprsg\" (UID: \"bb237aa2-8e39-41cf-8a99-ff006b7b0646\") " pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:29.961362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:29.961332    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92hhs\" (UniqueName: \"kubernetes.io/projected/bb237aa2-8e39-41cf-8a99-ff006b7b0646-kube-api-access-92hhs\") pod \"authorino-operator-76b478bd78-cprsg\" (UID: \"bb237aa2-8e39-41cf-8a99-ff006b7b0646\") " pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:30.069617 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:30.069567    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:30.345519 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:30.345399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-cprsg"]
Sep 09 21:49:30.348237 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:49:30.348209    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb237aa2_8e39_41cf_8a99_ff006b7b0646.slice/crio-94c7368a315300f11476b33edf29ffc0850b42bf6a3775f57e9a0b34ae425760 WatchSource:0}: Error finding container 94c7368a315300f11476b33edf29ffc0850b42bf6a3775f57e9a0b34ae425760: Status 404 returned error can't find the container with id 94c7368a315300f11476b33edf29ffc0850b42bf6a3775f57e9a0b34ae425760
Sep 09 21:49:31.231447 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:31.231408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg" event={"ID":"bb237aa2-8e39-41cf-8a99-ff006b7b0646","Type":"ContainerStarted","Data":"94c7368a315300f11476b33edf29ffc0850b42bf6a3775f57e9a0b34ae425760"}
Sep 09 21:49:31.965494 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:31.965382    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"]
Sep 09 21:49:31.967991 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:31.967948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:31.970446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:31.970411    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-v8995\""
Sep 09 21:49:31.970735 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:31.970705    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 21:49:31.979622 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:31.979580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"]
Sep 09 21:49:32.068248 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:32.068107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdktw\" (UniqueName: \"kubernetes.io/projected/9f4a3c03-a8f1-455f-a2d3-49f2a362ab11-kube-api-access-zdktw\") pod \"dns-operator-controller-manager-7b84cd7c9c-ms9bj\" (UID: \"9f4a3c03-a8f1-455f-a2d3-49f2a362ab11\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:32.169226 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:32.169194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdktw\" (UniqueName: \"kubernetes.io/projected/9f4a3c03-a8f1-455f-a2d3-49f2a362ab11-kube-api-access-zdktw\") pod \"dns-operator-controller-manager-7b84cd7c9c-ms9bj\" (UID: \"9f4a3c03-a8f1-455f-a2d3-49f2a362ab11\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:32.194749 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:32.194710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdktw\" (UniqueName: \"kubernetes.io/projected/9f4a3c03-a8f1-455f-a2d3-49f2a362ab11-kube-api-access-zdktw\") pod \"dns-operator-controller-manager-7b84cd7c9c-ms9bj\" (UID: \"9f4a3c03-a8f1-455f-a2d3-49f2a362ab11\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:32.283032 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:32.282944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:32.560740 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:32.560707    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"]
Sep 09 21:49:33.290326 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:49:33.290282    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4a3c03_a8f1_455f_a2d3_49f2a362ab11.slice/crio-f3394f7582f5c91b8e202a4cec619517e6df45963ca112140f39c7eb7626642a WatchSource:0}: Error finding container f3394f7582f5c91b8e202a4cec619517e6df45963ca112140f39c7eb7626642a: Status 404 returned error can't find the container with id f3394f7582f5c91b8e202a4cec619517e6df45963ca112140f39c7eb7626642a
Sep 09 21:49:34.246060 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:34.246022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg" event={"ID":"bb237aa2-8e39-41cf-8a99-ff006b7b0646","Type":"ContainerStarted","Data":"ab3c3cc7d8c399cdd61a1d79f800e3bb70f078f002b55e8fc3fc5e646d958e04"}
Sep 09 21:49:34.246259 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:34.246118    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:34.247325 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:34.247300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj" event={"ID":"9f4a3c03-a8f1-455f-a2d3-49f2a362ab11","Type":"ContainerStarted","Data":"f3394f7582f5c91b8e202a4cec619517e6df45963ca112140f39c7eb7626642a"}
Sep 09 21:49:34.293546 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:34.293490    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg" podStartSLOduration=2.310607642 podStartE2EDuration="5.293448708s" totalImagesPullingTime="2.982841066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:49:34.292808864 +0000 UTC m=+648.847468604" watchObservedRunningTime="2026-09-09 21:49:34.293448708 +0000 UTC m=+648.848108447"
Sep 09 21:49:35.254394 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:35.254348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj" event={"ID":"9f4a3c03-a8f1-455f-a2d3-49f2a362ab11","Type":"ContainerStarted","Data":"f9142e500946fb5fd8b5162e3d9eef192cabfb3799219840ba3fcddd546bc628"}
Sep 09 21:49:35.280431 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:35.280379    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj" podStartSLOduration=2.376216058 podStartE2EDuration="4.280361676s" totalImagesPullingTime="1.904145618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:49:35.278906616 +0000 UTC m=+649.833566357" watchObservedRunningTime="2026-09-09 21:49:35.280361676 +0000 UTC m=+649.835021416"
Sep 09 21:49:36.258658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.258623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:36.328237 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.328196    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"]
Sep 09 21:49:36.331492 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.331455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.333693 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.333672    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7rl5w\""
Sep 09 21:49:36.343501 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.343455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"]
Sep 09 21:49:36.505016 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.504978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxbx5\" (UniqueName: \"kubernetes.io/projected/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-kube-api-access-zxbx5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.505197 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.505036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.605660 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.605627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxbx5\" (UniqueName: \"kubernetes.io/projected/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-kube-api-access-zxbx5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.605764 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.605689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.606100 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.606080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.616736 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.616706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxbx5\" (UniqueName: \"kubernetes.io/projected/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-kube-api-access-zxbx5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.641439 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.641401    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:36.930596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:36.930554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"]
Sep 09 21:49:36.932646 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:49:36.932615    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac068169_82ee_44c4_be2d_4cb62b5bb9cb.slice/crio-7ec55d5dd1125440e0467305ffb72731e85d85eda884195ae42e55b9a3f55068 WatchSource:0}: Error finding container 7ec55d5dd1125440e0467305ffb72731e85d85eda884195ae42e55b9a3f55068: Status 404 returned error can't find the container with id 7ec55d5dd1125440e0467305ffb72731e85d85eda884195ae42e55b9a3f55068
Sep 09 21:49:37.264192 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:37.264103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q" event={"ID":"ac068169-82ee-44c4-be2d-4cb62b5bb9cb","Type":"ContainerStarted","Data":"7ec55d5dd1125440e0467305ffb72731e85d85eda884195ae42e55b9a3f55068"}
Sep 09 21:49:41.284521 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:41.284479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q" event={"ID":"ac068169-82ee-44c4-be2d-4cb62b5bb9cb","Type":"ContainerStarted","Data":"0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e"}
Sep 09 21:49:41.284952 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:41.284587    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:41.306105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:41.306051    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q" podStartSLOduration=1.468276788 podStartE2EDuration="5.306031048s" totalImagesPullingTime="3.83775426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:49:41.304551676 +0000 UTC m=+655.859211416" watchObservedRunningTime="2026-09-09 21:49:41.306031048 +0000 UTC m=+655.860690789"
Sep 09 21:49:45.257380 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:45.257350    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-cprsg"
Sep 09 21:49:47.267196 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:47.267159    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ms9bj"
Sep 09 21:49:52.291351 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:52.291321    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:54.260954 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.260915    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"]
Sep 09 21:49:54.265480 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.265441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:54.278726 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.278694    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"]
Sep 09 21:49:54.334058 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.334015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:54.334241 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.334130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jh6t\" (UniqueName: \"kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:54.412755 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.412712    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"]
Sep 09 21:49:54.413067 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.413039    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-8jh6t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht" podUID="eee23efc-1ba4-4b1a-978b-1e33b2bb35fe"
Sep 09 21:49:54.419827 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.419793    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"]
Sep 09 21:49:54.429228 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.429197    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"]
Sep 09 21:49:54.429566 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.429532    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" containerName="manager" containerID="cri-o://0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e" gracePeriod=2
Sep 09 21:49:54.435101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.435069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jh6t\" (UniqueName: \"kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:54.435230 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.435159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:54.435611 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.435588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:54.439886 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.439863    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8jh6t for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-vplht" not found
Sep 09 21:49:54.439971 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.439954    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t podName:eee23efc-1ba4-4b1a-978b-1e33b2bb35fe nodeName:}" failed. No retries permitted until 2026-09-09 21:49:54.939933022 +0000 UTC m=+669.494592759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8jh6t" (UniqueName: "kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t") pod "kuadrant-operator-controller-manager-5769f99d9f-vplht" (UID: "eee23efc-1ba4-4b1a-978b-1e33b2bb35fe") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-vplht" not found
Sep 09 21:49:54.444151 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.444124    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"]
Sep 09 21:49:54.447278 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.447254    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"]
Sep 09 21:49:54.447396 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.447377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.451259 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.451229    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-sn55q\": pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:54.452915 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.452878    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:54.457578 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.457552    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"]
Sep 09 21:49:54.457846 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.457831    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" containerName="manager"
Sep 09 21:49:54.457846 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.457846    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" containerName="manager"
Sep 09 21:49:54.457979 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.457897    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" containerName="manager"
Sep 09 21:49:54.460715 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.460681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.461489 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.461441    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"]
Sep 09 21:49:54.480415 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.480380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"]
Sep 09 21:49:54.485870 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.485837    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:54.536210 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.536124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137b294d-b46f-4704-b126-c468a33d0641-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtm52\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.536210 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.536184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kssk6\" (UniqueName: \"kubernetes.io/projected/137b294d-b46f-4704-b126-c468a33d0641-kube-api-access-kssk6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtm52\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.637011 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.636979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137b294d-b46f-4704-b126-c468a33d0641-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtm52\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.637172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.637028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5c7185-0582-413a-9142-59fee4e8eabe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w69rd\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.637172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.637053    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwkn2\" (UniqueName: \"kubernetes.io/projected/3f5c7185-0582-413a-9142-59fee4e8eabe-kube-api-access-fwkn2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w69rd\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.637172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.637084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kssk6\" (UniqueName: \"kubernetes.io/projected/137b294d-b46f-4704-b126-c468a33d0641-kube-api-access-kssk6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtm52\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.637450 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.637423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137b294d-b46f-4704-b126-c468a33d0641-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtm52\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.645319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.645287    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kssk6\" (UniqueName: \"kubernetes.io/projected/137b294d-b46f-4704-b126-c468a33d0641-kube-api-access-kssk6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dtm52\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.670305 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.670279    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:54.672196 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:54.672168    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:54.737335 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.737302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxbx5\" (UniqueName: \"kubernetes.io/projected/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-kube-api-access-zxbx5\") pod \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") "
Sep 09 21:49:54.737526 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.737362    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-extensions-socket-volume\") pod \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\" (UID: \"ac068169-82ee-44c4-be2d-4cb62b5bb9cb\") "
Sep 09 21:49:54.737526 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.737445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5c7185-0582-413a-9142-59fee4e8eabe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w69rd\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.737526 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.737498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwkn2\" (UniqueName: \"kubernetes.io/projected/3f5c7185-0582-413a-9142-59fee4e8eabe-kube-api-access-fwkn2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w69rd\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.737850 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.737813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac068169-82ee-44c4-be2d-4cb62b5bb9cb" (UID: "ac068169-82ee-44c4-be2d-4cb62b5bb9cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:49:54.737952 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.737871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5c7185-0582-413a-9142-59fee4e8eabe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w69rd\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.739829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.739795    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-kube-api-access-zxbx5" (OuterVolumeSpecName: "kube-api-access-zxbx5") pod "ac068169-82ee-44c4-be2d-4cb62b5bb9cb" (UID: "ac068169-82ee-44c4-be2d-4cb62b5bb9cb"). InnerVolumeSpecName "kube-api-access-zxbx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:49:54.747711 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.747691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwkn2\" (UniqueName: \"kubernetes.io/projected/3f5c7185-0582-413a-9142-59fee4e8eabe-kube-api-access-fwkn2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w69rd\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.806754 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.806720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:54.813890 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.813867    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:54.838021 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.837980    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-extensions-socket-volume\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:49:54.838021 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:54.838011    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxbx5\" (UniqueName: \"kubernetes.io/projected/ac068169-82ee-44c4-be2d-4cb62b5bb9cb-kube-api-access-zxbx5\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:49:55.039544 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.039508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jh6t\" (UniqueName: \"kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:55.041735 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.041714    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8jh6t for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-vplht" not found
Sep 09 21:49:55.041838 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.041791    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t podName:eee23efc-1ba4-4b1a-978b-1e33b2bb35fe nodeName:}" failed. No retries permitted until 2026-09-09 21:49:56.041772615 +0000 UTC m=+670.596432333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jh6t" (UniqueName: "kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t") pod "kuadrant-operator-controller-manager-5769f99d9f-vplht" (UID: "eee23efc-1ba4-4b1a-978b-1e33b2bb35fe") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-vplht" not found
Sep 09 21:49:55.102223 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.102191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"]
Sep 09 21:49:55.104871 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:49:55.104838    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5c7185_0582_413a_9142_59fee4e8eabe.slice/crio-a556b00dfe7f5765e149e672628728bfe79ee1f91fe04c44b03098874640502c WatchSource:0}: Error finding container a556b00dfe7f5765e149e672628728bfe79ee1f91fe04c44b03098874640502c: Status 404 returned error can't find the container with id a556b00dfe7f5765e149e672628728bfe79ee1f91fe04c44b03098874640502c
Sep 09 21:49:55.111142 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.111119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"]
Sep 09 21:49:55.114165 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:49:55.114143    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137b294d_b46f_4704_b126_c468a33d0641.slice/crio-a5919bfb49ddd59cde06afad22299282a0a288066823060a13aa7a90299e938f WatchSource:0}: Error finding container a5919bfb49ddd59cde06afad22299282a0a288066823060a13aa7a90299e938f: Status 404 returned error can't find the container with id a5919bfb49ddd59cde06afad22299282a0a288066823060a13aa7a90299e938f
Sep 09 21:49:55.349247 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.349209    2560 generic.go:356] "Generic (PLEG): container finished" podID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" containerID="0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e" exitCode=0
Sep 09 21:49:55.349247 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.349250    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:55.349769 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.349308    2560 scope.go:117] "RemoveContainer" containerID="0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e"
Sep 09 21:49:55.351356 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.351320    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:55.351657 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.351630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd" event={"ID":"3f5c7185-0582-413a-9142-59fee4e8eabe","Type":"ContainerStarted","Data":"25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88"}
Sep 09 21:49:55.351759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.351684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd" event={"ID":"3f5c7185-0582-413a-9142-59fee4e8eabe","Type":"ContainerStarted","Data":"a556b00dfe7f5765e149e672628728bfe79ee1f91fe04c44b03098874640502c"}
Sep 09 21:49:55.351759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.351715    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:49:55.353405 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.353331    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:55.353550 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.353438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52" event={"ID":"137b294d-b46f-4704-b126-c468a33d0641","Type":"ContainerStarted","Data":"14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d"}
Sep 09 21:49:55.353550 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.353455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:55.353550 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.353504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52" event={"ID":"137b294d-b46f-4704-b126-c468a33d0641","Type":"ContainerStarted","Data":"a5919bfb49ddd59cde06afad22299282a0a288066823060a13aa7a90299e938f"}
Sep 09 21:49:55.358786 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.358358    2560 scope.go:117] "RemoveContainer" containerID="0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e"
Sep 09 21:49:55.358927 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.358900    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e\": container with ID starting with 0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e not found: ID does not exist" containerID="0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e"
Sep 09 21:49:55.359021 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.358939    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e"} err="failed to get container status \"0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e\": rpc error: code = NotFound desc = could not find container \"0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e\": container with ID starting with 0b84f0017226efaee047b0c754cf08db40e65fdda0dbfd06eab0e229b031c14e not found: ID does not exist"
Sep 09 21:49:55.362276 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.362256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:55.379303 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.379259    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd" podStartSLOduration=1.3792436559999999 podStartE2EDuration="1.379243656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:49:55.377512856 +0000 UTC m=+669.932172595" watchObservedRunningTime="2026-09-09 21:49:55.379243656 +0000 UTC m=+669.933903396"
Sep 09 21:49:55.379501 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.379453    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:55.396982 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.396892    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52" podStartSLOduration=1.396868724 podStartE2EDuration="1.396868724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:49:55.396607722 +0000 UTC m=+669.951267475" watchObservedRunningTime="2026-09-09 21:49:55.396868724 +0000 UTC m=+669.951528475"
Sep 09 21:49:55.398292 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.398234    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="eee23efc-1ba4-4b1a-978b-1e33b2bb35fe" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:55.443327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.443297    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-extensions-socket-volume\") pod \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\" (UID: \"eee23efc-1ba4-4b1a-978b-1e33b2bb35fe\") "
Sep 09 21:49:55.443554 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.443534    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jh6t\" (UniqueName: \"kubernetes.io/projected/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-kube-api-access-8jh6t\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:49:55.443636 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.443545    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eee23efc-1ba4-4b1a-978b-1e33b2bb35fe" (UID: "eee23efc-1ba4-4b1a-978b-1e33b2bb35fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:49:55.544180 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.544144    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe-extensions-socket-volume\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:49:55.914099 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.914057    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-sn55q\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sn55q"
Sep 09 21:49:55.915530 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.915491    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac068169-82ee-44c4-be2d-4cb62b5bb9cb" path="/var/lib/kubelet/pods/ac068169-82ee-44c4-be2d-4cb62b5bb9cb/volumes"
Sep 09 21:49:55.915808 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:55.915785    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="eee23efc-1ba4-4b1a-978b-1e33b2bb35fe" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:55.915862 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:55.915817    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee23efc-1ba4-4b1a-978b-1e33b2bb35fe" path="/var/lib/kubelet/pods/eee23efc-1ba4-4b1a-978b-1e33b2bb35fe/volumes"
Sep 09 21:49:56.359181 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:56.359142    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:49:56.359661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:49:56.359220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:49:56.363188 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:49:56.363152    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-vplht\" is forbidden: User \"system:node:ip-10-0-137-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-189.ec2.internal' and this object" podUID="eee23efc-1ba4-4b1a-978b-1e33b2bb35fe" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-vplht"
Sep 09 21:50:06.361617 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.361576    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 21:50:06.425301 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.425270    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"]
Sep 09 21:50:06.425495 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.425450    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52" podUID="137b294d-b46f-4704-b126-c468a33d0641" containerName="manager" containerID="cri-o://14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d" gracePeriod=10
Sep 09 21:50:06.427413 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.427387    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:50:06.702297 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.702263    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:50:06.719827 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.719794    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kssk6\" (UniqueName: \"kubernetes.io/projected/137b294d-b46f-4704-b126-c468a33d0641-kube-api-access-kssk6\") pod \"137b294d-b46f-4704-b126-c468a33d0641\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") "
Sep 09 21:50:06.719981 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.719838    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137b294d-b46f-4704-b126-c468a33d0641-extensions-socket-volume\") pod \"137b294d-b46f-4704-b126-c468a33d0641\" (UID: \"137b294d-b46f-4704-b126-c468a33d0641\") "
Sep 09 21:50:06.720379 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.720342    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137b294d-b46f-4704-b126-c468a33d0641-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "137b294d-b46f-4704-b126-c468a33d0641" (UID: "137b294d-b46f-4704-b126-c468a33d0641"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:50:06.722118 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.722090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137b294d-b46f-4704-b126-c468a33d0641-kube-api-access-kssk6" (OuterVolumeSpecName: "kube-api-access-kssk6") pod "137b294d-b46f-4704-b126-c468a33d0641" (UID: "137b294d-b46f-4704-b126-c468a33d0641"). InnerVolumeSpecName "kube-api-access-kssk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:50:06.820638 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.820593    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kssk6\" (UniqueName: \"kubernetes.io/projected/137b294d-b46f-4704-b126-c468a33d0641-kube-api-access-kssk6\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:50:06.820638 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:06.820627    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137b294d-b46f-4704-b126-c468a33d0641-extensions-socket-volume\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:50:07.410539 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.410496    2560 generic.go:356] "Generic (PLEG): container finished" podID="137b294d-b46f-4704-b126-c468a33d0641" containerID="14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d" exitCode=0
Sep 09 21:50:07.410918 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.410553    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"
Sep 09 21:50:07.410918 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.410559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52" event={"ID":"137b294d-b46f-4704-b126-c468a33d0641","Type":"ContainerDied","Data":"14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d"}
Sep 09 21:50:07.410918 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.410645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52" event={"ID":"137b294d-b46f-4704-b126-c468a33d0641","Type":"ContainerDied","Data":"a5919bfb49ddd59cde06afad22299282a0a288066823060a13aa7a90299e938f"}
Sep 09 21:50:07.410918 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.410668    2560 scope.go:117] "RemoveContainer" containerID="14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d"
Sep 09 21:50:07.418935 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.418916    2560 scope.go:117] "RemoveContainer" containerID="14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d"
Sep 09 21:50:07.419217 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:50:07.419200    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d\": container with ID starting with 14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d not found: ID does not exist" containerID="14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d"
Sep 09 21:50:07.419266 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.419224    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d"} err="failed to get container status \"14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d\": rpc error: code = NotFound desc = could not find container \"14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d\": container with ID starting with 14365c654e587211ccca2cb7c46776abffbd34b121c25c7a205cbd99f333ff9d not found: ID does not exist"
Sep 09 21:50:07.456773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.456738    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"]
Sep 09 21:50:07.476973 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.476933    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dtm52"]
Sep 09 21:50:07.916042 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:07.916003    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="137b294d-b46f-4704-b126-c468a33d0641" path="/var/lib/kubelet/pods/137b294d-b46f-4704-b126-c468a33d0641/volumes"
Sep 09 21:50:25.319235 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.319198    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:50:25.319721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.319491    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137b294d-b46f-4704-b126-c468a33d0641" containerName="manager"
Sep 09 21:50:25.319721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.319506    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="137b294d-b46f-4704-b126-c468a33d0641" containerName="manager"
Sep 09 21:50:25.319721 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.319558    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="137b294d-b46f-4704-b126-c468a33d0641" containerName="manager"
Sep 09 21:50:25.321565 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.321546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.323509 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.323485    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 21:50:25.323640 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.323529    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-252jf\""
Sep 09 21:50:25.333884 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.333859    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:50:25.358397 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.358360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a2b2d383-983e-43c7-98b3-eb4d02da10ae-config-file\") pod \"limitador-limitador-84994f7ffc-fk9r6\" (UID: \"a2b2d383-983e-43c7-98b3-eb4d02da10ae\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.358575 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.358416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjc8f\" (UniqueName: \"kubernetes.io/projected/a2b2d383-983e-43c7-98b3-eb4d02da10ae-kube-api-access-kjc8f\") pod \"limitador-limitador-84994f7ffc-fk9r6\" (UID: \"a2b2d383-983e-43c7-98b3-eb4d02da10ae\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.358688 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.358666    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:50:25.459338 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.459303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjc8f\" (UniqueName: \"kubernetes.io/projected/a2b2d383-983e-43c7-98b3-eb4d02da10ae-kube-api-access-kjc8f\") pod \"limitador-limitador-84994f7ffc-fk9r6\" (UID: \"a2b2d383-983e-43c7-98b3-eb4d02da10ae\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.459533 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.459392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a2b2d383-983e-43c7-98b3-eb4d02da10ae-config-file\") pod \"limitador-limitador-84994f7ffc-fk9r6\" (UID: \"a2b2d383-983e-43c7-98b3-eb4d02da10ae\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.460030 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.460002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a2b2d383-983e-43c7-98b3-eb4d02da10ae-config-file\") pod \"limitador-limitador-84994f7ffc-fk9r6\" (UID: \"a2b2d383-983e-43c7-98b3-eb4d02da10ae\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.467257 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.467137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjc8f\" (UniqueName: \"kubernetes.io/projected/a2b2d383-983e-43c7-98b3-eb4d02da10ae-kube-api-access-kjc8f\") pod \"limitador-limitador-84994f7ffc-fk9r6\" (UID: \"a2b2d383-983e-43c7-98b3-eb4d02da10ae\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.632157 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.632077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:25.903269 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:25.903049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:50:25.906003 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:50:25.905978    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b2d383_983e_43c7_98b3_eb4d02da10ae.slice/crio-8e34f0a225d6888d826b616e90ad0375ff572248f8b75081f3ee1222b311b717 WatchSource:0}: Error finding container 8e34f0a225d6888d826b616e90ad0375ff572248f8b75081f3ee1222b311b717: Status 404 returned error can't find the container with id 8e34f0a225d6888d826b616e90ad0375ff572248f8b75081f3ee1222b311b717
Sep 09 21:50:26.498241 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:26.498190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6" event={"ID":"a2b2d383-983e-43c7-98b3-eb4d02da10ae","Type":"ContainerStarted","Data":"8e34f0a225d6888d826b616e90ad0375ff572248f8b75081f3ee1222b311b717"}
Sep 09 21:50:27.503490 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:27.503434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6" event={"ID":"a2b2d383-983e-43c7-98b3-eb4d02da10ae","Type":"ContainerStarted","Data":"f74530745355dabedd9e7742662282104b7634b3e69bf1f766dc5bd85ba983c2"}
Sep 09 21:50:27.503883 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:27.503550    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:50:27.521274 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:27.521223    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6" podStartSLOduration=1.656851715 podStartE2EDuration="2.521205875s" totalImagesPullingTime="864.35416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:50:27.519940554 +0000 UTC m=+702.074600294" watchObservedRunningTime="2026-09-09 21:50:27.521205875 +0000 UTC m=+702.075865615"
Sep 09 21:50:38.510105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:50:38.510021    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"
Sep 09 21:51:37.167872 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:37.167832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:51:52.371556 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.371520    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"]
Sep 09 21:51:52.373981 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.373953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.376281 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.376255    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 21:51:52.376281 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.376266    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 21:51:52.377084 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.377062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 21:51:52.377084 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.377084    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5x6f2\""
Sep 09 21:51:52.385943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.385916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"]
Sep 09 21:51:52.480837 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.480798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.481020 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.480847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.481020 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.480895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.481020 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.480928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwjm\" (UniqueName: \"kubernetes.io/projected/8841ef22-0a46-470a-a9f6-e734ea93650d-kube-api-access-nxwjm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.481020 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.480986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.481158 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.481032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8841ef22-0a46-470a-a9f6-e734ea93650d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.581781 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.581740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.581781 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.581782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.581999 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.581807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.581999 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.581859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwjm\" (UniqueName: \"kubernetes.io/projected/8841ef22-0a46-470a-a9f6-e734ea93650d-kube-api-access-nxwjm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.581999 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.581889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.581999 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.581924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8841ef22-0a46-470a-a9f6-e734ea93650d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.582233 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.582210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.582277 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.582259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.582312 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.582283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.584299 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.584276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8841ef22-0a46-470a-a9f6-e734ea93650d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.584561 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.584543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8841ef22-0a46-470a-a9f6-e734ea93650d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.589282 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.589254    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwjm\" (UniqueName: \"kubernetes.io/projected/8841ef22-0a46-470a-a9f6-e734ea93650d-kube-api-access-nxwjm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d\" (UID: \"8841ef22-0a46-470a-a9f6-e734ea93650d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.685642 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.685554    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:51:52.857730 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.857685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:51:52.967717 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:52.967569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"]
Sep 09 21:51:52.969841 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:51:52.969811    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8841ef22_0a46_470a_a9f6_e734ea93650d.slice/crio-ae0aa781b5f3f24e22a5f32ab79f0c6bb40016ba8af6c559be88146df5641782 WatchSource:0}: Error finding container ae0aa781b5f3f24e22a5f32ab79f0c6bb40016ba8af6c559be88146df5641782: Status 404 returned error can't find the container with id ae0aa781b5f3f24e22a5f32ab79f0c6bb40016ba8af6c559be88146df5641782
Sep 09 21:51:53.868314 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:53.868272    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d" event={"ID":"8841ef22-0a46-470a-a9f6-e734ea93650d","Type":"ContainerStarted","Data":"ae0aa781b5f3f24e22a5f32ab79f0c6bb40016ba8af6c559be88146df5641782"}
Sep 09 21:51:54.874571 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:54.874526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d" event={"ID":"8841ef22-0a46-470a-a9f6-e734ea93650d","Type":"ContainerStarted","Data":"8990c67665b2e46025c48296e545d284c2f577ffe8c75c051b81349a21baa9c8"}
Sep 09 21:51:54.890597 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:51:54.890543    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d" podStartSLOduration=1.833560566 podStartE2EDuration="2.890520633s" totalImagesPullingTime="1.056960067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:51:54.889749793 +0000 UTC m=+789.444409532" watchObservedRunningTime="2026-09-09 21:51:54.890520633 +0000 UTC m=+789.445180373"
Sep 09 21:52:02.686090 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:02.686055    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:52:02.686650 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:02.686146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:52:02.698604 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:02.698578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:52:02.919825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:02.919793    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d"
Sep 09 21:52:06.353103 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.353071    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"]
Sep 09 21:52:06.355542 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.355520    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.357449 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.357430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 21:52:06.365323 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.365301    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"]
Sep 09 21:52:06.393607 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.393565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qxp\" (UniqueName: \"kubernetes.io/projected/1d528554-7ea9-4bbf-8173-592cf4334d30-kube-api-access-v8qxp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.393807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.393617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.393807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.393649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.393807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.393691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d528554-7ea9-4bbf-8173-592cf4334d30-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.393807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.393741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.393807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.393768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.494800 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.494758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.494994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.494833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d528554-7ea9-4bbf-8173-592cf4334d30-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.494994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.494880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.494994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.494907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.494994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.494947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qxp\" (UniqueName: \"kubernetes.io/projected/1d528554-7ea9-4bbf-8173-592cf4334d30-kube-api-access-v8qxp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.494994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.494985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.495237 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.495214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.495594 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.495568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.495724 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.495680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.497589 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.497567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d528554-7ea9-4bbf-8173-592cf4334d30-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.497681 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.497650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d528554-7ea9-4bbf-8173-592cf4334d30-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.502622 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.502603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qxp\" (UniqueName: \"kubernetes.io/projected/1d528554-7ea9-4bbf-8173-592cf4334d30-kube-api-access-v8qxp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xrlg\" (UID: \"1d528554-7ea9-4bbf-8173-592cf4334d30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.666140 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.666045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:06.936736 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:06.936711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"]
Sep 09 21:52:06.939535 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:52:06.939508    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d528554_7ea9_4bbf_8173_592cf4334d30.slice/crio-e48337ab015db26fc79e40d00e729e11604e4f6af5feb3775acbbe86b6fe46af WatchSource:0}: Error finding container e48337ab015db26fc79e40d00e729e11604e4f6af5feb3775acbbe86b6fe46af: Status 404 returned error can't find the container with id e48337ab015db26fc79e40d00e729e11604e4f6af5feb3775acbbe86b6fe46af
Sep 09 21:52:07.043504 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:07.043450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:52:07.937820 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:07.937787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg" event={"ID":"1d528554-7ea9-4bbf-8173-592cf4334d30","Type":"ContainerStarted","Data":"69a37ea4d91315b8c08fd5841c7e9eb8a4027dd601019c19f9a5ff7c3ee23e10"}
Sep 09 21:52:07.938198 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:07.937864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg" event={"ID":"1d528554-7ea9-4bbf-8173-592cf4334d30","Type":"ContainerStarted","Data":"e48337ab015db26fc79e40d00e729e11604e4f6af5feb3775acbbe86b6fe46af"}
Sep 09 21:52:07.954653 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:07.954597    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg" podStartSLOduration=1.716572676 podStartE2EDuration="1.954579176s" totalImagesPullingTime="238.0065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:52:07.953668304 +0000 UTC m=+802.508328055" watchObservedRunningTime="2026-09-09 21:52:07.954579176 +0000 UTC m=+802.509238933"
Sep 09 21:52:16.666634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:16.666592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:16.667024 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:16.666691    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:16.679003 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:16.678974    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:16.985897 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:16.985813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xrlg"
Sep 09 21:52:21.995826 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:21.995789    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:52:38.638909 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:38.638866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:52:51.446674 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:52:51.446635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:53:01.150026 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.149989    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"]
Sep 09 21:53:01.154236 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.154209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.156717 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.156685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 21:53:01.161063 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.161037    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"]
Sep 09 21:53:01.257191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.257145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.257389 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.257257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.257389 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.257326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx966\" (UniqueName: \"kubernetes.io/projected/1fbfcb23-f20c-496e-88af-f6710e156716-kube-api-access-wx966\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.257389 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.257382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.257584 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.257455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.257584 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.257509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fbfcb23-f20c-496e-88af-f6710e156716-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.358748 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.358701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.358748 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.358753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx966\" (UniqueName: \"kubernetes.io/projected/1fbfcb23-f20c-496e-88af-f6710e156716-kube-api-access-wx966\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359012 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.358784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359012 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.358825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359012 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.358846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fbfcb23-f20c-496e-88af-f6710e156716-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359012 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.359000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359276 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.359251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359276 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.359268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.359364 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.359336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.361256 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.361226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fbfcb23-f20c-496e-88af-f6710e156716-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.361413 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.361396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fbfcb23-f20c-496e-88af-f6710e156716-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.365895 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.365872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx966\" (UniqueName: \"kubernetes.io/projected/1fbfcb23-f20c-496e-88af-f6710e156716-kube-api-access-wx966\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f668c\" (UID: \"1fbfcb23-f20c-496e-88af-f6710e156716\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.467375 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.467281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:01.737581 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.737498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"]
Sep 09 21:53:01.741976 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:53:01.741946    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbfcb23_f20c_496e_88af_f6710e156716.slice/crio-1633d91ecf9e2a516d05cf8c4900d811575928db50b167720eae79d69b93571b WatchSource:0}: Error finding container 1633d91ecf9e2a516d05cf8c4900d811575928db50b167720eae79d69b93571b: Status 404 returned error can't find the container with id 1633d91ecf9e2a516d05cf8c4900d811575928db50b167720eae79d69b93571b
Sep 09 21:53:01.743242 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:01.743224    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:53:02.171501 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:02.171439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c" event={"ID":"1fbfcb23-f20c-496e-88af-f6710e156716","Type":"ContainerStarted","Data":"b26bdcdb5bcb199628fa32c203f5d861a4616d07cf484b319fa53d87f897452a"}
Sep 09 21:53:02.171871 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:02.171521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c" event={"ID":"1fbfcb23-f20c-496e-88af-f6710e156716","Type":"ContainerStarted","Data":"1633d91ecf9e2a516d05cf8c4900d811575928db50b167720eae79d69b93571b"}
Sep 09 21:53:02.188447 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:02.188396    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c" podStartSLOduration=1.009455399 podStartE2EDuration="1.188379578s" totalImagesPullingTime="178.924179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:53:02.187033402 +0000 UTC m=+856.741693133" watchObservedRunningTime="2026-09-09 21:53:02.188379578 +0000 UTC m=+856.743039331"
Sep 09 21:53:02.848508 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:02.848459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:53:04.139453 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.139413    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"]
Sep 09 21:53:04.142580 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.142564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.144458 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.144427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 09 21:53:04.150811 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.150787    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"]
Sep 09 21:53:04.185578 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.185545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.185779 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.185589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.185779 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.185609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.185779 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.185703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd72d825-5c8f-4220-884a-bde057bfb28b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.185779 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.185741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.185779 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.185772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpmf\" (UniqueName: \"kubernetes.io/projected/bd72d825-5c8f-4220-884a-bde057bfb28b-kube-api-access-jmpmf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.286617 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.286577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.286617 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.286623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.286822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.286667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd72d825-5c8f-4220-884a-bde057bfb28b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.286822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.286694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.286822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.286727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpmf\" (UniqueName: \"kubernetes.io/projected/bd72d825-5c8f-4220-884a-bde057bfb28b-kube-api-access-jmpmf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.286822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.286786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.287041 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.287012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.287082 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.287062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.287191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.287173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.289204 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.289173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd72d825-5c8f-4220-884a-bde057bfb28b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.289490 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.289440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd72d825-5c8f-4220-884a-bde057bfb28b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.294387 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.294357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpmf\" (UniqueName: \"kubernetes.io/projected/bd72d825-5c8f-4220-884a-bde057bfb28b-kube-api-access-jmpmf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5\" (UID: \"bd72d825-5c8f-4220-884a-bde057bfb28b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.453315 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.453217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:04.730775 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:04.730749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"]
Sep 09 21:53:04.733527 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:53:04.733493    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd72d825_5c8f_4220_884a_bde057bfb28b.slice/crio-05a5d4dcceabfeeed12fc06482ce01d1cd74281cf3da06d431c8393f372d43ef WatchSource:0}: Error finding container 05a5d4dcceabfeeed12fc06482ce01d1cd74281cf3da06d431c8393f372d43ef: Status 404 returned error can't find the container with id 05a5d4dcceabfeeed12fc06482ce01d1cd74281cf3da06d431c8393f372d43ef
Sep 09 21:53:05.185327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:05.185287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5" event={"ID":"bd72d825-5c8f-4220-884a-bde057bfb28b","Type":"ContainerStarted","Data":"eebb1b0f15011d36f29265a396f5a948d9992ff375475c279512317482eac2ef"}
Sep 09 21:53:05.185327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:05.185331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5" event={"ID":"bd72d825-5c8f-4220-884a-bde057bfb28b","Type":"ContainerStarted","Data":"05a5d4dcceabfeeed12fc06482ce01d1cd74281cf3da06d431c8393f372d43ef"}
Sep 09 21:53:05.200967 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:05.200907    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5" podStartSLOduration=1.025578439 podStartE2EDuration="1.200889783s" totalImagesPullingTime="175.311344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:53:05.19904288 +0000 UTC m=+859.753702642" watchObservedRunningTime="2026-09-09 21:53:05.200889783 +0000 UTC m=+859.755549522"
Sep 09 21:53:10.445683 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:10.445575    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:53:11.468143 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:11.468098    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:11.468596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:11.468165    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:11.481360 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:11.481334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:12.232430 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:12.232396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f668c"
Sep 09 21:53:14.453680 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:14.453640    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:14.454155 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:14.453699    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:14.465994 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:14.465973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:53:15.246838 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:53:15.246806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5"
Sep 09 21:54:44.852573 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:44.852529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:54:56.843979 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.843941    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"]
Sep 09 21:54:56.847243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.847221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:56.851635 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.851612    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-8c5761ec-kserve-self-signed-certs\""
Sep 09 21:54:56.863302 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.863258    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"]
Sep 09 21:54:56.950927 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.950871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxrvw\" (UniqueName: \"kubernetes.io/projected/a3866323-c018-44ac-8900-7499c8cbb50f-kube-api-access-zxrvw\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:56.951150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.950938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-dshm\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:56.951150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.951032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3866323-c018-44ac-8900-7499c8cbb50f-tls-certs\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:56.951150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.951133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-tmp-dir\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:56.951284 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.951195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-home\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:56.951284 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:56.951210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-model-cache\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.051883 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.051843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxrvw\" (UniqueName: \"kubernetes.io/projected/a3866323-c018-44ac-8900-7499c8cbb50f-kube-api-access-zxrvw\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.051883 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.051888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-dshm\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052117 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.051918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3866323-c018-44ac-8900-7499c8cbb50f-tls-certs\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052117 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.051994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-tmp-dir\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052117 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.052059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-home\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052117 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.052081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-model-cache\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052430 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.052405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-tmp-dir\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052539 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.052456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-model-cache\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.052539 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.052524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-home\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.054427 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.054407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-dshm\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.054561 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.054544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3866323-c018-44ac-8900-7499c8cbb50f-tls-certs\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.060491 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.060451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxrvw\" (UniqueName: \"kubernetes.io/projected/a3866323-c018-44ac-8900-7499c8cbb50f-kube-api-access-zxrvw\") pod \"e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") " pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.159772 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.159680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:54:57.337068 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.337028    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"]
Sep 09 21:54:57.340608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.340586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.342896 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.342871    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-94w96\""
Sep 09 21:54:57.343036 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.342882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 21:54:57.343433 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.343412    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-594ab9-serving-cert\""
Sep 09 21:54:57.343549 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.343489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:54:57.343611 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.343559    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 21:54:57.352271 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.352243    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"]
Sep 09 21:54:57.439263 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.439180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"]
Sep 09 21:54:57.443169 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:54:57.443135    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3866323_c018_44ac_8900_7499c8cbb50f.slice/crio-300a89892850885ff83ac52a27bd66f0b123534c52d188ce52c786ac3b1b9f81 WatchSource:0}: Error finding container 300a89892850885ff83ac52a27bd66f0b123534c52d188ce52c786ac3b1b9f81: Status 404 returned error can't find the container with id 300a89892850885ff83ac52a27bd66f0b123534c52d188ce52c786ac3b1b9f81
Sep 09 21:54:57.455663 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.455637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.455777 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.455679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-metrics-certs\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.455777 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.455740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76b4ad1-839e-44bf-bddf-021d5b28a582-openshift-service-ca\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.455858 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.455806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxt2b\" (UniqueName: \"kubernetes.io/projected/d76b4ad1-839e-44bf-bddf-021d5b28a582-kube-api-access-kxt2b\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.547127 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.547084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:54:57.556609 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.556573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxt2b\" (UniqueName: \"kubernetes.io/projected/d76b4ad1-839e-44bf-bddf-021d5b28a582-kube-api-access-kxt2b\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.556777 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.556629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.556777 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.556669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-metrics-certs\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.556777 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.556688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76b4ad1-839e-44bf-bddf-021d5b28a582-openshift-service-ca\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.556919 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:54:57.556820    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-serving-cert: secret "maas-api-e2e-autores-594ab9-serving-cert" not found
Sep 09 21:54:57.556919 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:54:57.556901    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls podName:d76b4ad1-839e-44bf-bddf-021d5b28a582 nodeName:}" failed. No retries permitted until 2026-09-09 21:54:58.056878483 +0000 UTC m=+972.611538212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls") pod "maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" (UID: "d76b4ad1-839e-44bf-bddf-021d5b28a582") : secret "maas-api-e2e-autores-594ab9-serving-cert" not found
Sep 09 21:54:57.557366 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.557346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76b4ad1-839e-44bf-bddf-021d5b28a582-openshift-service-ca\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.559364 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.559344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-metrics-certs\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.565872 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.565831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxt2b\" (UniqueName: \"kubernetes.io/projected/d76b4ad1-839e-44bf-bddf-021d5b28a582-kube-api-access-kxt2b\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:57.698927 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.698833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8" event={"ID":"a3866323-c018-44ac-8900-7499c8cbb50f","Type":"ContainerStarted","Data":"44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2"}
Sep 09 21:54:57.698927 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.698889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8" event={"ID":"a3866323-c018-44ac-8900-7499c8cbb50f","Type":"ContainerStarted","Data":"300a89892850885ff83ac52a27bd66f0b123534c52d188ce52c786ac3b1b9f81"}
Sep 09 21:54:57.717206 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:57.717146    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8" podStartSLOduration=1.71712397 podStartE2EDuration="1.71712397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:54:57.715235891 +0000 UTC m=+972.269895696" watchObservedRunningTime="2026-09-09 21:54:57.71712397 +0000 UTC m=+972.271783713"
Sep 09 21:54:58.061556 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:58.061520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:58.064692 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:58.064662    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls\") pod \"maas-api-e2e-autores-594ab9-7d95c449d4-7plx8\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:58.253384 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:58.253348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:54:58.533198 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:58.533117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"]
Sep 09 21:54:58.536747 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:54:58.536720    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76b4ad1_839e_44bf_bddf_021d5b28a582.slice/crio-15406a43e32fb7b9b81163d429416f084da367b7f70064cfca46ac90b5cc9123 WatchSource:0}: Error finding container 15406a43e32fb7b9b81163d429416f084da367b7f70064cfca46ac90b5cc9123: Status 404 returned error can't find the container with id 15406a43e32fb7b9b81163d429416f084da367b7f70064cfca46ac90b5cc9123
Sep 09 21:54:58.705642 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:54:58.705602    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" event={"ID":"d76b4ad1-839e-44bf-bddf-021d5b28a582","Type":"ContainerStarted","Data":"15406a43e32fb7b9b81163d429416f084da367b7f70064cfca46ac90b5cc9123"}
Sep 09 21:55:01.724164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:01.724123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" event={"ID":"d76b4ad1-839e-44bf-bddf-021d5b28a582","Type":"ContainerStarted","Data":"51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6"}
Sep 09 21:55:01.724640 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:01.724221    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:55:01.745019 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:01.744960    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" podStartSLOduration=2.398391794 podStartE2EDuration="4.744942153s" totalImagesPullingTime="2.346550359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:55:01.742952302 +0000 UTC m=+976.297612043" watchObservedRunningTime="2026-09-09 21:55:01.744942153 +0000 UTC m=+976.299601894"
Sep 09 21:55:07.160658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:07.160553    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:55:07.160658 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:07.160618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:55:07.174198 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:07.174166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:55:07.734437 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:07.734397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:55:07.762326 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:07.762292    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:55:10.610167 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.610125    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"]
Sep 09 21:55:10.613502 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.613460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.616330 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.616299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ebe9b0-openshift-default-dockercfg-kkwbb\""
Sep 09 21:55:10.631690 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.631658    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"]
Sep 09 21:55:10.679102 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-certs\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679102 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-credential-socket\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9d2019-e8e4-4154-b620-901f93337eab-istiod-ca-cert\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-istio-token\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-envoy\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679311 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-socket\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679522 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9d2019-e8e4-4154-b620-901f93337eab-istio-podinfo\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679522 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtwj5\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-kube-api-access-mtwj5\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.679522 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.679410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-data\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780125 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-credential-socket\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9d2019-e8e4-4154-b620-901f93337eab-istiod-ca-cert\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-istio-token\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-envoy\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-socket\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9d2019-e8e4-4154-b620-901f93337eab-istio-podinfo\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtwj5\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-kube-api-access-mtwj5\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-data\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780687 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-certs\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780687 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-credential-socket\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780764 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-certs\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780816 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-socket\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.780987 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.780964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-data\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.781062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.781043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9d2019-e8e4-4154-b620-901f93337eab-istiod-ca-cert\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.782669 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.782642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-envoy\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.782875 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.782858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9d2019-e8e4-4154-b620-901f93337eab-istio-podinfo\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.790221 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.790191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-istio-token\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.790334 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.790245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtwj5\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-kube-api-access-mtwj5\") pod \"e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") " pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:10.924497 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:10.924391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:11.207984 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:11.207958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"]
Sep 09 21:55:11.210236 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:55:11.210207    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9d2019_e8e4_4154_b620_901f93337eab.slice/crio-9cf631978619636e15f1a5fae525b79f880e32f022ad4187ca79cbab70454a87 WatchSource:0}: Error finding container 9cf631978619636e15f1a5fae525b79f880e32f022ad4187ca79cbab70454a87: Status 404 returned error can't find the container with id 9cf631978619636e15f1a5fae525b79f880e32f022ad4187ca79cbab70454a87
Sep 09 21:55:11.770130 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:11.770088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" event={"ID":"5b9d2019-e8e4-4154-b620-901f93337eab","Type":"ContainerStarted","Data":"9cf631978619636e15f1a5fae525b79f880e32f022ad4187ca79cbab70454a87"}
Sep 09 21:55:13.816130 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:13.816092    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:13.816418 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:13.816169    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:13.816418 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:13.816199    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:14.786707 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:14.786664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" event={"ID":"5b9d2019-e8e4-4154-b620-901f93337eab","Type":"ContainerStarted","Data":"24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"}
Sep 09 21:55:14.809818 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:14.809761    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podStartSLOduration=2.206356727 podStartE2EDuration="4.809743515s" totalImagesPullingTime="2.603386788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:55:14.808036361 +0000 UTC m=+989.362696103" watchObservedRunningTime="2026-09-09 21:55:14.809743515 +0000 UTC m=+989.364403256"
Sep 09 21:55:14.925161 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:14.925130    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:14.935118 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:14.935075    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:15.792565 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:15.792534    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:15.793905 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:15.793877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:16.887506 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:16.887456    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:55:36.129170 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.129138    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"]
Sep 09 21:55:36.136834 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.136811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.139208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.139186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9e97e70d-gw-openshift-default-dockercfg-ggd8m\""
Sep 09 21:55:36.149948 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.149869    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"]
Sep 09 21:55:36.214020 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.213977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-socket\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8cbg\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-kube-api-access-k8cbg\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-certs\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-podinfo\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214202 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-credential-socket\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214365 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istiod-ca-cert\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214365 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-data\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-envoy\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.214448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.214409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-token\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315279 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-credential-socket\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315504 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istiod-ca-cert\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315504 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-data\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315504 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-envoy\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315504 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-token\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315504 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-socket\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8cbg\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-kube-api-access-k8cbg\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315774 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-credential-socket\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315805 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-certs\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315851 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-data\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.315851 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.315823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-podinfo\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.316083 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.316056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-socket\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.316171 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.316106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-certs\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.316171 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.316126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istiod-ca-cert\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.318166 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.318134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-envoy\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.318542 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.318520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-podinfo\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.328156 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.328129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-token\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.328382 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.328359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8cbg\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-kube-api-access-k8cbg\") pod \"e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") " pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.446614 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.446574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:36.727205 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.727109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"]
Sep 09 21:55:36.730107 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:55:36.730076    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ecade9_d68f_481c_82ee_9ffce2e599a2.slice/crio-5dc15025a03580e74ff6b7e57249407baa0e1d7e813e9d303862be3383662c55 WatchSource:0}: Error finding container 5dc15025a03580e74ff6b7e57249407baa0e1d7e813e9d303862be3383662c55: Status 404 returned error can't find the container with id 5dc15025a03580e74ff6b7e57249407baa0e1d7e813e9d303862be3383662c55
Sep 09 21:55:36.732330 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.732296    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:36.732392 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.732373    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:36.732434 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.732424    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:36.894049 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.893995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" event={"ID":"f2ecade9-d68f-481c-82ee-9ffce2e599a2","Type":"ContainerStarted","Data":"b0f5a576c34be3dc5248094ca49d8c13a287257c0a3cbb9c2fade0687a6d1bd0"}
Sep 09 21:55:36.894225 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.894074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" event={"ID":"f2ecade9-d68f-481c-82ee-9ffce2e599a2","Type":"ContainerStarted","Data":"5dc15025a03580e74ff6b7e57249407baa0e1d7e813e9d303862be3383662c55"}
Sep 09 21:55:36.896288 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.896257    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b9d2019-e8e4-4154-b620-901f93337eab" containerID="24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c" exitCode=0
Sep 09 21:55:36.896415 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.896342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" event={"ID":"5b9d2019-e8e4-4154-b620-901f93337eab","Type":"ContainerDied","Data":"24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"}
Sep 09 21:55:36.896817 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.896801    2560 scope.go:117] "RemoveContainer" containerID="24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"
Sep 09 21:55:36.898173 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.898140    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:36.898275 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.898225    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:36.898321 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.898271    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:36.916808 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.916711    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podStartSLOduration=0.916690552 podStartE2EDuration="916.690552ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:55:36.915073817 +0000 UTC m=+1011.469733588" watchObservedRunningTime="2026-09-09 21:55:36.916690552 +0000 UTC m=+1011.471350296"
Sep 09 21:55:36.948023 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:36.947985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:55:37.447583 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.447546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:37.452647 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.452620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:37.906780 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.906739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" event={"ID":"5b9d2019-e8e4-4154-b620-901f93337eab","Type":"ContainerStarted","Data":"9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d"}
Sep 09 21:55:37.907113 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.907096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:37.920059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.920024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:37.924965 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.924926    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:37.925190 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.925167    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 09 21:55:37.925246 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:37.925220    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 09 21:55:38.499279 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.499222    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"]
Sep 09 21:55:38.515808 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.515781    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.519422 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.519300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"]
Sep 09 21:55:38.526926 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.525757    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9e97e70d-serving-cert\""
Sep 09 21:55:38.537065 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.537035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f6acd8-c954-4a85-a645-bc6831630da1-openshift-service-ca\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.537160 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.537089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngt52\" (UniqueName: \"kubernetes.io/projected/93f6acd8-c954-4a85-a645-bc6831630da1-kube-api-access-ngt52\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.537205 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.537159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-metrics-certs\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.537237 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.537216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.638542 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.638496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngt52\" (UniqueName: \"kubernetes.io/projected/93f6acd8-c954-4a85-a645-bc6831630da1-kube-api-access-ngt52\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.638696 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.638556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-metrics-certs\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.638696 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.638617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.638798 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.638691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f6acd8-c954-4a85-a645-bc6831630da1-openshift-service-ca\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.638798 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:55:38.638785    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-serving-cert: secret "maas-api-e2e-migrate-9e97e70d-serving-cert" not found
Sep 09 21:55:38.638875 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:55:38.638850    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls podName:93f6acd8-c954-4a85-a645-bc6831630da1 nodeName:}" failed. No retries permitted until 2026-09-09 21:55:39.138833798 +0000 UTC m=+1013.693493516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls") pod "maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" (UID: "93f6acd8-c954-4a85-a645-bc6831630da1") : secret "maas-api-e2e-migrate-9e97e70d-serving-cert" not found
Sep 09 21:55:38.639420 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.639350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f6acd8-c954-4a85-a645-bc6831630da1-openshift-service-ca\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.641229 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.641205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-metrics-certs\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.650077 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.650057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngt52\" (UniqueName: \"kubernetes.io/projected/93f6acd8-c954-4a85-a645-bc6831630da1-kube-api-access-ngt52\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:38.925056 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.925017    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 09 21:55:38.925216 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:38.925077    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 09 21:55:39.144054 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.144019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:39.146753 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.146726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls\") pod \"maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:39.437409 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.437366    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:39.733543 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.733513    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"]
Sep 09 21:55:39.736015 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:55:39.735987    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f6acd8_c954_4a85_a645_bc6831630da1.slice/crio-b9f311ae4345f926039cb63a0dcd08716271a434fe7b82d08dc2aa4845e815d9 WatchSource:0}: Error finding container b9f311ae4345f926039cb63a0dcd08716271a434fe7b82d08dc2aa4845e815d9: Status 404 returned error can't find the container with id b9f311ae4345f926039cb63a0dcd08716271a434fe7b82d08dc2aa4845e815d9
Sep 09 21:55:39.921294 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.921249    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" event={"ID":"93f6acd8-c954-4a85-a645-bc6831630da1","Type":"ContainerStarted","Data":"b9f311ae4345f926039cb63a0dcd08716271a434fe7b82d08dc2aa4845e815d9"}
Sep 09 21:55:39.924962 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.924940    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 09 21:55:39.925025 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:39.924988    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 09 21:55:40.924945 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:40.924912    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 09 21:55:40.925436 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:40.924967    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 09 21:55:40.928425 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:40.928402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" event={"ID":"93f6acd8-c954-4a85-a645-bc6831630da1","Type":"ContainerStarted","Data":"ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92"}
Sep 09 21:55:40.944394 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:40.944347    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" podStartSLOduration=2.506687478 podStartE2EDuration="2.944329957s" totalImagesPullingTime="437.642479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:55:40.942570623 +0000 UTC m=+1015.497230361" watchObservedRunningTime="2026-09-09 21:55:40.944329957 +0000 UTC m=+1015.498989691"
Sep 09 21:55:41.925218 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:41.925168    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 09 21:55:41.925728 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:41.925254    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 09 21:55:41.933401 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:41.933371    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:42.925421 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:42.925379    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 09 21:55:42.925832 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:42.925450    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 09 21:55:43.929865 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:43.929835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:43.930254 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:43.930139    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:43.930932 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:43.930912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:55:47.943921 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:47.943893    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:55:54.843453 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:54.843397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:55:58.010371 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:58.010338    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerID="b0f5a576c34be3dc5248094ca49d8c13a287257c0a3cbb9c2fade0687a6d1bd0" exitCode=0
Sep 09 21:55:58.010825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:58.010418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" event={"ID":"f2ecade9-d68f-481c-82ee-9ffce2e599a2","Type":"ContainerDied","Data":"b0f5a576c34be3dc5248094ca49d8c13a287257c0a3cbb9c2fade0687a6d1bd0"}
Sep 09 21:55:58.010825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:58.010817    2560 scope.go:117] "RemoveContainer" containerID="b0f5a576c34be3dc5248094ca49d8c13a287257c0a3cbb9c2fade0687a6d1bd0"
Sep 09 21:55:58.011876 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:58.011850    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:58.011936 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:58.011914    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:58.011970 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:58.011947    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:55:59.019953 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:59.019919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" event={"ID":"f2ecade9-d68f-481c-82ee-9ffce2e599a2","Type":"ContainerStarted","Data":"ab2b3faeee1e48f816432e69c66cd4312a1f90d646012c43b8eb1de5667d4c9f"}
Sep 09 21:55:59.446768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:59.446726    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:55:59.447040 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:59.447014    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 09 21:55:59.447129 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:55:59.447078    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 09 21:56:00.447798 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:00.447755    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 09 21:56:00.448208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:00.447819    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 09 21:56:01.447338 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:01.447295    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 09 21:56:01.447599 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:01.447360    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 09 21:56:02.446956 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:02.446918    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 09 21:56:02.447363 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:02.446978    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 09 21:56:03.447074 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:03.447033    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 09 21:56:03.447594 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:03.447100    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 09 21:56:04.451424 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:04.451391    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:56:04.451888 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:04.451677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:56:04.452444 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:04.452427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:56:09.397248 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.397211    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"]
Sep 09 21:56:09.398160 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.398119    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" podUID="93f6acd8-c954-4a85-a645-bc6831630da1" containerName="maas-api" containerID="cri-o://ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92" gracePeriod=30
Sep 09 21:56:09.646310 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.646281    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:56:09.744586 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.744482    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngt52\" (UniqueName: \"kubernetes.io/projected/93f6acd8-c954-4a85-a645-bc6831630da1-kube-api-access-ngt52\") pod \"93f6acd8-c954-4a85-a645-bc6831630da1\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") "
Sep 09 21:56:09.744586 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.744546    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f6acd8-c954-4a85-a645-bc6831630da1-openshift-service-ca\") pod \"93f6acd8-c954-4a85-a645-bc6831630da1\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") "
Sep 09 21:56:09.744829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.744590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls\") pod \"93f6acd8-c954-4a85-a645-bc6831630da1\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") "
Sep 09 21:56:09.744829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.744620    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-metrics-certs\") pod \"93f6acd8-c954-4a85-a645-bc6831630da1\" (UID: \"93f6acd8-c954-4a85-a645-bc6831630da1\") "
Sep 09 21:56:09.744953 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.744930    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f6acd8-c954-4a85-a645-bc6831630da1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93f6acd8-c954-4a85-a645-bc6831630da1" (UID: "93f6acd8-c954-4a85-a645-bc6831630da1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:56:09.753946 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.753896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93f6acd8-c954-4a85-a645-bc6831630da1" (UID: "93f6acd8-c954-4a85-a645-bc6831630da1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:56:09.760146 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.759885    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f6acd8-c954-4a85-a645-bc6831630da1-kube-api-access-ngt52" (OuterVolumeSpecName: "kube-api-access-ngt52") pod "93f6acd8-c954-4a85-a645-bc6831630da1" (UID: "93f6acd8-c954-4a85-a645-bc6831630da1"). InnerVolumeSpecName "kube-api-access-ngt52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:56:09.762296 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.762262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "93f6acd8-c954-4a85-a645-bc6831630da1" (UID: "93f6acd8-c954-4a85-a645-bc6831630da1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:56:09.846337 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.846299    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngt52\" (UniqueName: \"kubernetes.io/projected/93f6acd8-c954-4a85-a645-bc6831630da1-kube-api-access-ngt52\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:09.846337 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.846340    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f6acd8-c954-4a85-a645-bc6831630da1-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:09.846577 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.846357    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:09.846577 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.846371    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93f6acd8-c954-4a85-a645-bc6831630da1-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:09.874660 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.874623    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"]
Sep 09 21:56:09.874874 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:09.874851    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy" containerID="cri-o://ab2b3faeee1e48f816432e69c66cd4312a1f90d646012c43b8eb1de5667d4c9f" gracePeriod=30
Sep 09 21:56:10.075060 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.075027    2560 generic.go:356] "Generic (PLEG): container finished" podID="93f6acd8-c954-4a85-a645-bc6831630da1" containerID="ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92" exitCode=0
Sep 09 21:56:10.075243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.075089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"
Sep 09 21:56:10.075243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.075109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" event={"ID":"93f6acd8-c954-4a85-a645-bc6831630da1","Type":"ContainerDied","Data":"ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92"}
Sep 09 21:56:10.075243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.075171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd" event={"ID":"93f6acd8-c954-4a85-a645-bc6831630da1","Type":"ContainerDied","Data":"b9f311ae4345f926039cb63a0dcd08716271a434fe7b82d08dc2aa4845e815d9"}
Sep 09 21:56:10.075243 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.075195    2560 scope.go:117] "RemoveContainer" containerID="ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92"
Sep 09 21:56:10.084074 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.084043    2560 scope.go:117] "RemoveContainer" containerID="ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92"
Sep 09 21:56:10.084357 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:10.084339    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92\": container with ID starting with ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92 not found: ID does not exist" containerID="ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92"
Sep 09 21:56:10.084421 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.084368    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92"} err="failed to get container status \"ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92\": rpc error: code = NotFound desc = could not find container \"ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92\": container with ID starting with ef8a8a25b190f1f8715dd64d2b9a516a098749a142fd367add76c2a331dd0a92 not found: ID does not exist"
Sep 09 21:56:10.094770 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.094734    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"]
Sep 09 21:56:10.099042 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:10.099014    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9e97e70d-5974976956-gzzmd"]
Sep 09 21:56:11.917732 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:11.917696    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f6acd8-c954-4a85-a645-bc6831630da1" path="/var/lib/kubelet/pods/93f6acd8-c954-4a85-a645-bc6831630da1/volumes"
Sep 09 21:56:13.354003 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:13.353964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:56:14.460350 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.460314    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"]
Sep 09 21:56:14.460749 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.460672    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f6acd8-c954-4a85-a645-bc6831630da1" containerName="maas-api"
Sep 09 21:56:14.460749 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.460685    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f6acd8-c954-4a85-a645-bc6831630da1" containerName="maas-api"
Sep 09 21:56:14.460825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.460752    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f6acd8-c954-4a85-a645-bc6831630da1" containerName="maas-api"
Sep 09 21:56:14.462812 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.462795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.465316 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.465288    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a691ec3b-serving-cert\""
Sep 09 21:56:14.474139 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.474109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"]
Sep 09 21:56:14.487221 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.487188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4nr\" (UniqueName: \"kubernetes.io/projected/e6efad69-328b-4509-8c9e-d2078b02a99c-kube-api-access-7q4nr\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.487388 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.487228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-metrics-certs\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.487388 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.487264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.487388 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.487378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6efad69-328b-4509-8c9e-d2078b02a99c-openshift-service-ca\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.588705 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.588670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4nr\" (UniqueName: \"kubernetes.io/projected/e6efad69-328b-4509-8c9e-d2078b02a99c-kube-api-access-7q4nr\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.588929 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.588723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-metrics-certs\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.588929 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.588765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.588929 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.588857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6efad69-328b-4509-8c9e-d2078b02a99c-openshift-service-ca\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.589100 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:14.588976    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-serving-cert: secret "maas-api-e2e-ait-a691ec3b-serving-cert" not found
Sep 09 21:56:14.589100 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:14.589063    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls podName:e6efad69-328b-4509-8c9e-d2078b02a99c nodeName:}" failed. No retries permitted until 2026-09-09 21:56:15.089030114 +0000 UTC m=+1049.643689850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls") pod "maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" (UID: "e6efad69-328b-4509-8c9e-d2078b02a99c") : secret "maas-api-e2e-ait-a691ec3b-serving-cert" not found
Sep 09 21:56:14.589822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.589796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6efad69-328b-4509-8c9e-d2078b02a99c-openshift-service-ca\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.591692 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.591667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-metrics-certs\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:14.598495 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:14.598455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4nr\" (UniqueName: \"kubernetes.io/projected/e6efad69-328b-4509-8c9e-d2078b02a99c-kube-api-access-7q4nr\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:15.092961 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.092927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:15.095690 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.095661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls\") pod \"maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:15.104066 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.104029    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerID="ab2b3faeee1e48f816432e69c66cd4312a1f90d646012c43b8eb1de5667d4c9f" exitCode=0
Sep 09 21:56:15.104290 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.104089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" event={"ID":"f2ecade9-d68f-481c-82ee-9ffce2e599a2","Type":"ContainerDied","Data":"ab2b3faeee1e48f816432e69c66cd4312a1f90d646012c43b8eb1de5667d4c9f"}
Sep 09 21:56:15.104290 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.104154    2560 scope.go:117] "RemoveContainer" containerID="b0f5a576c34be3dc5248094ca49d8c13a287257c0a3cbb9c2fade0687a6d1bd0"
Sep 09 21:56:15.138585 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.138503    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:56:15.194132 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194090    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-credential-socket\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194161    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-data\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-certs\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istiod-ca-cert\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194275    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-podinfo\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8cbg\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-kube-api-access-k8cbg\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194320 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-envoy\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194656 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-token\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194656 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-socket\") pod \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\" (UID: \"f2ecade9-d68f-481c-82ee-9ffce2e599a2\") "
Sep 09 21:56:15.194656 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:56:15.194805 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194663    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.194805 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194687    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:56:15.194912 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.194866    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:56:15.195113 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.195079    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:56:15.195478 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.195438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:56:15.197413 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.197381    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:56:15.197535 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.197448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:56:15.197535 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.197498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 21:56:15.197535 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.197494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-kube-api-access-k8cbg" (OuterVolumeSpecName: "kube-api-access-k8cbg") pod "f2ecade9-d68f-481c-82ee-9ffce2e599a2" (UID: "f2ecade9-d68f-481c-82ee-9ffce2e599a2"). InnerVolumeSpecName "kube-api-access-k8cbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:56:15.295943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295912    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.295943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295941    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.295943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295950    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.296208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295958    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.296208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295966    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.296208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295974    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.296208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295982    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8cbg\" (UniqueName: \"kubernetes.io/projected/f2ecade9-d68f-481c-82ee-9ffce2e599a2-kube-api-access-k8cbg\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.296208 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.295991    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2ecade9-d68f-481c-82ee-9ffce2e599a2-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:15.375664 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.375631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:15.648948 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:15.648919    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"]
Sep 09 21:56:15.651343 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:56:15.651312    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6efad69_328b_4509_8c9e_d2078b02a99c.slice/crio-2e6a5b0b5d4508897b424f1b785fb33f980a8f498ac162ad97154c8aab7ed995 WatchSource:0}: Error finding container 2e6a5b0b5d4508897b424f1b785fb33f980a8f498ac162ad97154c8aab7ed995: Status 404 returned error can't find the container with id 2e6a5b0b5d4508897b424f1b785fb33f980a8f498ac162ad97154c8aab7ed995
Sep 09 21:56:16.111010 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.110961    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"
Sep 09 21:56:16.111209 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.110962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh" event={"ID":"f2ecade9-d68f-481c-82ee-9ffce2e599a2","Type":"ContainerDied","Data":"5dc15025a03580e74ff6b7e57249407baa0e1d7e813e9d303862be3383662c55"}
Sep 09 21:56:16.111209 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.111149    2560 scope.go:117] "RemoveContainer" containerID="ab2b3faeee1e48f816432e69c66cd4312a1f90d646012c43b8eb1de5667d4c9f"
Sep 09 21:56:16.112944 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.112902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" event={"ID":"e6efad69-328b-4509-8c9e-d2078b02a99c","Type":"ContainerStarted","Data":"ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697"}
Sep 09 21:56:16.113060 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.112971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" event={"ID":"e6efad69-328b-4509-8c9e-d2078b02a99c","Type":"ContainerStarted","Data":"2e6a5b0b5d4508897b424f1b785fb33f980a8f498ac162ad97154c8aab7ed995"}
Sep 09 21:56:16.113060 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.113005    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:16.135005 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.134950    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" podStartSLOduration=1.7699716049999998 podStartE2EDuration="2.134933945s" totalImagesPullingTime="364.96234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:56:16.133367839 +0000 UTC m=+1050.688027590" watchObservedRunningTime="2026-09-09 21:56:16.134933945 +0000 UTC m=+1050.689593684"
Sep 09 21:56:16.148877 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.148843    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"]
Sep 09 21:56:16.152690 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:16.152662    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9e97e70d-gw-openshift-default-686d796896-krnrh"]
Sep 09 21:56:17.916596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:17.916558    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" path="/var/lib/kubelet/pods/f2ecade9-d68f-481c-82ee-9ffce2e599a2/volumes"
Sep 09 21:56:22.126045 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:22.126006    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:32.051491 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:32.051419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:56:42.588448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.588337    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"]
Sep 09 21:56:42.588929 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.588692    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" podUID="d76b4ad1-839e-44bf-bddf-021d5b28a582" containerName="maas-api" containerID="cri-o://51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6" gracePeriod=30
Sep 09 21:56:42.730078 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.730034    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" podUID="d76b4ad1-839e-44bf-bddf-021d5b28a582" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.29:8443/health\": dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 09 21:56:42.849129 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.849061    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:56:42.960843 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.960814    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls\") pod \"d76b4ad1-839e-44bf-bddf-021d5b28a582\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") "
Sep 09 21:56:42.961038 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.960862    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-metrics-certs\") pod \"d76b4ad1-839e-44bf-bddf-021d5b28a582\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") "
Sep 09 21:56:42.961038 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.960882    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxt2b\" (UniqueName: \"kubernetes.io/projected/d76b4ad1-839e-44bf-bddf-021d5b28a582-kube-api-access-kxt2b\") pod \"d76b4ad1-839e-44bf-bddf-021d5b28a582\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") "
Sep 09 21:56:42.961038 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.960938    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76b4ad1-839e-44bf-bddf-021d5b28a582-openshift-service-ca\") pod \"d76b4ad1-839e-44bf-bddf-021d5b28a582\" (UID: \"d76b4ad1-839e-44bf-bddf-021d5b28a582\") "
Sep 09 21:56:42.961493 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.961432    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76b4ad1-839e-44bf-bddf-021d5b28a582-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d76b4ad1-839e-44bf-bddf-021d5b28a582" (UID: "d76b4ad1-839e-44bf-bddf-021d5b28a582"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:56:42.963264 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.963225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d76b4ad1-839e-44bf-bddf-021d5b28a582" (UID: "d76b4ad1-839e-44bf-bddf-021d5b28a582"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:56:42.963362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.963270    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d76b4ad1-839e-44bf-bddf-021d5b28a582" (UID: "d76b4ad1-839e-44bf-bddf-021d5b28a582"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:56:42.963362 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:42.963286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76b4ad1-839e-44bf-bddf-021d5b28a582-kube-api-access-kxt2b" (OuterVolumeSpecName: "kube-api-access-kxt2b") pod "d76b4ad1-839e-44bf-bddf-021d5b28a582" (UID: "d76b4ad1-839e-44bf-bddf-021d5b28a582"). InnerVolumeSpecName "kube-api-access-kxt2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:56:43.061872 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.061835    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:43.061872 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.061866    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76b4ad1-839e-44bf-bddf-021d5b28a582-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:43.061872 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.061876    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxt2b\" (UniqueName: \"kubernetes.io/projected/d76b4ad1-839e-44bf-bddf-021d5b28a582-kube-api-access-kxt2b\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:43.062112 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.061885    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76b4ad1-839e-44bf-bddf-021d5b28a582-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:43.243825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.243734    2560 generic.go:356] "Generic (PLEG): container finished" podID="d76b4ad1-839e-44bf-bddf-021d5b28a582" containerID="51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6" exitCode=0
Sep 09 21:56:43.243825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.243777    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"
Sep 09 21:56:43.243825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.243808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" event={"ID":"d76b4ad1-839e-44bf-bddf-021d5b28a582","Type":"ContainerDied","Data":"51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6"}
Sep 09 21:56:43.244061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.243867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8" event={"ID":"d76b4ad1-839e-44bf-bddf-021d5b28a582","Type":"ContainerDied","Data":"15406a43e32fb7b9b81163d429416f084da367b7f70064cfca46ac90b5cc9123"}
Sep 09 21:56:43.244061 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.243890    2560 scope.go:117] "RemoveContainer" containerID="51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6"
Sep 09 21:56:43.253745 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.253727    2560 scope.go:117] "RemoveContainer" containerID="51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6"
Sep 09 21:56:43.254079 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:43.254062    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6\": container with ID starting with 51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6 not found: ID does not exist" containerID="51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6"
Sep 09 21:56:43.254145 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.254091    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6"} err="failed to get container status \"51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6\": rpc error: code = NotFound desc = could not find container \"51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6\": container with ID starting with 51f2eda5c6fb2a4d82d0e4c75ee100292cb178a01c5c58f626608da25e6a54d6 not found: ID does not exist"
Sep 09 21:56:43.264739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.264673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"]
Sep 09 21:56:43.266651 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.266627    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-594ab9-7d95c449d4-7plx8"]
Sep 09 21:56:43.916434 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:43.916398    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76b4ad1-839e-44bf-bddf-021d5b28a582" path="/var/lib/kubelet/pods/d76b4ad1-839e-44bf-bddf-021d5b28a582/volumes"
Sep 09 21:56:45.422223 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.422185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"]
Sep 09 21:56:45.422712 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.422449    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" podUID="e6efad69-328b-4509-8c9e-d2078b02a99c" containerName="maas-api" containerID="cri-o://ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697" gracePeriod=30
Sep 09 21:56:45.677446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.677377    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:45.688365 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.688341    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls\") pod \"e6efad69-328b-4509-8c9e-d2078b02a99c\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") "
Sep 09 21:56:45.688483 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.688414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q4nr\" (UniqueName: \"kubernetes.io/projected/e6efad69-328b-4509-8c9e-d2078b02a99c-kube-api-access-7q4nr\") pod \"e6efad69-328b-4509-8c9e-d2078b02a99c\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") "
Sep 09 21:56:45.688483 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.688431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-metrics-certs\") pod \"e6efad69-328b-4509-8c9e-d2078b02a99c\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") "
Sep 09 21:56:45.688483 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.688453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6efad69-328b-4509-8c9e-d2078b02a99c-openshift-service-ca\") pod \"e6efad69-328b-4509-8c9e-d2078b02a99c\" (UID: \"e6efad69-328b-4509-8c9e-d2078b02a99c\") "
Sep 09 21:56:45.689021 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.688975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6efad69-328b-4509-8c9e-d2078b02a99c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6efad69-328b-4509-8c9e-d2078b02a99c" (UID: "e6efad69-328b-4509-8c9e-d2078b02a99c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:56:45.690916 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.690891    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6efad69-328b-4509-8c9e-d2078b02a99c-kube-api-access-7q4nr" (OuterVolumeSpecName: "kube-api-access-7q4nr") pod "e6efad69-328b-4509-8c9e-d2078b02a99c" (UID: "e6efad69-328b-4509-8c9e-d2078b02a99c"). InnerVolumeSpecName "kube-api-access-7q4nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:56:45.690916 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.690899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6efad69-328b-4509-8c9e-d2078b02a99c" (UID: "e6efad69-328b-4509-8c9e-d2078b02a99c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:56:45.691117 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.691095    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6efad69-328b-4509-8c9e-d2078b02a99c" (UID: "e6efad69-328b-4509-8c9e-d2078b02a99c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:56:45.790147 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.790110    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:45.790147 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.790145    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q4nr\" (UniqueName: \"kubernetes.io/projected/e6efad69-328b-4509-8c9e-d2078b02a99c-kube-api-access-7q4nr\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:45.790358 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.790160    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6efad69-328b-4509-8c9e-d2078b02a99c-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:45.790358 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:45.790176    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6efad69-328b-4509-8c9e-d2078b02a99c-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:56:46.260639 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.260597    2560 generic.go:356] "Generic (PLEG): container finished" podID="e6efad69-328b-4509-8c9e-d2078b02a99c" containerID="ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697" exitCode=0
Sep 09 21:56:46.260836 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.260655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" event={"ID":"e6efad69-328b-4509-8c9e-d2078b02a99c","Type":"ContainerDied","Data":"ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697"}
Sep 09 21:56:46.260836 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.260707    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4" event={"ID":"e6efad69-328b-4509-8c9e-d2078b02a99c","Type":"ContainerDied","Data":"2e6a5b0b5d4508897b424f1b785fb33f980a8f498ac162ad97154c8aab7ed995"}
Sep 09 21:56:46.260836 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.260735    2560 scope.go:117] "RemoveContainer" containerID="ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697"
Sep 09 21:56:46.260836 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.260657    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"
Sep 09 21:56:46.269347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.269325    2560 scope.go:117] "RemoveContainer" containerID="ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697"
Sep 09 21:56:46.269639 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:46.269620    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697\": container with ID starting with ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697 not found: ID does not exist" containerID="ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697"
Sep 09 21:56:46.269719 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.269647    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697"} err="failed to get container status \"ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697\": rpc error: code = NotFound desc = could not find container \"ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697\": container with ID starting with ea7b01f3b4bb6b7b82969eba5d8dc18a8bbde039ca766aa33dd6bd6e5d126697 not found: ID does not exist"
Sep 09 21:56:46.279759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.279729    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"]
Sep 09 21:56:46.285848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:46.285818    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a691ec3b-7d5d8bd4bf-qd2c4"]
Sep 09 21:56:47.752577 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752541    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"]
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752889    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752908    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752921    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6efad69-328b-4509-8c9e-d2078b02a99c" containerName="maas-api"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752927    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6efad69-328b-4509-8c9e-d2078b02a99c" containerName="maas-api"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752936    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752942    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752949    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76b4ad1-839e-44bf-bddf-021d5b28a582" containerName="maas-api"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.752954    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76b4ad1-839e-44bf-bddf-021d5b28a582" containerName="maas-api"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.753000    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6efad69-328b-4509-8c9e-d2078b02a99c" containerName="maas-api"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.753006    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy"
Sep 09 21:56:47.753062 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.753017    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76b4ad1-839e-44bf-bddf-021d5b28a582" containerName="maas-api"
Sep 09 21:56:47.756025 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.756005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.758673 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.758649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5677f8b9-openshift-default-dockercfg-vstc8\""
Sep 09 21:56:47.768013 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.767987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"]
Sep 09 21:56:47.812548 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-certs\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812548 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806369cb-5162-4623-8edd-17e22157d6d8-istio-podinfo\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812767 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-data\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812767 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-socket\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812767 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-credential-socket\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812767 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-istio-token\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812895 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806369cb-5162-4623-8edd-17e22157d6d8-istiod-ca-cert\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812940 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-envoy\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.812970 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.812935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr2rm\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-kube-api-access-kr2rm\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806369cb-5162-4623-8edd-17e22157d6d8-istiod-ca-cert\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-envoy\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913822 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr2rm\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-kube-api-access-kr2rm\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913865 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-certs\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913865 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806369cb-5162-4623-8edd-17e22157d6d8-istio-podinfo\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-data\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.913943 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-socket\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914045 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.913966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-credential-socket\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914045 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.914021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-istio-token\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914233 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.914207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-certs\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914305 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.914250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-data\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914404 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.914377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-socket\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914483 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.914415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806369cb-5162-4623-8edd-17e22157d6d8-istiod-ca-cert\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.914613 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.914592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-credential-socket\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.916566 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.916535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-envoy\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.916821 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.916799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806369cb-5162-4623-8edd-17e22157d6d8-istio-podinfo\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.917274 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.917252    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6efad69-328b-4509-8c9e-d2078b02a99c" path="/var/lib/kubelet/pods/e6efad69-328b-4509-8c9e-d2078b02a99c/volumes"
Sep 09 21:56:47.923437 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.923397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-istio-token\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:47.923607 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:47.923551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr2rm\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-kube-api-access-kr2rm\") pod \"e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") " pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:48.066704 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:48.066660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:48.356706 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:48.356611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"]
Sep 09 21:56:48.359414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:56:48.359388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806369cb_5162_4623_8edd_17e22157d6d8.slice/crio-fb33de044573c23d3241ba3304b84290495ba3f20bad39c2343fa1ac6d85d3d8 WatchSource:0}: Error finding container fb33de044573c23d3241ba3304b84290495ba3f20bad39c2343fa1ac6d85d3d8: Status 404 returned error can't find the container with id fb33de044573c23d3241ba3304b84290495ba3f20bad39c2343fa1ac6d85d3d8
Sep 09 21:56:48.361769 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:48.361734    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:56:48.361867 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:48.361823    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:56:48.361928 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:48.361868    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:56:49.280282 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:49.280249    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" event={"ID":"806369cb-5162-4623-8edd-17e22157d6d8","Type":"ContainerStarted","Data":"fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"}
Sep 09 21:56:49.280697 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:49.280299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" event={"ID":"806369cb-5162-4623-8edd-17e22157d6d8","Type":"ContainerStarted","Data":"fb33de044573c23d3241ba3304b84290495ba3f20bad39c2343fa1ac6d85d3d8"}
Sep 09 21:56:49.302957 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:49.302905    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podStartSLOduration=2.302886513 podStartE2EDuration="2.302886513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:56:49.301506562 +0000 UTC m=+1083.856166302" watchObservedRunningTime="2026-09-09 21:56:49.302886513 +0000 UTC m=+1083.857546264"
Sep 09 21:56:50.066146 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:50.066109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:56:50.066805 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:50.066783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:50.071602 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:50.071581    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:50.285371 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:50.285342    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:50.286283 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:50.286261    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:56:51.133017 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.132975    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"]
Sep 09 21:56:51.133422 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.133404    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ecade9-d68f-481c-82ee-9ffce2e599a2" containerName="istio-proxy"
Sep 09 21:56:51.135574 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.135552    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.138537 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.138504    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-bbdd85-openshift-default-dockercfg-pwtgq\""
Sep 09 21:56:51.180753 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.180721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"]
Sep 09 21:56:51.249040 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc4b03e-0556-481d-aee8-34e8e9881315-istiod-ca-cert\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249040 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-envoy\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249245 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-podinfo\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249245 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-data\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249245 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjmzw\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-kube-api-access-xjmzw\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-socket\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-token\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-certs\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.249347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.249339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-credential-socket\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.350686 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.350649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-data\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.350721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjmzw\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-kube-api-access-xjmzw\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.350762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-socket\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.350788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-token\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.350850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-certs\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.350990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-credential-socket\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc4b03e-0556-481d-aee8-34e8e9881315-istiod-ca-cert\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-envoy\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-socket\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351606 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-podinfo\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351606 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-credential-socket\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351606 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-certs\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351759 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-data\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.351813 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.351758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc4b03e-0556-481d-aee8-34e8e9881315-istiod-ca-cert\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.353531 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.353509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-envoy\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.353917 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.353886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-podinfo\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.388059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.384775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-token\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.388059 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.387051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjmzw\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-kube-api-access-xjmzw\") pod \"e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") " pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.447110 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.447064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:51.740142 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.740055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"]
Sep 09 21:56:51.743414 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:56:51.743387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc4b03e_0556_481d_aee8_34e8e9881315.slice/crio-65599fecd2153a13fd3dd78bfc25371a306d485f68e3400544c2f8f07f9f0abb WatchSource:0}: Error finding container 65599fecd2153a13fd3dd78bfc25371a306d485f68e3400544c2f8f07f9f0abb: Status 404 returned error can't find the container with id 65599fecd2153a13fd3dd78bfc25371a306d485f68e3400544c2f8f07f9f0abb
Sep 09 21:56:51.745758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.745724    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:56:51.745829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.745794    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:56:51.745829 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.745820    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:56:51.902894 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.902857    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"]
Sep 09 21:56:51.905401 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.905376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:51.909150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.908912    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5677f8b9-serving-cert\""
Sep 09 21:56:51.909150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.908961    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-94w96\""
Sep 09 21:56:51.909150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.908978    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 21:56:51.909150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.909042    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:56:51.909150 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.909062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 21:56:51.926419 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.926385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"]
Sep 09 21:56:51.957766 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.957728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-metrics-certs\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:51.958080 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.958043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b83d55de-2e63-4471-9f50-d2f66a5fdedd-openshift-service-ca\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:51.958199 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.958139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:51.958199 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:51.958180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89mzv\" (UniqueName: \"kubernetes.io/projected/b83d55de-2e63-4471-9f50-d2f66a5fdedd-kube-api-access-89mzv\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.059766 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.059729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-metrics-certs\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.059977 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.059795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b83d55de-2e63-4471-9f50-d2f66a5fdedd-openshift-service-ca\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.059977 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.059841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.059977 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.059874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89mzv\" (UniqueName: \"kubernetes.io/projected/b83d55de-2e63-4471-9f50-d2f66a5fdedd-kube-api-access-89mzv\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.059977 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:52.059966    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-serving-cert: secret "maas-api-e2e-derive-5677f8b9-serving-cert" not found
Sep 09 21:56:52.060162 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:56:52.060062    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls podName:b83d55de-2e63-4471-9f50-d2f66a5fdedd nodeName:}" failed. No retries permitted until 2026-09-09 21:56:52.560037942 +0000 UTC m=+1087.114697682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls") pod "maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" (UID: "b83d55de-2e63-4471-9f50-d2f66a5fdedd") : secret "maas-api-e2e-derive-5677f8b9-serving-cert" not found
Sep 09 21:56:52.060532 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.060512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b83d55de-2e63-4471-9f50-d2f66a5fdedd-openshift-service-ca\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.062500 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.062449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-metrics-certs\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.076025 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.075996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89mzv\" (UniqueName: \"kubernetes.io/projected/b83d55de-2e63-4471-9f50-d2f66a5fdedd-kube-api-access-89mzv\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.296969 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.296930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" event={"ID":"3cc4b03e-0556-481d-aee8-34e8e9881315","Type":"ContainerStarted","Data":"49f659df3e3f6be4b0f7ec816c79363ebcc8d83e87eb81005768b2c0ec38b9bb"}
Sep 09 21:56:52.297207 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.296989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" event={"ID":"3cc4b03e-0556-481d-aee8-34e8e9881315","Type":"ContainerStarted","Data":"65599fecd2153a13fd3dd78bfc25371a306d485f68e3400544c2f8f07f9f0abb"}
Sep 09 21:56:52.329012 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.328895    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podStartSLOduration=1.32887563 podStartE2EDuration="1.32887563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:56:52.326305732 +0000 UTC m=+1086.880965472" watchObservedRunningTime="2026-09-09 21:56:52.32887563 +0000 UTC m=+1086.883535447"
Sep 09 21:56:52.447924 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.447877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:52.452878 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.452849    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:52.565340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.565297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.567931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.567905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls\") pod \"maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:52.817406 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:52.817370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:53.130073 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:53.130029    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"]
Sep 09 21:56:53.132451 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:56:53.132418    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83d55de_2e63_4471_9f50_d2f66a5fdedd.slice/crio-fcaa86c08a13367c85e4e560f89d1df83eea427dd69459a0c107e4d6de54ae29 WatchSource:0}: Error finding container fcaa86c08a13367c85e4e560f89d1df83eea427dd69459a0c107e4d6de54ae29: Status 404 returned error can't find the container with id fcaa86c08a13367c85e4e560f89d1df83eea427dd69459a0c107e4d6de54ae29
Sep 09 21:56:53.304084 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:53.304049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" event={"ID":"b83d55de-2e63-4471-9f50-d2f66a5fdedd","Type":"ContainerStarted","Data":"fcaa86c08a13367c85e4e560f89d1df83eea427dd69459a0c107e4d6de54ae29"}
Sep 09 21:56:53.304282 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:53.304255    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:53.305347 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:53.305329    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:56:54.310510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:54.310453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" event={"ID":"b83d55de-2e63-4471-9f50-d2f66a5fdedd","Type":"ContainerStarted","Data":"7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f"}
Sep 09 21:56:54.310895 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:54.310540    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:56:54.332349 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:56:54.332292    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" podStartSLOduration=2.798209652 podStartE2EDuration="3.332272269s" totalImagesPullingTime="534.062617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:56:54.330850827 +0000 UTC m=+1088.885510567" watchObservedRunningTime="2026-09-09 21:56:54.332272269 +0000 UTC m=+1088.886932002"
Sep 09 21:57:00.321836 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:00.321799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:57:06.635813 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:06.635004    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"]
Sep 09 21:57:09.346697 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.346622    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 21:57:09.347158 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.346690    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 21:57:09.384837 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.384792    2560 generic.go:356] "Generic (PLEG): container finished" podID="806369cb-5162-4623-8edd-17e22157d6d8" containerID="fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602" exitCode=0
Sep 09 21:57:09.385030 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.384869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" event={"ID":"806369cb-5162-4623-8edd-17e22157d6d8","Type":"ContainerDied","Data":"fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"}
Sep 09 21:57:09.385340 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.385322    2560 scope.go:117] "RemoveContainer" containerID="fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"
Sep 09 21:57:09.386656 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.386621    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:57:09.386754 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.386717    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:57:09.386793 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:09.386766    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:57:10.391890 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.391852    2560 generic.go:356] "Generic (PLEG): container finished" podID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerID="49f659df3e3f6be4b0f7ec816c79363ebcc8d83e87eb81005768b2c0ec38b9bb" exitCode=0
Sep 09 21:57:10.392446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.391932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" event={"ID":"3cc4b03e-0556-481d-aee8-34e8e9881315","Type":"ContainerDied","Data":"49f659df3e3f6be4b0f7ec816c79363ebcc8d83e87eb81005768b2c0ec38b9bb"}
Sep 09 21:57:10.392446 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.392431    2560 scope.go:117] "RemoveContainer" containerID="49f659df3e3f6be4b0f7ec816c79363ebcc8d83e87eb81005768b2c0ec38b9bb"
Sep 09 21:57:10.393765 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.393730    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:57:10.393877 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.393824    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:57:10.393877 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.393870    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:57:10.394399 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:10.394378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" event={"ID":"806369cb-5162-4623-8edd-17e22157d6d8","Type":"ContainerStarted","Data":"9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a"}
Sep 09 21:57:11.067038 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.066996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:57:11.067247 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.067222    2560 patch_prober.go:28] interesting pod/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 21:57:11.067309 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.067288    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 21:57:11.405527 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.405393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" event={"ID":"3cc4b03e-0556-481d-aee8-34e8e9881315","Type":"ContainerStarted","Data":"e126b9f5735b3b78ef37bb83562df27a74869718b4b64c3126217687bcd6b34c"}
Sep 09 21:57:11.447693 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.447642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:57:11.447988 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.447963    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 09 21:57:11.448079 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:11.448033    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 09 21:57:12.067384 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:12.067348    2560 patch_prober.go:28] interesting pod/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 21:57:12.067579 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:12.067400    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 21:57:12.366054 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:12.365965    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:57:12.448169 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:12.448127    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 09 21:57:12.448603 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:12.448199    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 09 21:57:13.067329 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:13.067284    2560 patch_prober.go:28] interesting pod/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 21:57:13.067527 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:13.067347    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 21:57:13.447851 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:13.447768    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 09 21:57:13.448077 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:13.448049    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 09 21:57:14.067823 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:14.067783    2560 patch_prober.go:28] interesting pod/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 21:57:14.068240 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:14.067840    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 21:57:14.448534 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:14.448429    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 09 21:57:14.448534 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:14.448507    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 09 21:57:15.067647 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:15.067602    2560 patch_prober.go:28] interesting pod/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 21:57:15.067830 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:15.067667    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 21:57:15.447979 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:15.447885    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 09 21:57:15.448643 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:15.448587    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 09 21:57:16.067752 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:16.067711    2560 patch_prober.go:28] interesting pod/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 09 21:57:16.067965 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:16.067784    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 09 21:57:16.448346 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:16.448250    2560 patch_prober.go:28] interesting pod/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 09 21:57:16.448346 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:16.448311    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 09 21:57:17.265070 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:17.265035    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:57:17.265684 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:17.265655    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:57:17.266993 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:17.266965    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:57:17.451495 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:17.451455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:57:17.451851 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:17.451810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:57:17.452516 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:17.452458    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:57:21.656744 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.656700    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8" podUID="a3866323-c018-44ac-8900-7499c8cbb50f" containerName="main" containerID="cri-o://44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2" gracePeriod=45
Sep 09 21:57:21.921766 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.921740    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:57:21.953327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-home\") pod \"a3866323-c018-44ac-8900-7499c8cbb50f\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") "
Sep 09 21:57:21.953327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953332    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxrvw\" (UniqueName: \"kubernetes.io/projected/a3866323-c018-44ac-8900-7499c8cbb50f-kube-api-access-zxrvw\") pod \"a3866323-c018-44ac-8900-7499c8cbb50f\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") "
Sep 09 21:57:21.953596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953360    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-model-cache\") pod \"a3866323-c018-44ac-8900-7499c8cbb50f\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") "
Sep 09 21:57:21.953596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953420    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-dshm\") pod \"a3866323-c018-44ac-8900-7499c8cbb50f\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") "
Sep 09 21:57:21.953596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953455    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3866323-c018-44ac-8900-7499c8cbb50f-tls-certs\") pod \"a3866323-c018-44ac-8900-7499c8cbb50f\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") "
Sep 09 21:57:21.953799 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-tmp-dir\") pod \"a3866323-c018-44ac-8900-7499c8cbb50f\" (UID: \"a3866323-c018-44ac-8900-7499c8cbb50f\") "
Sep 09 21:57:21.953911 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-home" (OuterVolumeSpecName: "home") pod "a3866323-c018-44ac-8900-7499c8cbb50f" (UID: "a3866323-c018-44ac-8900-7499c8cbb50f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:21.953911 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-model-cache" (OuterVolumeSpecName: "model-cache") pod "a3866323-c018-44ac-8900-7499c8cbb50f" (UID: "a3866323-c018-44ac-8900-7499c8cbb50f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:21.953911 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.953764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a3866323-c018-44ac-8900-7499c8cbb50f" (UID: "a3866323-c018-44ac-8900-7499c8cbb50f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:21.954322 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.954144    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-tmp-dir\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:21.954322 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.954168    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-home\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:21.954322 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.954183    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-model-cache\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:21.955781 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.955745    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3866323-c018-44ac-8900-7499c8cbb50f-kube-api-access-zxrvw" (OuterVolumeSpecName: "kube-api-access-zxrvw") pod "a3866323-c018-44ac-8900-7499c8cbb50f" (UID: "a3866323-c018-44ac-8900-7499c8cbb50f"). InnerVolumeSpecName "kube-api-access-zxrvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:57:21.955869 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.955788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-dshm" (OuterVolumeSpecName: "dshm") pod "a3866323-c018-44ac-8900-7499c8cbb50f" (UID: "a3866323-c018-44ac-8900-7499c8cbb50f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:21.955869 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:21.955829    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3866323-c018-44ac-8900-7499c8cbb50f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a3866323-c018-44ac-8900-7499c8cbb50f" (UID: "a3866323-c018-44ac-8900-7499c8cbb50f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:57:22.055050 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.055015    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3866323-c018-44ac-8900-7499c8cbb50f-tls-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:22.055050 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.055045    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxrvw\" (UniqueName: \"kubernetes.io/projected/a3866323-c018-44ac-8900-7499c8cbb50f-kube-api-access-zxrvw\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:22.055050 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.055055    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3866323-c018-44ac-8900-7499c8cbb50f-dshm\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:22.474800 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.474759    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3866323-c018-44ac-8900-7499c8cbb50f" containerID="44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2" exitCode=0
Sep 09 21:57:22.474800 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.474796    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"
Sep 09 21:57:22.475039 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.474824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8" event={"ID":"a3866323-c018-44ac-8900-7499c8cbb50f","Type":"ContainerDied","Data":"44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2"}
Sep 09 21:57:22.475039 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.474865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8" event={"ID":"a3866323-c018-44ac-8900-7499c8cbb50f","Type":"ContainerDied","Data":"300a89892850885ff83ac52a27bd66f0b123534c52d188ce52c786ac3b1b9f81"}
Sep 09 21:57:22.475039 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.474886    2560 scope.go:117] "RemoveContainer" containerID="44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2"
Sep 09 21:57:22.484191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.484172    2560 scope.go:117] "RemoveContainer" containerID="44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2"
Sep 09 21:57:22.484487 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:57:22.484449    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2\": container with ID starting with 44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2 not found: ID does not exist" containerID="44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2"
Sep 09 21:57:22.484559 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.484502    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2"} err="failed to get container status \"44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2\": rpc error: code = NotFound desc = could not find container \"44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2\": container with ID starting with 44933c97a012009ec1cc4bfcc9b54498a041fb43ec0b453a3bfa8d96b4dcc1e2 not found: ID does not exist"
Sep 09 21:57:22.496291 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.496264    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"]
Sep 09 21:57:22.501240 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:22.501219    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-8c5761ec-kserve-74b4f7667c-n6cg8"]
Sep 09 21:57:23.916725 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:23.916693    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3866323-c018-44ac-8900-7499c8cbb50f" path="/var/lib/kubelet/pods/a3866323-c018-44ac-8900-7499c8cbb50f/volumes"
Sep 09 21:57:29.864878 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:29.864842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:57:32.736122 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:32.736087    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"]
Sep 09 21:57:32.736568 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:32.736317    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" podUID="b83d55de-2e63-4471-9f50-d2f66a5fdedd" containerName="maas-api" containerID="cri-o://7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f" gracePeriod=30
Sep 09 21:57:32.986312 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:32.986254    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:57:33.062270 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.062238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b83d55de-2e63-4471-9f50-d2f66a5fdedd-openshift-service-ca\") pod \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") "
Sep 09 21:57:33.062495 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.062280    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls\") pod \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") "
Sep 09 21:57:33.062495 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.062438    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89mzv\" (UniqueName: \"kubernetes.io/projected/b83d55de-2e63-4471-9f50-d2f66a5fdedd-kube-api-access-89mzv\") pod \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") "
Sep 09 21:57:33.062636 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.062507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-metrics-certs\") pod \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\" (UID: \"b83d55de-2e63-4471-9f50-d2f66a5fdedd\") "
Sep 09 21:57:33.062726 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.062703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b83d55de-2e63-4471-9f50-d2f66a5fdedd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b83d55de-2e63-4471-9f50-d2f66a5fdedd" (UID: "b83d55de-2e63-4471-9f50-d2f66a5fdedd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:57:33.062825 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.062796    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b83d55de-2e63-4471-9f50-d2f66a5fdedd-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:33.064588 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.064564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b83d55de-2e63-4471-9f50-d2f66a5fdedd" (UID: "b83d55de-2e63-4471-9f50-d2f66a5fdedd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:57:33.064695 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.064585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b83d55de-2e63-4471-9f50-d2f66a5fdedd" (UID: "b83d55de-2e63-4471-9f50-d2f66a5fdedd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:57:33.064695 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.064609    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83d55de-2e63-4471-9f50-d2f66a5fdedd-kube-api-access-89mzv" (OuterVolumeSpecName: "kube-api-access-89mzv") pod "b83d55de-2e63-4471-9f50-d2f66a5fdedd" (UID: "b83d55de-2e63-4471-9f50-d2f66a5fdedd"). InnerVolumeSpecName "kube-api-access-89mzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:57:33.100859 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.100826    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"]
Sep 09 21:57:33.101123 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.101083    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy" containerID="cri-o://9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a" gracePeriod=30
Sep 09 21:57:33.163598 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.163562    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89mzv\" (UniqueName: \"kubernetes.io/projected/b83d55de-2e63-4471-9f50-d2f66a5fdedd-kube-api-access-89mzv\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:33.163598 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.163596    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:33.163598 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.163607    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b83d55de-2e63-4471-9f50-d2f66a5fdedd-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:33.532113 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.532076    2560 generic.go:356] "Generic (PLEG): container finished" podID="b83d55de-2e63-4471-9f50-d2f66a5fdedd" containerID="7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f" exitCode=0
Sep 09 21:57:33.532295 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.532122    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"
Sep 09 21:57:33.532295 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.532136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" event={"ID":"b83d55de-2e63-4471-9f50-d2f66a5fdedd","Type":"ContainerDied","Data":"7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f"}
Sep 09 21:57:33.532295 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.532180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5" event={"ID":"b83d55de-2e63-4471-9f50-d2f66a5fdedd","Type":"ContainerDied","Data":"fcaa86c08a13367c85e4e560f89d1df83eea427dd69459a0c107e4d6de54ae29"}
Sep 09 21:57:33.532295 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.532203    2560 scope.go:117] "RemoveContainer" containerID="7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f"
Sep 09 21:57:33.541452 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.541431    2560 scope.go:117] "RemoveContainer" containerID="7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f"
Sep 09 21:57:33.541825 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:57:33.541804    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f\": container with ID starting with 7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f not found: ID does not exist" containerID="7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f"
Sep 09 21:57:33.541881 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.541834    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f"} err="failed to get container status \"7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f\": rpc error: code = NotFound desc = could not find container \"7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f\": container with ID starting with 7e689dca4a932681b679986e48e19e80467cfca39e67341260cce2328bc6a75f not found: ID does not exist"
Sep 09 21:57:33.552528 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.552494    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"]
Sep 09 21:57:33.562538 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.562513    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5677f8b9-58c95db694-pdzq5"]
Sep 09 21:57:33.917608 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:33.917574    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83d55de-2e63-4471-9f50-d2f66a5fdedd" path="/var/lib/kubelet/pods/b83d55de-2e63-4471-9f50-d2f66a5fdedd/volumes"
Sep 09 21:57:38.345725 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.345700    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:57:38.412877 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.412792    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-certs\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.412877 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.412831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806369cb-5162-4623-8edd-17e22157d6d8-istiod-ca-cert\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.412877 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.412851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-credential-socket\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.412879    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr2rm\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-kube-api-access-kr2rm\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.412939    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806369cb-5162-4623-8edd-17e22157d6d8-istio-podinfo\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.412981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-data\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-istio-token\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413042    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-envoy\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:38.413164 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413093    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-socket\") pod \"806369cb-5162-4623-8edd-17e22157d6d8\" (UID: \"806369cb-5162-4623-8edd-17e22157d6d8\") "
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413302    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413319    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/806369cb-5162-4623-8edd-17e22157d6d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413500    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413522    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806369cb-5162-4623-8edd-17e22157d6d8-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413538    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.413558 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413556    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.413871 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.413572    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.415386 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.415355    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:57:38.415529 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.415383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/806369cb-5162-4623-8edd-17e22157d6d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 21:57:38.415775 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.415756    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:57:38.416003 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.415984    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-kube-api-access-kr2rm" (OuterVolumeSpecName: "kube-api-access-kr2rm") pod "806369cb-5162-4623-8edd-17e22157d6d8" (UID: "806369cb-5162-4623-8edd-17e22157d6d8"). InnerVolumeSpecName "kube-api-access-kr2rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:57:38.514942 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.514908    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.514942 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.514938    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806369cb-5162-4623-8edd-17e22157d6d8-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.514942 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.514948    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr2rm\" (UniqueName: \"kubernetes.io/projected/806369cb-5162-4623-8edd-17e22157d6d8-kube-api-access-kr2rm\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.515174 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.514958    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806369cb-5162-4623-8edd-17e22157d6d8-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:38.563867 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.563829    2560 generic.go:356] "Generic (PLEG): container finished" podID="806369cb-5162-4623-8edd-17e22157d6d8" containerID="9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a" exitCode=0
Sep 09 21:57:38.564034 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.563880    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"
Sep 09 21:57:38.564034 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.563909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" event={"ID":"806369cb-5162-4623-8edd-17e22157d6d8","Type":"ContainerDied","Data":"9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a"}
Sep 09 21:57:38.564034 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.563974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p" event={"ID":"806369cb-5162-4623-8edd-17e22157d6d8","Type":"ContainerDied","Data":"fb33de044573c23d3241ba3304b84290495ba3f20bad39c2343fa1ac6d85d3d8"}
Sep 09 21:57:38.564034 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.564002    2560 scope.go:117] "RemoveContainer" containerID="9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a"
Sep 09 21:57:38.573527 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.573507    2560 scope.go:117] "RemoveContainer" containerID="fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"
Sep 09 21:57:38.581609 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.581596    2560 scope.go:117] "RemoveContainer" containerID="9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a"
Sep 09 21:57:38.581910 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:57:38.581889    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a\": container with ID starting with 9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a not found: ID does not exist" containerID="9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a"
Sep 09 21:57:38.581990 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.581924    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a"} err="failed to get container status \"9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a\": rpc error: code = NotFound desc = could not find container \"9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a\": container with ID starting with 9810ad973d5a5e7cfe8b4f847899ad2ab214dd7d550f34b85f5c7b505920cc7a not found: ID does not exist"
Sep 09 21:57:38.581990 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.581952    2560 scope.go:117] "RemoveContainer" containerID="fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"
Sep 09 21:57:38.582251 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:57:38.582230    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602\": container with ID starting with fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602 not found: ID does not exist" containerID="fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"
Sep 09 21:57:38.582300 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.582259    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602"} err="failed to get container status \"fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602\": rpc error: code = NotFound desc = could not find container \"fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602\": container with ID starting with fb26a931678157e5c26e4c00dd2c17cc3cad9de01cc204db641609344cd24602 not found: ID does not exist"
Sep 09 21:57:38.590188 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.590163    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"]
Sep 09 21:57:38.592750 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:38.592729    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5677f8b9-openshift-default-fdc989dd8-kkf7p"]
Sep 09 21:57:39.916223 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:39.916182    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="806369cb-5162-4623-8edd-17e22157d6d8" path="/var/lib/kubelet/pods/806369cb-5162-4623-8edd-17e22157d6d8/volumes"
Sep 09 21:57:45.052349 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052304    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"]
Sep 09 21:57:45.052855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052787    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy"
Sep 09 21:57:45.052855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052807    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy"
Sep 09 21:57:45.052855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052821    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83d55de-2e63-4471-9f50-d2f66a5fdedd" containerName="maas-api"
Sep 09 21:57:45.052855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052829    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83d55de-2e63-4471-9f50-d2f66a5fdedd" containerName="maas-api"
Sep 09 21:57:45.052855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052845    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3866323-c018-44ac-8900-7499c8cbb50f" containerName="main"
Sep 09 21:57:45.052855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052853    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3866323-c018-44ac-8900-7499c8cbb50f" containerName="main"
Sep 09 21:57:45.053158 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052965    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83d55de-2e63-4471-9f50-d2f66a5fdedd" containerName="maas-api"
Sep 09 21:57:45.053158 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052980    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy"
Sep 09 21:57:45.053158 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.052992    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3866323-c018-44ac-8900-7499c8cbb50f" containerName="main"
Sep 09 21:57:45.055683 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.055660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:45.058196 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.058176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nqcf2\""
Sep 09 21:57:45.058405 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.058389    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:57:45.070699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.070673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"]
Sep 09 21:57:45.174729 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.174689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2191021-f57a-496f-af26-60e97101aaa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq\" (UID: \"f2191021-f57a-496f-af26-60e97101aaa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:45.275297 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.275263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2191021-f57a-496f-af26-60e97101aaa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq\" (UID: \"f2191021-f57a-496f-af26-60e97101aaa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:45.275920 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.275899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2191021-f57a-496f-af26-60e97101aaa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq\" (UID: \"f2191021-f57a-496f-af26-60e97101aaa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:45.365602 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.365559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:45.646579 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:45.646489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"]
Sep 09 21:57:45.648906 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:57:45.648869    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2191021_f57a_496f_af26_60e97101aaa0.slice/crio-33c9c61cfce5222b763d3ad4efb4e8b88748139915f963ac8a7874175f598a61 WatchSource:0}: Error finding container 33c9c61cfce5222b763d3ad4efb4e8b88748139915f963ac8a7874175f598a61: Status 404 returned error can't find the container with id 33c9c61cfce5222b763d3ad4efb4e8b88748139915f963ac8a7874175f598a61
Sep 09 21:57:46.604848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:46.604815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq" event={"ID":"f2191021-f57a-496f-af26-60e97101aaa0","Type":"ContainerStarted","Data":"33c9c61cfce5222b763d3ad4efb4e8b88748139915f963ac8a7874175f598a61"}
Sep 09 21:57:48.623388 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:48.623344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq" event={"ID":"f2191021-f57a-496f-af26-60e97101aaa0","Type":"ContainerStarted","Data":"bebaf6c8d25ba725ca3bc6ead5ec28643df0f561156295df7fa8fb7f85521e08"}
Sep 09 21:57:48.639771 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:48.639714    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq" podStartSLOduration=1.067988946 podStartE2EDuration="3.639696054s" totalImagesPullingTime="2.571707108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:57:48.638715749 +0000 UTC m=+1143.193375492" watchObservedRunningTime="2026-09-09 21:57:48.639696054 +0000 UTC m=+1143.194355794"
Sep 09 21:57:49.630097 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:49.630060    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2191021-f57a-496f-af26-60e97101aaa0" containerID="bebaf6c8d25ba725ca3bc6ead5ec28643df0f561156295df7fa8fb7f85521e08" exitCode=0
Sep 09 21:57:49.630496 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:49.630147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq" event={"ID":"f2191021-f57a-496f-af26-60e97101aaa0","Type":"ContainerDied","Data":"bebaf6c8d25ba725ca3bc6ead5ec28643df0f561156295df7fa8fb7f85521e08"}
Sep 09 21:57:50.066181 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:50.066142    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:57:50.767709 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:50.767677    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:50.935728 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:50.935640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2191021-f57a-496f-af26-60e97101aaa0-maas-api-service-ca\") pod \"f2191021-f57a-496f-af26-60e97101aaa0\" (UID: \"f2191021-f57a-496f-af26-60e97101aaa0\") "
Sep 09 21:57:50.936007 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:50.935982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2191021-f57a-496f-af26-60e97101aaa0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f2191021-f57a-496f-af26-60e97101aaa0" (UID: "f2191021-f57a-496f-af26-60e97101aaa0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:57:51.036779 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:51.036734    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2191021-f57a-496f-af26-60e97101aaa0-maas-api-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:57:51.642115 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:51.642083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq" event={"ID":"f2191021-f57a-496f-af26-60e97101aaa0","Type":"ContainerDied","Data":"33c9c61cfce5222b763d3ad4efb4e8b88748139915f963ac8a7874175f598a61"}
Sep 09 21:57:51.642115 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:51.642105    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"
Sep 09 21:57:51.642327 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:51.642133    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33c9c61cfce5222b763d3ad4efb4e8b88748139915f963ac8a7874175f598a61"
Sep 09 21:57:55.797151 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:55.797111    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"]
Sep 09 21:57:55.799768 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:55.799740    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-bbdd85-sl4dq"]
Sep 09 21:57:55.916853 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:57:55.916813    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2191021-f57a-496f-af26-60e97101aaa0" path="/var/lib/kubelet/pods/f2191021-f57a-496f-af26-60e97101aaa0/volumes"
Sep 09 21:58:03.573191 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:03.573154    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"]
Sep 09 21:58:03.573729 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:03.573423    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy" containerID="cri-o://e126b9f5735b3b78ef37bb83562df27a74869718b4b64c3126217687bcd6b34c" gracePeriod=30
Sep 09 21:58:04.472098 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472066    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"]
Sep 09 21:58:04.472403 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472391    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy"
Sep 09 21:58:04.472450 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472406    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy"
Sep 09 21:58:04.472450 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472423    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2191021-f57a-496f-af26-60e97101aaa0" containerName="revoke-keys"
Sep 09 21:58:04.472450 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472428    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2191021-f57a-496f-af26-60e97101aaa0" containerName="revoke-keys"
Sep 09 21:58:04.472615 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472514    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2191021-f57a-496f-af26-60e97101aaa0" containerName="revoke-keys"
Sep 09 21:58:04.472615 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.472524    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="806369cb-5162-4623-8edd-17e22157d6d8" containerName="istio-proxy"
Sep 09 21:58:04.475748 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.475731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.478270 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.478240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-c10ca1-openshift-default-dockercfg-qgdgl\""
Sep 09 21:58:04.503628 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.503590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"]
Sep 09 21:58:04.554596 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-token\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.554795 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-certs\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.554795 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-envoy\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.554795 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istiod-ca-cert\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.554967 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-credential-socket\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.554967 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-data\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.554967 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-podinfo\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.555113 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.554974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx7nk\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-kube-api-access-wx7nk\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.555113 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.555021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-socket\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.655886 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.655845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-credential-socket\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.655906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-data\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-podinfo\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx7nk\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-kube-api-access-wx7nk\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-socket\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-token\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-certs\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-envoy\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656333 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istiod-ca-cert\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-credential-socket\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-socket\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-data\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656739 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-certs\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.656942 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.656924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istiod-ca-cert\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.658530 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.658504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-envoy\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.658659 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.658609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-podinfo\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.669072 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.669045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx7nk\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-kube-api-access-wx7nk\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.669385 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.669367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-token\") pod \"e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") " pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:04.785906 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:04.785806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:05.083376 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.083337    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"]
Sep 09 21:58:05.090282 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:58:05.090251    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6b7968_40a0_4bfb_a22b_9e02dc2ce95a.slice/crio-029fa1a90ddedd2cc7c8091cb6c2f665473f408979923c59fcbea3c73fee8f70 WatchSource:0}: Error finding container 029fa1a90ddedd2cc7c8091cb6c2f665473f408979923c59fcbea3c73fee8f70: Status 404 returned error can't find the container with id 029fa1a90ddedd2cc7c8091cb6c2f665473f408979923c59fcbea3c73fee8f70
Sep 09 21:58:05.092545 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.092507    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:58:05.092642 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.092580    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:58:05.092642 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.092609    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 21:58:05.707083 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.707043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" event={"ID":"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a","Type":"ContainerStarted","Data":"cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2"}
Sep 09 21:58:05.707481 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.707108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" event={"ID":"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a","Type":"ContainerStarted","Data":"029fa1a90ddedd2cc7c8091cb6c2f665473f408979923c59fcbea3c73fee8f70"}
Sep 09 21:58:05.786531 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:05.786491    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:06.792334 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:06.792244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:06.827079 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:06.827028    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" podStartSLOduration=2.82700818 podStartE2EDuration="2.82700818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:58:05.739868675 +0000 UTC m=+1160.294528414" watchObservedRunningTime="2026-09-09 21:58:06.82700818 +0000 UTC m=+1161.381667978"
Sep 09 21:58:07.475969 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:07.475923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:58:07.716698 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:07.716665    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:07.717638 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:07.717619    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:08.724478 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.724430    2560 generic.go:356] "Generic (PLEG): container finished" podID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerID="e126b9f5735b3b78ef37bb83562df27a74869718b4b64c3126217687bcd6b34c" exitCode=0
Sep 09 21:58:08.724887 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.724499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" event={"ID":"3cc4b03e-0556-481d-aee8-34e8e9881315","Type":"ContainerDied","Data":"e126b9f5735b3b78ef37bb83562df27a74869718b4b64c3126217687bcd6b34c"}
Sep 09 21:58:08.724887 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.724561    2560 scope.go:117] "RemoveContainer" containerID="49f659df3e3f6be4b0f7ec816c79363ebcc8d83e87eb81005768b2c0ec38b9bb"
Sep 09 21:58:08.828431 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.828391    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:58:08.896307 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896212    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-token\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896307 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896252    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-credential-socket\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896307 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896276    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-socket\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896307 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896307    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-data\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-envoy\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjmzw\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-kube-api-access-xjmzw\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc4b03e-0556-481d-aee8-34e8e9881315-istiod-ca-cert\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-podinfo\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896515    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-certs\") pod \"3cc4b03e-0556-481d-aee8-34e8e9881315\" (UID: \"3cc4b03e-0556-481d-aee8-34e8e9881315\") "
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896596    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:08.896661 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:08.897015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896734    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:08.897015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896848    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.897015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896867    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.897015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896917    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.897015 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.896944    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:08.897273 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.897225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cc4b03e-0556-481d-aee8-34e8e9881315-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:58:08.898902 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.898870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 21:58:08.899267 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.898984    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:58:08.899267 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.899078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-kube-api-access-xjmzw" (OuterVolumeSpecName: "kube-api-access-xjmzw") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "kube-api-access-xjmzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:58:08.899411 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.899291    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cc4b03e-0556-481d-aee8-34e8e9881315" (UID: "3cc4b03e-0556-481d-aee8-34e8e9881315"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:08.998172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.998124    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.998172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.998164    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.998172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.998177    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.998172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.998188    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjmzw\" (UniqueName: \"kubernetes.io/projected/3cc4b03e-0556-481d-aee8-34e8e9881315-kube-api-access-xjmzw\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.998581 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.998202    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc4b03e-0556-481d-aee8-34e8e9881315-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:08.998581 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:08.998216    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc4b03e-0556-481d-aee8-34e8e9881315-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:09.730800 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:09.730757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf" event={"ID":"3cc4b03e-0556-481d-aee8-34e8e9881315","Type":"ContainerDied","Data":"65599fecd2153a13fd3dd78bfc25371a306d485f68e3400544c2f8f07f9f0abb"}
Sep 09 21:58:09.731237 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:09.730824    2560 scope.go:117] "RemoveContainer" containerID="e126b9f5735b3b78ef37bb83562df27a74869718b4b64c3126217687bcd6b34c"
Sep 09 21:58:09.731237 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:09.730776    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"
Sep 09 21:58:09.757363 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:09.757330    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"]
Sep 09 21:58:09.764727 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:09.764697    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-bbdd85-openshift-default-5bfb6c4c6-gdgdf"]
Sep 09 21:58:09.915874 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:09.915837    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" path="/var/lib/kubelet/pods/3cc4b03e-0556-481d-aee8-34e8e9881315/volumes"
Sep 09 21:58:18.468404 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:18.468352    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"]
Sep 09 21:58:18.468881 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:18.468633    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" podUID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" containerName="istio-proxy" containerID="cri-o://cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2" gracePeriod=30
Sep 09 21:58:22.719371 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:22.719337    2560 patch_prober.go:28] interesting pod/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 21:58:22.719766 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:22.719407    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" podUID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:58:23.352390 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.352351    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:58:23.720037 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.720010    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:23.804601 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.804561    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" containerID="cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2" exitCode=0
Sep 09 21:58:23.804773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.804605    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"
Sep 09 21:58:23.804773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.804648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" event={"ID":"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a","Type":"ContainerDied","Data":"cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2"}
Sep 09 21:58:23.804773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.804704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs" event={"ID":"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a","Type":"ContainerDied","Data":"029fa1a90ddedd2cc7c8091cb6c2f665473f408979923c59fcbea3c73fee8f70"}
Sep 09 21:58:23.804773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.804726    2560 scope.go:117] "RemoveContainer" containerID="cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2"
Sep 09 21:58:23.813564 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.813543    2560 scope.go:117] "RemoveContainer" containerID="cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2"
Sep 09 21:58:23.813855 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:58:23.813835    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2\": container with ID starting with cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2 not found: ID does not exist" containerID="cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2"
Sep 09 21:58:23.813920 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.813865    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2"} err="failed to get container status \"cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2\": rpc error: code = NotFound desc = could not find container \"cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2\": container with ID starting with cf7971a5a4399430be23fed80e49bc2220d11bbab2c9e65005f42abb0006dde2 not found: ID does not exist"
Sep 09 21:58:23.831160 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-envoy\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831293 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831173    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istiod-ca-cert\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831293 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831190    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-credential-socket\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831293 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-data\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831447 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-socket\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831447 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-certs\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831447 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831423    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-token\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831460    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-podinfo\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831513    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:23.831634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831516    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx7nk\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-kube-api-access-wx7nk\") pod \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\" (UID: \"4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a\") "
Sep 09 21:58:23.831634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831535    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:23.831634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:23.831634 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:23.831931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:58:23.831931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831873    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.831931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831896    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.831931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831909    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.831931 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831922    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.832098 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.831936    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.833533 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.833497    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:58:23.833684 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.833663    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:58:23.834106 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.834085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 21:58:23.834181 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.834086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-kube-api-access-wx7nk" (OuterVolumeSpecName: "kube-api-access-wx7nk") pod "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" (UID: "4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a"). InnerVolumeSpecName "kube-api-access-wx7nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:58:23.932807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.932773    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.932807 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.932805    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.932993 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.932816    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx7nk\" (UniqueName: \"kubernetes.io/projected/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-kube-api-access-wx7nk\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:23.932993 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:23.932825    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:24.121600 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:24.121561    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"]
Sep 09 21:58:24.125948 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:24.125916    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-c10ca1-openshift-default-6f95bfd6c4-68vqs"]
Sep 09 21:58:25.917765 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:25.917728    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" path="/var/lib/kubelet/pods/4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a/volumes"
Sep 09 21:58:38.354145 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354095    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"]
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354594    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354615    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354627    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354636    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354647    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354657    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354734    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354748    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc4b03e-0556-481d-aee8-34e8e9881315" containerName="istio-proxy"
Sep 09 21:58:38.354758 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.354757    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6b7968-40a0-4bfb-a22b-9e02dc2ce95a" containerName="istio-proxy"
Sep 09 21:58:38.359391 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.359367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:38.362386 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.362358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:58:38.362386 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.362380    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nqcf2\""
Sep 09 21:58:38.368250 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.368226    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"]
Sep 09 21:58:38.461648 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.461611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72addab9-01bb-4ac4-951f-6c68fae0b2ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74\" (UID: \"72addab9-01bb-4ac4-951f-6c68fae0b2ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:38.562860 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.562820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72addab9-01bb-4ac4-951f-6c68fae0b2ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74\" (UID: \"72addab9-01bb-4ac4-951f-6c68fae0b2ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:38.563428 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.563406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72addab9-01bb-4ac4-951f-6c68fae0b2ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74\" (UID: \"72addab9-01bb-4ac4-951f-6c68fae0b2ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:38.671782 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.671683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:38.950571 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:38.950393    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"]
Sep 09 21:58:38.953266 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:58:38.953240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72addab9_01bb_4ac4_951f_6c68fae0b2ff.slice/crio-7bcf01a9043bc88ef309f4fe376750dcef208d099801e31741f31755bd8a4a56 WatchSource:0}: Error finding container 7bcf01a9043bc88ef309f4fe376750dcef208d099801e31741f31755bd8a4a56: Status 404 returned error can't find the container with id 7bcf01a9043bc88ef309f4fe376750dcef208d099801e31741f31755bd8a4a56
Sep 09 21:58:39.880458 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:39.880417    2560 generic.go:356] "Generic (PLEG): container finished" podID="72addab9-01bb-4ac4-951f-6c68fae0b2ff" containerID="8eacf03cc9fd7cc20f80748e2542bd9640e835bab329d0a1433eb67a9655092b" exitCode=0
Sep 09 21:58:39.880866 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:39.880510    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74" event={"ID":"72addab9-01bb-4ac4-951f-6c68fae0b2ff","Type":"ContainerDied","Data":"8eacf03cc9fd7cc20f80748e2542bd9640e835bab329d0a1433eb67a9655092b"}
Sep 09 21:58:39.880866 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:39.880559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74" event={"ID":"72addab9-01bb-4ac4-951f-6c68fae0b2ff","Type":"ContainerStarted","Data":"7bcf01a9043bc88ef309f4fe376750dcef208d099801e31741f31755bd8a4a56"}
Sep 09 21:58:41.011911 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.011886    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:41.185434 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.185330    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72addab9-01bb-4ac4-951f-6c68fae0b2ff-maas-api-service-ca\") pod \"72addab9-01bb-4ac4-951f-6c68fae0b2ff\" (UID: \"72addab9-01bb-4ac4-951f-6c68fae0b2ff\") "
Sep 09 21:58:41.185800 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.185774    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72addab9-01bb-4ac4-951f-6c68fae0b2ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72addab9-01bb-4ac4-951f-6c68fae0b2ff" (UID: "72addab9-01bb-4ac4-951f-6c68fae0b2ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:58:41.286855 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.286800    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72addab9-01bb-4ac4-951f-6c68fae0b2ff-maas-api-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:58:41.462904 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.462806    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:58:41.891652 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.891610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74" event={"ID":"72addab9-01bb-4ac4-951f-6c68fae0b2ff","Type":"ContainerDied","Data":"7bcf01a9043bc88ef309f4fe376750dcef208d099801e31741f31755bd8a4a56"}
Sep 09 21:58:41.891652 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.891637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"
Sep 09 21:58:41.891882 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:41.891672    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bcf01a9043bc88ef309f4fe376750dcef208d099801e31741f31755bd8a4a56"
Sep 09 21:58:49.240364 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:49.240315    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"]
Sep 09 21:58:49.243539 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:49.243503    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5aaa80-btq74"]
Sep 09 21:58:49.916235 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:49.916197    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72addab9-01bb-4ac4-951f-6c68fae0b2ff" path="/var/lib/kubelet/pods/72addab9-01bb-4ac4-951f-6c68fae0b2ff/volumes"
Sep 09 21:58:53.249478 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:58:53.249426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:59:01.390448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:01.390402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:59:12.272069 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:12.272027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:59:16.028487 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:16.028440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"]
Sep 09 21:59:16.028864 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:16.028699    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy" containerID="cri-o://9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d" gracePeriod=30
Sep 09 21:59:18.165032 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.164994    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"]
Sep 09 21:59:18.165448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.165303    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72addab9-01bb-4ac4-951f-6c68fae0b2ff" containerName="revoke-keys"
Sep 09 21:59:18.165448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.165315    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="72addab9-01bb-4ac4-951f-6c68fae0b2ff" containerName="revoke-keys"
Sep 09 21:59:18.165448 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.165378    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="72addab9-01bb-4ac4-951f-6c68fae0b2ff" containerName="revoke-keys"
Sep 09 21:59:18.168132 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.168109    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.171319 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.171293    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-df8f95ff-serving-cert\""
Sep 09 21:59:18.171557 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.171538    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:59:18.171557 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.171547    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 21:59:18.172159 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.172137    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 21:59:18.172672 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.172641    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-94w96\""
Sep 09 21:59:18.184187 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.184166    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"]
Sep 09 21:59:18.322819 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.322778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21dce9d9-e2c6-478d-9f72-2f8a63bed174-openshift-service-ca\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.323001 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.322853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-maas-api-tls\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.323001 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.322897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx4tc\" (UniqueName: \"kubernetes.io/projected/21dce9d9-e2c6-478d-9f72-2f8a63bed174-kube-api-access-kx4tc\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.323001 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.322938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-metrics-certs\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.424087 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.423999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21dce9d9-e2c6-478d-9f72-2f8a63bed174-openshift-service-ca\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.424087 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.424055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-maas-api-tls\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.424301 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.424089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx4tc\" (UniqueName: \"kubernetes.io/projected/21dce9d9-e2c6-478d-9f72-2f8a63bed174-kube-api-access-kx4tc\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.424301 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.424125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-metrics-certs\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.424938 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.424892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21dce9d9-e2c6-478d-9f72-2f8a63bed174-openshift-service-ca\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.426789 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.426759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-metrics-certs\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.426789 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.426784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-maas-api-tls\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.435753 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.435728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx4tc\" (UniqueName: \"kubernetes.io/projected/21dce9d9-e2c6-478d-9f72-2f8a63bed174-kube-api-access-kx4tc\") pod \"maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.479958 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.479921    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:18.756666 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.756631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"]
Sep 09 21:59:18.759422 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:59:18.759382    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21dce9d9_e2c6_478d_9f72_2f8a63bed174.slice/crio-57054afdb6a80a99c6201718c5d087c689a8ab34c89246d1dbce535b5bca86c8 WatchSource:0}: Error finding container 57054afdb6a80a99c6201718c5d087c689a8ab34c89246d1dbce535b5bca86c8: Status 404 returned error can't find the container with id 57054afdb6a80a99c6201718c5d087c689a8ab34c89246d1dbce535b5bca86c8
Sep 09 21:59:18.760773 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:18.760755    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:59:19.063457 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:19.063416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc" event={"ID":"21dce9d9-e2c6-478d-9f72-2f8a63bed174","Type":"ContainerStarted","Data":"57054afdb6a80a99c6201718c5d087c689a8ab34c89246d1dbce535b5bca86c8"}
Sep 09 21:59:20.070426 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:20.070390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc" event={"ID":"21dce9d9-e2c6-478d-9f72-2f8a63bed174","Type":"ContainerStarted","Data":"6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02"}
Sep 09 21:59:20.070801 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:20.070502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:20.105724 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:20.105652    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc" podStartSLOduration=1.650803893 podStartE2EDuration="2.105626772s" totalImagesPullingTime="454.822879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:59:20.10527395 +0000 UTC m=+1234.659933714" watchObservedRunningTime="2026-09-09 21:59:20.105626772 +0000 UTC m=+1234.660286513"
Sep 09 21:59:21.277304 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.277278    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:59:21.389334 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.389298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:59:21.394302 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.394266    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"]
Sep 09 21:59:21.394781 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.394755    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy"
Sep 09 21:59:21.394781 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.394781    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy"
Sep 09 21:59:21.394966 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.394801    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy"
Sep 09 21:59:21.394966 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.394810    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy"
Sep 09 21:59:21.394966 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.394905    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy"
Sep 09 21:59:21.397918 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.397899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.400093 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.400072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-ace629-serving-cert\""
Sep 09 21:59:21.418688 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.418653    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"]
Sep 09 21:59:21.453101 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtwj5\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-kube-api-access-mtwj5\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453253 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453121    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-certs\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453253 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-credential-socket\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453253 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453211    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-data\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453253 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453237    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9d2019-e8e4-4154-b620-901f93337eab-istiod-ca-cert\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453427 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9d2019-e8e4-4154-b620-901f93337eab-istio-podinfo\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453427 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-istio-token\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453427 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-socket\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453427 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453356    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-envoy\") pod \"5b9d2019-e8e4-4154-b620-901f93337eab\" (UID: \"5b9d2019-e8e4-4154-b620-901f93337eab\") "
Sep 09 21:59:21.453645 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453567    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:59:21.453645 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:59:21.453824 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453801    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:59:21.453824 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:59:21.454016 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.453769    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b9d2019-e8e4-4154-b620-901f93337eab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:59:21.455595 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.455570    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b9d2019-e8e4-4154-b620-901f93337eab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 21:59:21.455699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.455620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-kube-api-access-mtwj5" (OuterVolumeSpecName: "kube-api-access-mtwj5") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "kube-api-access-mtwj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:59:21.455699 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.455658    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:59:21.455857 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.455832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b9d2019-e8e4-4154-b620-901f93337eab" (UID: "5b9d2019-e8e4-4154-b620-901f93337eab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:59:21.554455 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.554455 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.554698 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e702a-7845-4f5f-8651-7fc119679dbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.554698 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7s2\" (UniqueName: \"kubernetes.io/projected/1f6e702a-7845-4f5f-8651-7fc119679dbf-kube-api-access-tc7s2\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.554774 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554763    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.554808 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554777    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.554808 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554785    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9d2019-e8e4-4154-b620-901f93337eab-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.554968 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554947    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9d2019-e8e4-4154-b620-901f93337eab-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.555025 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.554972    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.555025 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.555010    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.555121 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.555025    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.555121 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.555040    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtwj5\" (UniqueName: \"kubernetes.io/projected/5b9d2019-e8e4-4154-b620-901f93337eab-kube-api-access-mtwj5\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.555121 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.555053    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9d2019-e8e4-4154-b620-901f93337eab-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 21:59:21.656105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.656007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7s2\" (UniqueName: \"kubernetes.io/projected/1f6e702a-7845-4f5f-8651-7fc119679dbf-kube-api-access-tc7s2\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.656105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.656096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.656337 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.656124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.656337 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.656180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e702a-7845-4f5f-8651-7fc119679dbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.656857 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.656824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e702a-7845-4f5f-8651-7fc119679dbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.658776 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.658757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.658845 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.658828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.670105 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.670086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7s2\" (UniqueName: \"kubernetes.io/projected/1f6e702a-7845-4f5f-8651-7fc119679dbf-kube-api-access-tc7s2\") pod \"maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:21.711165 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:21.711130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:22.059485 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.059438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"]
Sep 09 21:59:22.060122 ip-10-0-137-189 kubenswrapper[2560]: W0909 21:59:22.060093    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6e702a_7845_4f5f_8651_7fc119679dbf.slice/crio-5bbd5dcdeb317482e366577468da34d114661c6b268dae63f8ec469c6808e787 WatchSource:0}: Error finding container 5bbd5dcdeb317482e366577468da34d114661c6b268dae63f8ec469c6808e787: Status 404 returned error can't find the container with id 5bbd5dcdeb317482e366577468da34d114661c6b268dae63f8ec469c6808e787
Sep 09 21:59:22.081848 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.081813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm" event={"ID":"1f6e702a-7845-4f5f-8651-7fc119679dbf","Type":"ContainerStarted","Data":"5bbd5dcdeb317482e366577468da34d114661c6b268dae63f8ec469c6808e787"}
Sep 09 21:59:22.083510 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.083481    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b9d2019-e8e4-4154-b620-901f93337eab" containerID="9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d" exitCode=0
Sep 09 21:59:22.083632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.083538    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"
Sep 09 21:59:22.083632 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.083575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" event={"ID":"5b9d2019-e8e4-4154-b620-901f93337eab","Type":"ContainerDied","Data":"9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d"}
Sep 09 21:59:22.083756 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.083637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x" event={"ID":"5b9d2019-e8e4-4154-b620-901f93337eab","Type":"ContainerDied","Data":"9cf631978619636e15f1a5fae525b79f880e32f022ad4187ca79cbab70454a87"}
Sep 09 21:59:22.083756 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.083671    2560 scope.go:117] "RemoveContainer" containerID="9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d"
Sep 09 21:59:22.092731 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.092703    2560 scope.go:117] "RemoveContainer" containerID="24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"
Sep 09 21:59:22.100890 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.100872    2560 scope.go:117] "RemoveContainer" containerID="9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d"
Sep 09 21:59:22.101178 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:59:22.101158    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d\": container with ID starting with 9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d not found: ID does not exist" containerID="9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d"
Sep 09 21:59:22.101258 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.101190    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d"} err="failed to get container status \"9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d\": rpc error: code = NotFound desc = could not find container \"9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d\": container with ID starting with 9115fedd92f9aa35d7292a7a50c2f20cef02b5ea5f7a72bcf9a9d5ca03e36a7d not found: ID does not exist"
Sep 09 21:59:22.101258 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.101213    2560 scope.go:117] "RemoveContainer" containerID="24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"
Sep 09 21:59:22.101520 ip-10-0-137-189 kubenswrapper[2560]: E0909 21:59:22.101498    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c\": container with ID starting with 24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c not found: ID does not exist" containerID="24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"
Sep 09 21:59:22.101567 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.101527    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c"} err="failed to get container status \"24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c\": rpc error: code = NotFound desc = could not find container \"24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c\": container with ID starting with 24091fecb3af8e1df57a7826657dc338ac38d8059f5835df462dedf4518b209c not found: ID does not exist"
Sep 09 21:59:22.121172 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.121125    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"]
Sep 09 21:59:22.138985 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:22.138952    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ebe9b0-openshift-default-66dddd7bbb-nl48x"]
Sep 09 21:59:23.090124 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:23.090090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm" event={"ID":"1f6e702a-7845-4f5f-8651-7fc119679dbf","Type":"ContainerStarted","Data":"30fb90d0f12225f4de64247d06c727d7f9518468fc16d7bc33ea3ac092c467b8"}
Sep 09 21:59:23.090647 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:23.090207    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:23.117011 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:23.116961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm" podStartSLOduration=1.731793244 podStartE2EDuration="2.116945984s" totalImagesPullingTime="385.15274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:59:23.116078006 +0000 UTC m=+1237.670737757" watchObservedRunningTime="2026-09-09 21:59:23.116945984 +0000 UTC m=+1237.671605723"
Sep 09 21:59:23.916971 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:23.916923    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" path="/var/lib/kubelet/pods/5b9d2019-e8e4-4154-b620-901f93337eab/volumes"
Sep 09 21:59:26.080192 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:26.080158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 21:59:29.101906 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:29.101874    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 21:59:30.281730 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:30.281694    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 21:59:56.053365 ip-10-0-137-189 kubenswrapper[2560]: I0909 21:59:56.053328    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:00:00.164986 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.164943    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"]
Sep 09 22:00:00.165378 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.165338    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9d2019-e8e4-4154-b620-901f93337eab" containerName="istio-proxy"
Sep 09 22:00:00.169728 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.169699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"
Sep 09 22:00:00.173294 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.173271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nqcf2\""
Sep 09 22:00:00.180061 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.180035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"
Sep 09 22:00:00.193025 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.192989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"]
Sep 09 22:00:00.459885 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.459797    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"]
Sep 09 22:00:00.463760 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:00:00.463729    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2b3861_fc1d_441f_b498_96161b4aebd2.slice/crio-c237838916e47458965c6f8d34be532380737a554f0da09816f2a9fd8d915b94 WatchSource:0}: Error finding container c237838916e47458965c6f8d34be532380737a554f0da09816f2a9fd8d915b94: Status 404 returned error can't find the container with id c237838916e47458965c6f8d34be532380737a554f0da09816f2a9fd8d915b94
Sep 09 22:00:00.564476 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.564422    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"]
Sep 09 22:00:00.564710 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.564664    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc" podUID="21dce9d9-e2c6-478d-9f72-2f8a63bed174" containerName="maas-api" containerID="cri-o://6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02" gracePeriod=30
Sep 09 22:00:00.589580 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.589449    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"]
Sep 09 22:00:00.809571 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.809546    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 22:00:00.891220 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.891175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21dce9d9-e2c6-478d-9f72-2f8a63bed174-openshift-service-ca\") pod \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") "
Sep 09 22:00:00.891220 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.891227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-maas-api-tls\") pod \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") "
Sep 09 22:00:00.891453 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.891328    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx4tc\" (UniqueName: \"kubernetes.io/projected/21dce9d9-e2c6-478d-9f72-2f8a63bed174-kube-api-access-kx4tc\") pod \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") "
Sep 09 22:00:00.891453 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.891364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-metrics-certs\") pod \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\" (UID: \"21dce9d9-e2c6-478d-9f72-2f8a63bed174\") "
Sep 09 22:00:00.891636 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.891602    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21dce9d9-e2c6-478d-9f72-2f8a63bed174-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21dce9d9-e2c6-478d-9f72-2f8a63bed174" (UID: "21dce9d9-e2c6-478d-9f72-2f8a63bed174"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:00:00.893668 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.893642    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21dce9d9-e2c6-478d-9f72-2f8a63bed174" (UID: "21dce9d9-e2c6-478d-9f72-2f8a63bed174"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:00:00.893668 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.893648    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21dce9d9-e2c6-478d-9f72-2f8a63bed174-kube-api-access-kx4tc" (OuterVolumeSpecName: "kube-api-access-kx4tc") pod "21dce9d9-e2c6-478d-9f72-2f8a63bed174" (UID: "21dce9d9-e2c6-478d-9f72-2f8a63bed174"). InnerVolumeSpecName "kube-api-access-kx4tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:00:00.893876 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.893860    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "21dce9d9-e2c6-478d-9f72-2f8a63bed174" (UID: "21dce9d9-e2c6-478d-9f72-2f8a63bed174"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:00:00.992609 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.992502    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21dce9d9-e2c6-478d-9f72-2f8a63bed174-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:00:00.992609 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.992542    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:00:00.992609 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.992555    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx4tc\" (UniqueName: \"kubernetes.io/projected/21dce9d9-e2c6-478d-9f72-2f8a63bed174-kube-api-access-kx4tc\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:00:00.992609 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:00.992567    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21dce9d9-e2c6-478d-9f72-2f8a63bed174-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:00:01.274955 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.274854    2560 generic.go:356] "Generic (PLEG): container finished" podID="21dce9d9-e2c6-478d-9f72-2f8a63bed174" containerID="6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02" exitCode=0
Sep 09 22:00:01.274955 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.274913    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"
Sep 09 22:00:01.274955 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.274939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc" event={"ID":"21dce9d9-e2c6-478d-9f72-2f8a63bed174","Type":"ContainerDied","Data":"6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02"}
Sep 09 22:00:01.275581 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.274994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc" event={"ID":"21dce9d9-e2c6-478d-9f72-2f8a63bed174","Type":"ContainerDied","Data":"57054afdb6a80a99c6201718c5d087c689a8ab34c89246d1dbce535b5bca86c8"}
Sep 09 22:00:01.275581 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.275018    2560 scope.go:117] "RemoveContainer" containerID="6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02"
Sep 09 22:00:01.277072 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.277044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n" event={"ID":"0f2b3861-fc1d-441f-b498-96161b4aebd2","Type":"ContainerStarted","Data":"41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8"}
Sep 09 22:00:01.277177 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.277099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n" event={"ID":"0f2b3861-fc1d-441f-b498-96161b4aebd2","Type":"ContainerStarted","Data":"c237838916e47458965c6f8d34be532380737a554f0da09816f2a9fd8d915b94"}
Sep 09 22:00:01.277177 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.277159    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n" podUID="0f2b3861-fc1d-441f-b498-96161b4aebd2" containerName="cleanup" containerID="cri-o://41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8" gracePeriod=30
Sep 09 22:00:01.284559 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.284534    2560 scope.go:117] "RemoveContainer" containerID="6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02"
Sep 09 22:00:01.284865 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:00:01.284845    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02\": container with ID starting with 6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02 not found: ID does not exist" containerID="6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02"
Sep 09 22:00:01.284938 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.284879    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02"} err="failed to get container status \"6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02\": rpc error: code = NotFound desc = could not find container \"6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02\": container with ID starting with 6ba449b66ef63a3757c67d5d4f61b6cbdbde62764ae086f9f7d6f7b5012ccf02 not found: ID does not exist"
Sep 09 22:00:01.297979 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.297918    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n" podStartSLOduration=1.297898136 podStartE2EDuration="1.297898136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:00:01.296678746 +0000 UTC m=+1275.851338491" watchObservedRunningTime="2026-09-09 22:00:01.297898136 +0000 UTC m=+1275.852557875"
Sep 09 22:00:01.316267 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.316240    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"]
Sep 09 22:00:01.321403 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.321373    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df8f95ff-765b5b6b8-mnwmc"]
Sep 09 22:00:01.523062 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.523034    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"
Sep 09 22:00:01.915982 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:01.915941    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21dce9d9-e2c6-478d-9f72-2f8a63bed174" path="/var/lib/kubelet/pods/21dce9d9-e2c6-478d-9f72-2f8a63bed174/volumes"
Sep 09 22:00:02.287155 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.287045    2560 generic.go:356] "Generic (PLEG): container finished" podID="0f2b3861-fc1d-441f-b498-96161b4aebd2" containerID="41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8" exitCode=6
Sep 09 22:00:02.287155 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.287099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"
Sep 09 22:00:02.287155 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.287128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n" event={"ID":"0f2b3861-fc1d-441f-b498-96161b4aebd2","Type":"ContainerDied","Data":"41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8"}
Sep 09 22:00:02.287781 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.287220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n" event={"ID":"0f2b3861-fc1d-441f-b498-96161b4aebd2","Type":"ContainerDied","Data":"c237838916e47458965c6f8d34be532380737a554f0da09816f2a9fd8d915b94"}
Sep 09 22:00:02.287781 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.287256    2560 scope.go:117] "RemoveContainer" containerID="41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8"
Sep 09 22:00:02.296530 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.296487    2560 scope.go:117] "RemoveContainer" containerID="41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8"
Sep 09 22:00:02.296994 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:00:02.296965    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8\": container with ID starting with 41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8 not found: ID does not exist" containerID="41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8"
Sep 09 22:00:02.297103 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.297006    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8"} err="failed to get container status \"41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8\": rpc error: code = NotFound desc = could not find container \"41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8\": container with ID starting with 41de19e03062e6d05d709f0d9a6e4d650f32616c9ac06e9e667a0c5855d9a6f8 not found: ID does not exist"
Sep 09 22:00:02.303156 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.303128    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"]
Sep 09 22:00:02.307869 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:02.307843    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df8f95ff-29816520-m9m6n"]
Sep 09 22:00:03.916073 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:03.916038    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f2b3861-fc1d-441f-b498-96161b4aebd2" path="/var/lib/kubelet/pods/0f2b3861-fc1d-441f-b498-96161b4aebd2/volumes"
Sep 09 22:00:10.475231 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:10.475134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:00:21.400820 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.400786    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"]
Sep 09 22:00:21.401342 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.401112    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21dce9d9-e2c6-478d-9f72-2f8a63bed174" containerName="maas-api"
Sep 09 22:00:21.401342 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.401123    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21dce9d9-e2c6-478d-9f72-2f8a63bed174" containerName="maas-api"
Sep 09 22:00:21.401342 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.401130    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f2b3861-fc1d-441f-b498-96161b4aebd2" containerName="cleanup"
Sep 09 22:00:21.401342 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.401137    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f2b3861-fc1d-441f-b498-96161b4aebd2" containerName="cleanup"
Sep 09 22:00:21.401342 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.401224    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21dce9d9-e2c6-478d-9f72-2f8a63bed174" containerName="maas-api"
Sep 09 22:00:21.401342 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.401237    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f2b3861-fc1d-441f-b498-96161b4aebd2" containerName="cleanup"
Sep 09 22:00:21.404365 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.404345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.406916 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.406894    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-f6cce2-openshift-default-dockercfg-6krqq\""
Sep 09 22:00:21.418985 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.418957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"]
Sep 09 22:00:21.464939 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.464890    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:00:21.478238 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istiod-ca-cert\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478423 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-socket\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478423 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-certs\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478423 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-data\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478423 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-podinfo\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478423 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwcpr\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-kube-api-access-kwcpr\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478713 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-envoy\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478713 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-credential-socket\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.478713 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.478647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-token\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579332 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-token\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579332 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istiod-ca-cert\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-socket\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-certs\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-data\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-podinfo\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwcpr\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-kube-api-access-kwcpr\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-envoy\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.579631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.579593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-credential-socket\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.580229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-certs\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.580383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-socket\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.580419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-credential-socket\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.580494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-data\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.580670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istiod-ca-cert\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.582949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-envoy\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.583505 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.583279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-podinfo\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.588730 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.588692    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-token\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.589610 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.589589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwcpr\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-kube-api-access-kwcpr\") pod \"e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") " pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.714840 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.714746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:21.993803 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.993624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"]
Sep 09 22:00:21.997208 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:00:21.997174    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad6ff91_2f94_4bcd_8ab5_65d74d91f91b.slice/crio-4071c20c23f13a930a7ff5531c761bc5a24185cdafab6863eb17760f77c39b68 WatchSource:0}: Error finding container 4071c20c23f13a930a7ff5531c761bc5a24185cdafab6863eb17760f77c39b68: Status 404 returned error can't find the container with id 4071c20c23f13a930a7ff5531c761bc5a24185cdafab6863eb17760f77c39b68
Sep 09 22:00:21.999720 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.999677    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:21.999820 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.999797    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:21.999868 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:21.999838    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:22.385161 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:22.385117    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" event={"ID":"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b","Type":"ContainerStarted","Data":"f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"}
Sep 09 22:00:22.385388 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:22.385176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" event={"ID":"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b","Type":"ContainerStarted","Data":"4071c20c23f13a930a7ff5531c761bc5a24185cdafab6863eb17760f77c39b68"}
Sep 09 22:00:22.430336 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:22.430264    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podStartSLOduration=1.430239359 podStartE2EDuration="1.430239359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:00:22.429060127 +0000 UTC m=+1296.983719867" watchObservedRunningTime="2026-09-09 22:00:22.430239359 +0000 UTC m=+1296.984899100"
Sep 09 22:00:22.715126 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:22.715022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:23.721600 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:23.721564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:24.396562 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:24.396531    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:24.397692 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:24.397665    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:25.549129 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.549091    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"]
Sep 09 22:00:25.552604 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.552580    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.554686 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.554659    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-f6cce2-serving-cert\""
Sep 09 22:00:25.565615 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.565590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"]
Sep 09 22:00:25.617627 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.617594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.617627 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.617630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.617839 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.617657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8fcv\" (UniqueName: \"kubernetes.io/projected/de27a28e-3b1b-473c-8345-3dee54ee9203-kube-api-access-x8fcv\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.617839 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.617729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de27a28e-3b1b-473c-8345-3dee54ee9203-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.719120 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.719085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.719120 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.719122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.719373 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.719148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8fcv\" (UniqueName: \"kubernetes.io/projected/de27a28e-3b1b-473c-8345-3dee54ee9203-kube-api-access-x8fcv\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.719373 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.719168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de27a28e-3b1b-473c-8345-3dee54ee9203-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.719851 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.719827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de27a28e-3b1b-473c-8345-3dee54ee9203-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.721956 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.721927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.722059 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.721966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.727415 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.727391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8fcv\" (UniqueName: \"kubernetes.io/projected/de27a28e-3b1b-473c-8345-3dee54ee9203-kube-api-access-x8fcv\") pod \"maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:25.863450 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:25.863408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:26.140423 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:26.140397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"]
Sep 09 22:00:26.142714 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:00:26.142684    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde27a28e_3b1b_473c_8345_3dee54ee9203.slice/crio-be3085b85c188ccca484ca3d007f0390d64847ad98437a15a262a035dcde0078 WatchSource:0}: Error finding container be3085b85c188ccca484ca3d007f0390d64847ad98437a15a262a035dcde0078: Status 404 returned error can't find the container with id be3085b85c188ccca484ca3d007f0390d64847ad98437a15a262a035dcde0078
Sep 09 22:00:26.406942 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:26.406839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9" event={"ID":"de27a28e-3b1b-473c-8345-3dee54ee9203","Type":"ContainerStarted","Data":"be3085b85c188ccca484ca3d007f0390d64847ad98437a15a262a035dcde0078"}
Sep 09 22:00:27.413874 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:27.413834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9" event={"ID":"de27a28e-3b1b-473c-8345-3dee54ee9203","Type":"ContainerStarted","Data":"e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f"}
Sep 09 22:00:27.414336 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:27.414068    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:27.432197 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:27.432148    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9" podStartSLOduration=2.022961126 podStartE2EDuration="2.432131431s" totalImagesPullingTime="409.170305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:00:27.431024158 +0000 UTC m=+1301.985683898" watchObservedRunningTime="2026-09-09 22:00:27.432131431 +0000 UTC m=+1301.986791170"
Sep 09 22:00:30.661044 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:30.660997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:00:33.424134 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:33.424104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:00:40.437674 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:40.437635    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 22:00:40.438181 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:40.437751    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 22:00:41.483590 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:41.483556    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerID="f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84" exitCode=0
Sep 09 22:00:41.484075 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:41.483631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" event={"ID":"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b","Type":"ContainerDied","Data":"f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"}
Sep 09 22:00:41.484075 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:41.484025    2560 scope.go:117] "RemoveContainer" containerID="f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"
Sep 09 22:00:41.485095 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:41.485066    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:41.485187 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:41.485136    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:41.485187 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:41.485170    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:42.491661 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:42.491583    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" event={"ID":"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b","Type":"ContainerStarted","Data":"23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c"}
Sep 09 22:00:42.715679 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:42.715641    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:42.716055 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:42.715962    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 22:00:42.716228 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:42.716206    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 22:00:43.715373 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:43.715333    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 22:00:43.715788 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:43.715396    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 22:00:44.715559 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:44.715520    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 22:00:44.716008 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:44.715583    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 22:00:45.716053 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:45.716005    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 22:00:45.716493 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:45.716090    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 22:00:46.716044 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:46.716002    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 09 22:00:46.716272 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:46.716081    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 09 22:00:47.769610 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:47.769576    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:47.770024 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:47.769895    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:47.772024 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:47.772002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:00:49.352231 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:49.352186    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:00:49.961759 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:49.961726    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"]
Sep 09 22:00:49.965014 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:49.964987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:49.967085 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:49.967063    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-e5cb43-openshift-default-dockercfg-4f9vq\""
Sep 09 22:00:49.977917 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:49.977890    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"]
Sep 09 22:00:50.060046 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-credential-socket\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060251 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-envoy\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060251 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-socket\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060251 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-certs\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060251 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-data\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-token\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4098da8c-4a3e-4175-8bb4-f3989803ef59-istiod-ca-cert\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6qb9\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-kube-api-access-r6qb9\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.060496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.060334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-podinfo\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161422 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-certs\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161628 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-data\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161628 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-token\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161628 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4098da8c-4a3e-4175-8bb4-f3989803ef59-istiod-ca-cert\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161628 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6qb9\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-kube-api-access-r6qb9\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161628 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-podinfo\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161871 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-credential-socket\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161871 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-envoy\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.161871 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-socket\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.162031 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.161913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-data\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.162190 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.162155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-credential-socket\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.162190 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.162181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-certs\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.162575 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.162211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-socket\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.162575 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.162257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4098da8c-4a3e-4175-8bb4-f3989803ef59-istiod-ca-cert\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.164188 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.164162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-envoy\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.164273 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.164236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-podinfo\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.169311 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.169288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6qb9\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-kube-api-access-r6qb9\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.169398 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.169308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-token\") pod \"e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") " pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.275683 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.275591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:50.558704 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.558675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"]
Sep 09 22:00:50.561187 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:00:50.561157    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4098da8c_4a3e_4175_8bb4_f3989803ef59.slice/crio-7678ecee0c3f6f819c3c39356ac6d33be7247d2feb3f9942ac8ded0c41a8e564 WatchSource:0}: Error finding container 7678ecee0c3f6f819c3c39356ac6d33be7247d2feb3f9942ac8ded0c41a8e564: Status 404 returned error can't find the container with id 7678ecee0c3f6f819c3c39356ac6d33be7247d2feb3f9942ac8ded0c41a8e564
Sep 09 22:00:50.563534 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.563501    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:50.563600 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.563573    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:50.563646 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:50.563601    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:00:51.550363 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:51.550318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" event={"ID":"4098da8c-4a3e-4175-8bb4-f3989803ef59","Type":"ContainerStarted","Data":"0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"}
Sep 09 22:00:51.550620 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:51.550391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" event={"ID":"4098da8c-4a3e-4175-8bb4-f3989803ef59","Type":"ContainerStarted","Data":"7678ecee0c3f6f819c3c39356ac6d33be7247d2feb3f9942ac8ded0c41a8e564"}
Sep 09 22:00:51.571112 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:51.571059    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podStartSLOduration=2.571041228 podStartE2EDuration="2.571041228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:00:51.569439859 +0000 UTC m=+1326.124099624" watchObservedRunningTime="2026-09-09 22:00:51.571041228 +0000 UTC m=+1326.125700968"
Sep 09 22:00:52.276063 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:52.276019    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:52.281507 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:52.281477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:52.555689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:52.555599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:52.556784 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:52.556758    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:00:54.592781 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.592746    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"]
Sep 09 22:00:54.595261 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.595239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.597286 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.597261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-e5cb43-serving-cert\""
Sep 09 22:00:54.607753 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.607731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"]
Sep 09 22:00:54.703061 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.703020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.703428 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.703397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.703562 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.703499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.703628 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.703563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88rb4\" (UniqueName: \"kubernetes.io/projected/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-kube-api-access-88rb4\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.804283 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.804246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.804512 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.804295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.804512 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.804319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.804512 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.804350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88rb4\" (UniqueName: \"kubernetes.io/projected/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-kube-api-access-88rb4\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.804959 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.804924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.806878 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.806847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.806996 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.806976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.811913 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.811890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88rb4\" (UniqueName: \"kubernetes.io/projected/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-kube-api-access-88rb4\") pod \"maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:54.907625 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:54.907528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:55.179265 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:55.179234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"]
Sep 09 22:00:55.182090 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:00:55.182061    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761816e6_4a58_4c5d_bf1c_1fbcbe89b72e.slice/crio-96caa0d59fd78076f45340f62a379d8060d8dfffb073617a131f950024cebb8f WatchSource:0}: Error finding container 96caa0d59fd78076f45340f62a379d8060d8dfffb073617a131f950024cebb8f: Status 404 returned error can't find the container with id 96caa0d59fd78076f45340f62a379d8060d8dfffb073617a131f950024cebb8f
Sep 09 22:00:55.570539 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:55.570501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9" event={"ID":"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e","Type":"ContainerStarted","Data":"96caa0d59fd78076f45340f62a379d8060d8dfffb073617a131f950024cebb8f"}
Sep 09 22:00:56.580237 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:56.580198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9" event={"ID":"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e","Type":"ContainerStarted","Data":"678b6ed1ed217f4f108f657098110b5829bbde70a918a37d564b9994fdf7cb50"}
Sep 09 22:00:56.580665 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:56.580293    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:00:56.597879 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:00:56.597828    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9" podStartSLOduration=2.041580039 podStartE2EDuration="2.597810145s" totalImagesPullingTime="556.230106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:00:56.597544772 +0000 UTC m=+1331.152204508" watchObservedRunningTime="2026-09-09 22:00:56.597810145 +0000 UTC m=+1331.152469938"
Sep 09 22:01:00.355013 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:00.354967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:01:02.597733 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:02.596763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:01:08.597681 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:08.597634    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 22:01:08.598149 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:08.597718    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 22:01:10.655934 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:10.655899    2560 generic.go:356] "Generic (PLEG): container finished" podID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerID="0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b" exitCode=0
Sep 09 22:01:10.656421 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:10.655981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" event={"ID":"4098da8c-4a3e-4175-8bb4-f3989803ef59","Type":"ContainerDied","Data":"0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"}
Sep 09 22:01:10.656421 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:10.656407    2560 scope.go:117] "RemoveContainer" containerID="0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"
Sep 09 22:01:10.657532 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:10.657502    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:01:10.657643 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:10.657589    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:01:10.657708 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:10.657639    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:01:11.663100 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:11.663066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" event={"ID":"4098da8c-4a3e-4175-8bb4-f3989803ef59","Type":"ContainerStarted","Data":"9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6"}
Sep 09 22:01:12.276038 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:12.275999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:01:12.276331 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:12.276215    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 09 22:01:12.276484 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:12.276366    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 09 22:01:13.276403 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:13.276357    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 09 22:01:13.276829 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:13.276421    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 09 22:01:14.275844 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:14.275808    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 09 22:01:14.276017 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:14.275862    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 09 22:01:15.276564 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:15.276527    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 09 22:01:15.276987 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:15.276603    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 09 22:01:16.276098 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:16.276059    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 09 22:01:16.276272 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:16.276131    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 09 22:01:17.280241 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:17.280208    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:01:17.280742 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:17.280617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:01:17.281226 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:17.281205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:01:25.655227 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:25.655188    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:01:38.846868 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:38.846828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:01:56.045880 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:01:56.045839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:02:12.650761 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:02:12.650719    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:02:25.568300 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:02:25.568259    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:02:44.945347 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:02:44.945265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:03:04.373804 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:03:04.373755    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:03:21.955393 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:03:21.955354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:03:35.654567 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:03:35.654523    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:04:23.841087 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:04:23.841050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:04:40.963417 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:04:40.963380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:04:46.001016 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:04:46.000986    2560 scope.go:117] "RemoveContainer" containerID="8eacf03cc9fd7cc20f80748e2542bd9640e835bab329d0a1433eb67a9655092b"
Sep 09 22:04:46.009876 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:04:46.009849    2560 scope.go:117] "RemoveContainer" containerID="bebaf6c8d25ba725ca3bc6ead5ec28643df0f561156295df7fa8fb7f85521e08"
Sep 09 22:04:55.248737 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:04:55.248701    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:05:11.861255 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:11.861215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:05:22.453401 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:22.453360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:05:36.963985 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:36.963883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:05:41.843373 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.843339    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"]
Sep 09 22:05:41.846897 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.846877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.849241 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.849218    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4f06aa-openshift-default-dockercfg-4pghz\""
Sep 09 22:05:41.861518 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.861490    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"]
Sep 09 22:05:41.984192 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-podinfo\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-certs\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8167918f-1c9a-45ca-8540-38e97fe35eb9-istiod-ca-cert\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-credential-socket\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-socket\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-token\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-envoy\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984451 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7nt6\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-kube-api-access-t7nt6\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:41.984782 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:41.984493    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-data\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085173 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-certs\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085173 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8167918f-1c9a-45ca-8540-38e97fe35eb9-istiod-ca-cert\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-credential-socket\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-socket\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-token\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-envoy\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7nt6\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-kube-api-access-t7nt6\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085862 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-data\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085862 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-certs\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085862 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-podinfo\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.085862 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-credential-socket\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.086016 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.085860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-socket\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.086062 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.086042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-data\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.086099 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.086045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8167918f-1c9a-45ca-8540-38e97fe35eb9-istiod-ca-cert\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.088075 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.088055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-envoy\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.088327 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.088312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-podinfo\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.093327 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.093304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-token\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.093887 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.093833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7nt6\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-kube-api-access-t7nt6\") pod \"e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") " pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.156675 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.156639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:42.442237 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.442209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"]
Sep 09 22:05:42.443967 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:05:42.443940    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8167918f_1c9a_45ca_8540_38e97fe35eb9.slice/crio-555bc653cef7dcb84d82820d42e181a87bd793530136083ec5b8a56fdf889ded WatchSource:0}: Error finding container 555bc653cef7dcb84d82820d42e181a87bd793530136083ec5b8a56fdf889ded: Status 404 returned error can't find the container with id 555bc653cef7dcb84d82820d42e181a87bd793530136083ec5b8a56fdf889ded
Sep 09 22:05:42.446372 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.446340    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:05:42.446445 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.446407    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:05:42.446445 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.446433    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:05:42.977915 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.977876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" event={"ID":"8167918f-1c9a-45ca-8540-38e97fe35eb9","Type":"ContainerStarted","Data":"0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"}
Sep 09 22:05:42.978344 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:42.977933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" event={"ID":"8167918f-1c9a-45ca-8540-38e97fe35eb9","Type":"ContainerStarted","Data":"555bc653cef7dcb84d82820d42e181a87bd793530136083ec5b8a56fdf889ded"}
Sep 09 22:05:43.157025 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:43.156990    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:43.163304 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:43.163277    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:43.182953 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:43.182904    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podStartSLOduration=2.182887409 podStartE2EDuration="2.182887409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:05:43.003399413 +0000 UTC m=+1617.558059153" watchObservedRunningTime="2026-09-09 22:05:43.182887409 +0000 UTC m=+1617.737547149"
Sep 09 22:05:43.983038 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:43.983006    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:43.984025 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:43.984006    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:05:51.096204 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:05:51.096158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:06:00.023656 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:00.023607    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 22:06:00.024103 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:00.023694    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 22:06:02.071352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:02.071317    2560 generic.go:356] "Generic (PLEG): container finished" podID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerID="0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e" exitCode=0
Sep 09 22:06:02.071800 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:02.071399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" event={"ID":"8167918f-1c9a-45ca-8540-38e97fe35eb9","Type":"ContainerDied","Data":"0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"}
Sep 09 22:06:02.071878 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:02.071851    2560 scope.go:117] "RemoveContainer" containerID="0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"
Sep 09 22:06:02.073099 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:02.073073    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:06:02.073158 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:02.073141    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:06:02.073194 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:02.073174    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:06:03.078745 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:03.078706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" event={"ID":"8167918f-1c9a-45ca-8540-38e97fe35eb9","Type":"ContainerStarted","Data":"c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7"}
Sep 09 22:06:03.157566 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:03.157525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:06:03.157815 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:03.157787    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 22:06:03.157888 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:03.157835    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 22:06:04.157632 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:04.157598    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 22:06:04.158033 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:04.157656    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 22:06:05.157547 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:05.157508    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 22:06:05.157751 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:05.157572    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 22:06:06.157459 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:06.157411    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 22:06:06.157687 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:06.157512    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 22:06:07.157210 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:07.157167    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 22:06:07.157637 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:07.157264    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 22:06:08.158019 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:08.157975    2560 patch_prober.go:28] interesting pod/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 09 22:06:08.158420 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:08.158040    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 09 22:06:09.161389 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:09.161358    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:06:09.161797 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:09.161764    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:06:09.162438 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:09.162420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:06:11.149323 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:11.149289    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:06:32.350949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:32.350910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:06:52.554795 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:52.554752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:06:57.898322 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:57.898272    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"]
Sep 09 22:06:57.898837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:06:57.898609    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy" containerID="cri-o://c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7" gracePeriod=30
Sep 09 22:07:03.160051 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.159981    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:07:03.249895 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.249854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-socket\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.249895 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.249900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-token\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250165 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.249922    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-envoy\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250165 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.249968    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-podinfo\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250165 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.249989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7nt6\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-kube-api-access-t7nt6\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250165 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250021    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-credential-socket\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250165 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-data\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250165 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250138    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8167918f-1c9a-45ca-8540-38e97fe35eb9-istiod-ca-cert\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-certs\") pod \"8167918f-1c9a-45ca-8540-38e97fe35eb9\" (UID: \"8167918f-1c9a-45ca-8540-38e97fe35eb9\") "
Sep 09 22:07:03.250496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250300    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:03.250617 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250535    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:03.250617 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250544    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-data" (OuterVolumeSpecName: "istio-data") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:03.250617 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250558    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.250617 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250569    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:03.250978 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.250865    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8167918f-1c9a-45ca-8540-38e97fe35eb9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:07:03.252337 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.252308    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-token" (OuterVolumeSpecName: "istio-token") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:03.252442 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.252392    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 22:07:03.252751 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.252715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:03.252837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.252723    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-kube-api-access-t7nt6" (OuterVolumeSpecName: "kube-api-access-t7nt6") pod "8167918f-1c9a-45ca-8540-38e97fe35eb9" (UID: "8167918f-1c9a-45ca-8540-38e97fe35eb9"). InnerVolumeSpecName "kube-api-access-t7nt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:03.351912 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351874    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8167918f-1c9a-45ca-8540-38e97fe35eb9-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.351912 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351906    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.351912 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351917    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.352157 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351926    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.352157 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351933    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.352157 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351941    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7nt6\" (UniqueName: \"kubernetes.io/projected/8167918f-1c9a-45ca-8540-38e97fe35eb9-kube-api-access-t7nt6\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.352157 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351950    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.352157 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.351958    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8167918f-1c9a-45ca-8540-38e97fe35eb9-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:03.385041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.384998    2560 generic.go:356] "Generic (PLEG): container finished" podID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerID="c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7" exitCode=0
Sep 09 22:07:03.385211 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.385051    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"
Sep 09 22:07:03.385211 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.385097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" event={"ID":"8167918f-1c9a-45ca-8540-38e97fe35eb9","Type":"ContainerDied","Data":"c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7"}
Sep 09 22:07:03.385211 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.385150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh" event={"ID":"8167918f-1c9a-45ca-8540-38e97fe35eb9","Type":"ContainerDied","Data":"555bc653cef7dcb84d82820d42e181a87bd793530136083ec5b8a56fdf889ded"}
Sep 09 22:07:03.385211 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.385173    2560 scope.go:117] "RemoveContainer" containerID="c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7"
Sep 09 22:07:03.395120 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.395102    2560 scope.go:117] "RemoveContainer" containerID="0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"
Sep 09 22:07:03.404300 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.404206    2560 scope.go:117] "RemoveContainer" containerID="c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7"
Sep 09 22:07:03.404696 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:03.404658    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7\": container with ID starting with c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7 not found: ID does not exist" containerID="c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7"
Sep 09 22:07:03.404799 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.404702    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7"} err="failed to get container status \"c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7\": rpc error: code = NotFound desc = could not find container \"c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7\": container with ID starting with c5860b6857e76dffed7dc121957489c028ce0e2dbd3538b12b41fdbf09694fb7 not found: ID does not exist"
Sep 09 22:07:03.404799 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.404723    2560 scope.go:117] "RemoveContainer" containerID="0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"
Sep 09 22:07:03.405119 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:03.405099    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e\": container with ID starting with 0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e not found: ID does not exist" containerID="0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"
Sep 09 22:07:03.405182 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.405126    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e"} err="failed to get container status \"0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e\": rpc error: code = NotFound desc = could not find container \"0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e\": container with ID starting with 0d5b4146f61f8c8ba17f701a8ebc2cf50bb78b0df0ee8b23f9339cc684acd34e not found: ID does not exist"
Sep 09 22:07:03.406634 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.406615    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"]
Sep 09 22:07:03.412445 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.412389    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4f06aa-openshift-default-77b8dbcb6-cfnvh"]
Sep 09 22:07:03.916956 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:03.916922    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" path="/var/lib/kubelet/pods/8167918f-1c9a-45ca-8540-38e97fe35eb9/volumes"
Sep 09 22:07:08.753634 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:08.753532    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:07:09.020937 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.020834    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"]
Sep 09 22:07:09.021171 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.021115    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9" podUID="de27a28e-3b1b-473c-8345-3dee54ee9203" containerName="maas-api" containerID="cri-o://e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f" gracePeriod=30
Sep 09 22:07:09.276136 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.276077    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:07:09.416522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.414789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-maas-api-tls\") pod \"de27a28e-3b1b-473c-8345-3dee54ee9203\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") "
Sep 09 22:07:09.416522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.414838    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8fcv\" (UniqueName: \"kubernetes.io/projected/de27a28e-3b1b-473c-8345-3dee54ee9203-kube-api-access-x8fcv\") pod \"de27a28e-3b1b-473c-8345-3dee54ee9203\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") "
Sep 09 22:07:09.416522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.414951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de27a28e-3b1b-473c-8345-3dee54ee9203-openshift-service-ca\") pod \"de27a28e-3b1b-473c-8345-3dee54ee9203\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") "
Sep 09 22:07:09.416522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.414987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-metrics-certs\") pod \"de27a28e-3b1b-473c-8345-3dee54ee9203\" (UID: \"de27a28e-3b1b-473c-8345-3dee54ee9203\") "
Sep 09 22:07:09.416522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.416015    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de27a28e-3b1b-473c-8345-3dee54ee9203-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de27a28e-3b1b-473c-8345-3dee54ee9203" (UID: "de27a28e-3b1b-473c-8345-3dee54ee9203"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:07:09.418427 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.418335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de27a28e-3b1b-473c-8345-3dee54ee9203-kube-api-access-x8fcv" (OuterVolumeSpecName: "kube-api-access-x8fcv") pod "de27a28e-3b1b-473c-8345-3dee54ee9203" (UID: "de27a28e-3b1b-473c-8345-3dee54ee9203"). InnerVolumeSpecName "kube-api-access-x8fcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:09.419452 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.418960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "de27a28e-3b1b-473c-8345-3dee54ee9203" (UID: "de27a28e-3b1b-473c-8345-3dee54ee9203"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:07:09.421935 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.421789    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de27a28e-3b1b-473c-8345-3dee54ee9203" (UID: "de27a28e-3b1b-473c-8345-3dee54ee9203"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:07:09.426793 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.424942    2560 generic.go:356] "Generic (PLEG): container finished" podID="de27a28e-3b1b-473c-8345-3dee54ee9203" containerID="e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f" exitCode=0
Sep 09 22:07:09.426793 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.425047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9" event={"ID":"de27a28e-3b1b-473c-8345-3dee54ee9203","Type":"ContainerDied","Data":"e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f"}
Sep 09 22:07:09.426793 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.425125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9" event={"ID":"de27a28e-3b1b-473c-8345-3dee54ee9203","Type":"ContainerDied","Data":"be3085b85c188ccca484ca3d007f0390d64847ad98437a15a262a035dcde0078"}
Sep 09 22:07:09.426793 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.425186    2560 scope.go:117] "RemoveContainer" containerID="e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f"
Sep 09 22:07:09.426793 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.425415    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"
Sep 09 22:07:09.437191 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.437135    2560 scope.go:117] "RemoveContainer" containerID="e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f"
Sep 09 22:07:09.437797 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:09.437680    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f\": container with ID starting with e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f not found: ID does not exist" containerID="e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f"
Sep 09 22:07:09.437797 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.437718    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f"} err="failed to get container status \"e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f\": rpc error: code = NotFound desc = could not find container \"e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f\": container with ID starting with e64e19e23ebd0f48b664ddff38dfa5366cc0d74b2a6ce1d1323548f9ff5e9d9f not found: ID does not exist"
Sep 09 22:07:09.451322 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.451285    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"]
Sep 09 22:07:09.454048 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.454024    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6cce2-6d5b48d84c-sfvj9"]
Sep 09 22:07:09.516060 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.516025    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de27a28e-3b1b-473c-8345-3dee54ee9203-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:09.516060 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.516052    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:09.516060 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.516065    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de27a28e-3b1b-473c-8345-3dee54ee9203-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:09.516302 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.516073    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8fcv\" (UniqueName: \"kubernetes.io/projected/de27a28e-3b1b-473c-8345-3dee54ee9203-kube-api-access-x8fcv\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:09.916215 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:09.916169    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de27a28e-3b1b-473c-8345-3dee54ee9203" path="/var/lib/kubelet/pods/de27a28e-3b1b-473c-8345-3dee54ee9203/volumes"
Sep 09 22:07:15.682053 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:15.682014    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"]
Sep 09 22:07:15.682523 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:15.682257    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" containerID="cri-o://23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c" gracePeriod=30
Sep 09 22:07:17.772865 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:17.772826    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 22:07:17.773260 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:17.772894    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 22:07:19.360761 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:19.360724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:07:20.923242 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:20.923203    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:07:21.016744 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016649    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-credential-socket\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.016744 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016703    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-certs\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.016744 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016742    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-podinfo\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwcpr\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-kube-api-access-kwcpr\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-token\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-socket\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016862    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-envoy\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istiod-ca-cert\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016925    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-data\") pod \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\" (UID: \"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b\") "
Sep 09 22:07:21.017041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.016970    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:21.017416 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.017078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:21.017416 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.017285    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.017416 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.017306    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.017416 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.017362    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:21.017416 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.017382    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:21.017416 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.017402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:07:21.019370 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.019336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:21.019370 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.019360    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 22:07:21.019558 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.019374    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-kube-api-access-kwcpr" (OuterVolumeSpecName: "kube-api-access-kwcpr") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "kube-api-access-kwcpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:21.019558 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.019409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" (UID: "3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:21.117927 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117888    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.117927 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117917    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwcpr\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-kube-api-access-kwcpr\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.117927 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117927    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.117927 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117937    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.118204 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117946    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.118204 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117954    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.118204 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.117961    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:21.485651 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.485610    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerID="23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c" exitCode=0
Sep 09 22:07:21.485833 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.485669    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"
Sep 09 22:07:21.485833 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.485696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" event={"ID":"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b","Type":"ContainerDied","Data":"23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c"}
Sep 09 22:07:21.485833 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.485781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq" event={"ID":"3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b","Type":"ContainerDied","Data":"4071c20c23f13a930a7ff5531c761bc5a24185cdafab6863eb17760f77c39b68"}
Sep 09 22:07:21.485833 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.485806    2560 scope.go:117] "RemoveContainer" containerID="23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c"
Sep 09 22:07:21.495052 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.495031    2560 scope.go:117] "RemoveContainer" containerID="f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"
Sep 09 22:07:21.503235 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.503171    2560 scope.go:117] "RemoveContainer" containerID="23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c"
Sep 09 22:07:21.503586 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:21.503557    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c\": container with ID starting with 23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c not found: ID does not exist" containerID="23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c"
Sep 09 22:07:21.503689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.503596    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c"} err="failed to get container status \"23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c\": rpc error: code = NotFound desc = could not find container \"23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c\": container with ID starting with 23245e24e97c90ef05c5666f36bb2a200cad04a2d25a492219650dc7f57ce40c not found: ID does not exist"
Sep 09 22:07:21.503689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.503616    2560 scope.go:117] "RemoveContainer" containerID="f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"
Sep 09 22:07:21.503906 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:21.503886    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84\": container with ID starting with f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84 not found: ID does not exist" containerID="f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"
Sep 09 22:07:21.503970 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.503912    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84"} err="failed to get container status \"f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84\": rpc error: code = NotFound desc = could not find container \"f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84\": container with ID starting with f7ed49add6787dbf8b457480b6a0a4e7b882f022c942460fb16de665f77d8c84 not found: ID does not exist"
Sep 09 22:07:21.509836 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.509683    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"]
Sep 09 22:07:21.511583 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.511561    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6cce2-openshift-default-748d447c68-fgplq"]
Sep 09 22:07:21.916637 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:21.916599    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" path="/var/lib/kubelet/pods/3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b/volumes"
Sep 09 22:07:26.293495 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.293440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"]
Sep 09 22:07:26.293969 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.293676    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9" podUID="761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" containerName="maas-api" containerID="cri-o://678b6ed1ed217f4f108f657098110b5829bbde70a918a37d564b9994fdf7cb50" gracePeriod=30
Sep 09 22:07:26.514277 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.514240    2560 generic.go:356] "Generic (PLEG): container finished" podID="761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" containerID="678b6ed1ed217f4f108f657098110b5829bbde70a918a37d564b9994fdf7cb50" exitCode=0
Sep 09 22:07:26.514459 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.514314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9" event={"ID":"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e","Type":"ContainerDied","Data":"678b6ed1ed217f4f108f657098110b5829bbde70a918a37d564b9994fdf7cb50"}
Sep 09 22:07:26.539762 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.539735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:07:26.562363 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.562331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88rb4\" (UniqueName: \"kubernetes.io/projected/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-kube-api-access-88rb4\") pod \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") "
Sep 09 22:07:26.562620 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.562448    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-openshift-service-ca\") pod \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") "
Sep 09 22:07:26.562620 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.562535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-metrics-certs\") pod \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") "
Sep 09 22:07:26.562620 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.562622    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-maas-api-tls\") pod \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\" (UID: \"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e\") "
Sep 09 22:07:26.567141 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.565859    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" (UID: "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:07:26.567141 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.566193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" (UID: "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:07:26.569135 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.568832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-kube-api-access-88rb4" (OuterVolumeSpecName: "kube-api-access-88rb4") pod "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" (UID: "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e"). InnerVolumeSpecName "kube-api-access-88rb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:26.569354 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.569328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" (UID: "761816e6-4a58-4c5d-bf1c-1fbcbe89b72e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:07:26.663949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.663912    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88rb4\" (UniqueName: \"kubernetes.io/projected/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-kube-api-access-88rb4\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:26.663949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.663942    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:26.663949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.663953    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:26.664183 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:26.663962    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:27.519705 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.519675    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"
Sep 09 22:07:27.520098 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.519675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9" event={"ID":"761816e6-4a58-4c5d-bf1c-1fbcbe89b72e","Type":"ContainerDied","Data":"96caa0d59fd78076f45340f62a379d8060d8dfffb073617a131f950024cebb8f"}
Sep 09 22:07:27.520098 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.519813    2560 scope.go:117] "RemoveContainer" containerID="678b6ed1ed217f4f108f657098110b5829bbde70a918a37d564b9994fdf7cb50"
Sep 09 22:07:27.546103 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.546062    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"]
Sep 09 22:07:27.548325 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.548298    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e5cb43-68b75d48df-p9sx9"]
Sep 09 22:07:27.834042 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834009    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"]
Sep 09 22:07:27.834395 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834380    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834397    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834411    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834416    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834428    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" containerName="maas-api"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834434    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" containerName="maas-api"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834446    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de27a28e-3b1b-473c-8345-3dee54ee9203" containerName="maas-api"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834451    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de27a28e-3b1b-473c-8345-3dee54ee9203" containerName="maas-api"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834460    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy"
Sep 09 22:07:27.834497 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834479    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy"
Sep 09 22:07:27.834975 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834531    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy"
Sep 09 22:07:27.834975 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834539    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" containerName="maas-api"
Sep 09 22:07:27.834975 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834545    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy"
Sep 09 22:07:27.834975 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834552    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy"
Sep 09 22:07:27.834975 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.834559    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de27a28e-3b1b-473c-8345-3dee54ee9203" containerName="maas-api"
Sep 09 22:07:27.838955 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.838935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.841360 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.841337    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-8fe6a1-openshift-default-dockercfg-pq2qd\""
Sep 09 22:07:27.851560 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.851520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"]
Sep 09 22:07:27.873607 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-podinfo\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873763 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-data\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873763 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-envoy\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873763 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-credential-socket\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873763 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfws9\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-kube-api-access-lfws9\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873899 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istiod-ca-cert\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873899 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-certs\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873899 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-token\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.873899 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.873894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-socket\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.916301 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.916264    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="761816e6-4a58-4c5d-bf1c-1fbcbe89b72e" path="/var/lib/kubelet/pods/761816e6-4a58-4c5d-bf1c-1fbcbe89b72e/volumes"
Sep 09 22:07:27.974883 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.974847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-certs\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.974883 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.974888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-token\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.974938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-socket\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-podinfo\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-data\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-envoy\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-certs\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-credential-socket\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-socket\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfws9\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-kube-api-access-lfws9\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istiod-ca-cert\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.975603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-data\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.976343 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-credential-socket\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.976343 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.975982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istiod-ca-cert\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.977688 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.977663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-envoy\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.977842 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.977826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-podinfo\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.983745 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.983721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-token\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:27.984569 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:27.984547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfws9\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-kube-api-access-lfws9\") pod \"e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") " pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:28.150509 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.150387    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:28.427921 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.427894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"]
Sep 09 22:07:28.430229 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:07:28.430201    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81d06aa_5ba5_4cb7_8001_41adcca2f666.slice/crio-a68ce319560492cdd9071b121f4199c1d7bba1e046e83b1be3148408b7d772ad WatchSource:0}: Error finding container a68ce319560492cdd9071b121f4199c1d7bba1e046e83b1be3148408b7d772ad: Status 404 returned error can't find the container with id a68ce319560492cdd9071b121f4199c1d7bba1e046e83b1be3148408b7d772ad
Sep 09 22:07:28.432795 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.432753    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:07:28.432878 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.432820    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:07:28.432878 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.432850    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:07:28.528161 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.528107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" event={"ID":"f81d06aa-5ba5-4cb7-8001-41adcca2f666","Type":"ContainerStarted","Data":"ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"}
Sep 09 22:07:28.528635 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.528182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" event={"ID":"f81d06aa-5ba5-4cb7-8001-41adcca2f666","Type":"ContainerStarted","Data":"a68ce319560492cdd9071b121f4199c1d7bba1e046e83b1be3148408b7d772ad"}
Sep 09 22:07:28.548232 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:28.548139    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podStartSLOduration=1.548117443 podStartE2EDuration="1.548117443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:07:28.546997355 +0000 UTC m=+1723.101657115" watchObservedRunningTime="2026-09-09 22:07:28.548117443 +0000 UTC m=+1723.102777184"
Sep 09 22:07:29.151486 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:29.151437    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:29.156705 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:29.156675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:29.534612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:29.534525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:29.535493 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:29.535457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:31.350226 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.350188    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:07:31.572674 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.572631    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"]
Sep 09 22:07:31.573158 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.573142    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy"
Sep 09 22:07:31.573220 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.573162    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8167918f-1c9a-45ca-8540-38e97fe35eb9" containerName="istio-proxy"
Sep 09 22:07:31.573262 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.573244    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad6ff91-2f94-4bcd-8ab5-65d74d91f91b" containerName="istio-proxy"
Sep 09 22:07:31.576776 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.576751    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.579283 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.579262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-8fe6a1-serving-cert\""
Sep 09 22:07:31.586498 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.586450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"]
Sep 09 22:07:31.607341 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.607232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9hnw\" (UniqueName: \"kubernetes.io/projected/921adfcc-c5d3-49b2-976d-4d0459752fa2-kube-api-access-x9hnw\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.607548 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.607408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.607548 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.607451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921adfcc-c5d3-49b2-976d-4d0459752fa2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.607656 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.607557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-metrics-certs\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.708539 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.708494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-metrics-certs\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.708734 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.708577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9hnw\" (UniqueName: \"kubernetes.io/projected/921adfcc-c5d3-49b2-976d-4d0459752fa2-kube-api-access-x9hnw\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.708734 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.708650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.708734 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.708669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921adfcc-c5d3-49b2-976d-4d0459752fa2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.708916 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:31.708802    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-serving-cert: secret "maas-api-e2e-ipp-b-8fe6a1-serving-cert" not found
Sep 09 22:07:31.708916 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:31.708892    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls podName:921adfcc-c5d3-49b2-976d-4d0459752fa2 nodeName:}" failed. No retries permitted until 2026-09-09 22:07:32.20885908 +0000 UTC m=+1726.763518801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls") pod "maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" (UID: "921adfcc-c5d3-49b2-976d-4d0459752fa2") : secret "maas-api-e2e-ipp-b-8fe6a1-serving-cert" not found
Sep 09 22:07:31.709338 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.709318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921adfcc-c5d3-49b2-976d-4d0459752fa2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.711007 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.710986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-metrics-certs\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:31.718483 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:31.718439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9hnw\" (UniqueName: \"kubernetes.io/projected/921adfcc-c5d3-49b2-976d-4d0459752fa2-kube-api-access-x9hnw\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:32.213309 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:32.213274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:32.216146 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:32.216108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:32.488943 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:32.488827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:32.763947 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:32.763870    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"]
Sep 09 22:07:32.766843 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:07:32.766811    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921adfcc_c5d3_49b2_976d_4d0459752fa2.slice/crio-8dcef3201fc8784afaffb4ca99475b648d1d9c430bfd795c6a1cfa1172f0bacb WatchSource:0}: Error finding container 8dcef3201fc8784afaffb4ca99475b648d1d9c430bfd795c6a1cfa1172f0bacb: Status 404 returned error can't find the container with id 8dcef3201fc8784afaffb4ca99475b648d1d9c430bfd795c6a1cfa1172f0bacb
Sep 09 22:07:32.768254 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:32.768237    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 22:07:33.556256 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:33.556230    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" event={"ID":"921adfcc-c5d3-49b2-976d-4d0459752fa2","Type":"ContainerStarted","Data":"50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2"}
Sep 09 22:07:33.556648 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:33.556285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" event={"ID":"921adfcc-c5d3-49b2-976d-4d0459752fa2","Type":"ContainerStarted","Data":"8dcef3201fc8784afaffb4ca99475b648d1d9c430bfd795c6a1cfa1172f0bacb"}
Sep 09 22:07:33.556648 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:33.556315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:33.572778 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:33.572729    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" podStartSLOduration=2.201586496 podStartE2EDuration="2.572712027s" totalImagesPullingTime="371.125531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:07:33.570909885 +0000 UTC m=+1728.125569624" watchObservedRunningTime="2026-09-09 22:07:33.572712027 +0000 UTC m=+1728.127371792"
Sep 09 22:07:33.963691 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:33.963603    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"]
Sep 09 22:07:33.963878 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:33.963853    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy" containerID="cri-o://9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6" gracePeriod=30
Sep 09 22:07:39.244483 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.244444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:07:39.376404 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376348    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-credential-socket\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376404 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376410    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-token\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376738 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376433    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-podinfo\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376738 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-certs\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376738 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-data\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376738 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376682    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6qb9\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-kube-api-access-r6qb9\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376738 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376719    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:39.376999 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-data" (OuterVolumeSpecName: "istio-data") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:39.376999 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-envoy\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376999 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:39.376999 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376834    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-socket\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.376999 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.376851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4098da8c-4a3e-4175-8bb4-f3989803ef59-istiod-ca-cert\") pod \"4098da8c-4a3e-4175-8bb4-f3989803ef59\" (UID: \"4098da8c-4a3e-4175-8bb4-f3989803ef59\") "
Sep 09 22:07:39.377481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.377049    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:39.377481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.377174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4098da8c-4a3e-4175-8bb4-f3989803ef59-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:07:39.377481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.377182    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.377481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.377216    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.377481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.377233    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.377481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.377247    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.378929 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.378899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-token" (OuterVolumeSpecName: "istio-token") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:39.379040 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.378931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-kube-api-access-r6qb9" (OuterVolumeSpecName: "kube-api-access-r6qb9") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "kube-api-access-r6qb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:07:39.379257 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.379234    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:07:39.379324 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.379307    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4098da8c-4a3e-4175-8bb4-f3989803ef59" (UID: "4098da8c-4a3e-4175-8bb4-f3989803ef59"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 22:07:39.478743 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.478639    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4098da8c-4a3e-4175-8bb4-f3989803ef59-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.478743 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.478684    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.478743 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.478694    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.478743 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.478702    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6qb9\" (UniqueName: \"kubernetes.io/projected/4098da8c-4a3e-4175-8bb4-f3989803ef59-kube-api-access-r6qb9\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.478743 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.478713    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4098da8c-4a3e-4175-8bb4-f3989803ef59-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:07:39.566899 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.566867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:07:39.585963 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.585925    2560 generic.go:356] "Generic (PLEG): container finished" podID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerID="9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6" exitCode=0
Sep 09 22:07:39.586125 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.585979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" event={"ID":"4098da8c-4a3e-4175-8bb4-f3989803ef59","Type":"ContainerDied","Data":"9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6"}
Sep 09 22:07:39.586125 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.585994    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"
Sep 09 22:07:39.586125 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.586048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w" event={"ID":"4098da8c-4a3e-4175-8bb4-f3989803ef59","Type":"ContainerDied","Data":"7678ecee0c3f6f819c3c39356ac6d33be7247d2feb3f9942ac8ded0c41a8e564"}
Sep 09 22:07:39.586125 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.586070    2560 scope.go:117] "RemoveContainer" containerID="9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6"
Sep 09 22:07:39.616778 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.616319    2560 scope.go:117] "RemoveContainer" containerID="0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"
Sep 09 22:07:39.634854 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.634817    2560 scope.go:117] "RemoveContainer" containerID="9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6"
Sep 09 22:07:39.635247 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:39.635223    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6\": container with ID starting with 9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6 not found: ID does not exist" containerID="9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6"
Sep 09 22:07:39.635321 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.635256    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6"} err="failed to get container status \"9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6\": rpc error: code = NotFound desc = could not find container \"9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6\": container with ID starting with 9941a632c304113b0b311fb8dae8e8f1fed60e71745a2d03098fa2d4e98628b6 not found: ID does not exist"
Sep 09 22:07:39.635321 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.635275    2560 scope.go:117] "RemoveContainer" containerID="0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"
Sep 09 22:07:39.635642 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:07:39.635622    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b\": container with ID starting with 0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b not found: ID does not exist" containerID="0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"
Sep 09 22:07:39.635706 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.635648    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b"} err="failed to get container status \"0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b\": rpc error: code = NotFound desc = could not find container \"0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b\": container with ID starting with 0c4c06831985edc7a5c0e6317099d833dc588eaadac7bfb44640314b251e1e9b not found: ID does not exist"
Sep 09 22:07:39.641515 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.641485    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"]
Sep 09 22:07:39.647456 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.647420    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e5cb43-openshift-default-6cd7948f96-j7l6w"]
Sep 09 22:07:39.918873 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:39.918831    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" path="/var/lib/kubelet/pods/4098da8c-4a3e-4175-8bb4-f3989803ef59/volumes"
Sep 09 22:07:45.246521 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:45.246458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:07:47.636287 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:47.636204    2560 generic.go:356] "Generic (PLEG): container finished" podID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerID="ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98" exitCode=0
Sep 09 22:07:47.636287 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:47.636261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" event={"ID":"f81d06aa-5ba5-4cb7-8001-41adcca2f666","Type":"ContainerDied","Data":"ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"}
Sep 09 22:07:47.636800 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:47.636718    2560 scope.go:117] "RemoveContainer" containerID="ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"
Sep 09 22:07:47.637897 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:47.637866    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:07:47.637995 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:47.637943    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:07:47.637995 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:47.637979    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:07:48.643898 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:48.643858    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" event={"ID":"f81d06aa-5ba5-4cb7-8001-41adcca2f666","Type":"ContainerStarted","Data":"f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a"}
Sep 09 22:07:49.151449 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:49.151411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:49.151655 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:49.151627    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 22:07:49.151707 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:49.151678    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 22:07:50.151801 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:50.151756    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 22:07:50.152156 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:50.151836    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 22:07:51.151000 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:51.150953    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 22:07:51.151197 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:51.151054    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 22:07:52.150809 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:52.150771    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 22:07:52.151201 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:52.150834    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 22:07:53.151048 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:53.151006    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 09 22:07:53.151559 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:53.151074    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 09 22:07:54.154626 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:54.154591    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:54.155101 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:54.154978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:07:54.155604 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:07:54.155584    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:08:12.954796 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:12.954752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:08:29.963262 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:29.963227    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:08:37.157595 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.157510    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"]
Sep 09 22:08:37.158042 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.157996    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy"
Sep 09 22:08:37.158042 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.158015    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy"
Sep 09 22:08:37.158042 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.158029    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy"
Sep 09 22:08:37.158042 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.158037    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy"
Sep 09 22:08:37.158249 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.158130    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy"
Sep 09 22:08:37.158249 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.158143    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4098da8c-4a3e-4175-8bb4-f3989803ef59" containerName="istio-proxy"
Sep 09 22:08:37.161031 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.161008    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.163453 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.163427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-fcfdbf-openshift-default-dockercfg-twj9g\""
Sep 09 22:08:37.171458 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.171431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"]
Sep 09 22:08:37.315092 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-credential-socket\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315092 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-data\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315329 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkzz\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-kube-api-access-xhkzz\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315329 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315329 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-envoy\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315329 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-token\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315329 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-certs\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315530 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-podinfo\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.315530 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.315450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-socket\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416161 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkzz\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-kube-api-access-xhkzz\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416161 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-envoy\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-token\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-certs\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-podinfo\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-socket\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-credential-socket\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416384 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-data\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416794 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-certs\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416844 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-credential-socket\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416844 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-socket\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.416920 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.416860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-data\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.417030 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.417006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.418794 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.418761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-envoy\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.418965 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.418939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-podinfo\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.424562 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.424540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-token\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.424837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.424817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkzz\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-kube-api-access-xhkzz\") pod \"e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") " pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.471757 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.471722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:37.750027 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.749997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"]
Sep 09 22:08:37.752496 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:08:37.752444    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddeb31a8_fe7d_4c23_9f75_1927e36b6315.slice/crio-293ace4531b0204b2e3ec53dbfc64d13875a026b0ec93c8994171b5f1e98f34e WatchSource:0}: Error finding container 293ace4531b0204b2e3ec53dbfc64d13875a026b0ec93c8994171b5f1e98f34e: Status 404 returned error can't find the container with id 293ace4531b0204b2e3ec53dbfc64d13875a026b0ec93c8994171b5f1e98f34e
Sep 09 22:08:37.754957 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.754913    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:08:37.755038 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.755008    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:08:37.755081 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.755054    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:08:37.868774 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.868742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" event={"ID":"ddeb31a8-fe7d-4c23-9f75-1927e36b6315","Type":"ContainerStarted","Data":"365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"}
Sep 09 22:08:37.868971 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.868801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" event={"ID":"ddeb31a8-fe7d-4c23-9f75-1927e36b6315","Type":"ContainerStarted","Data":"293ace4531b0204b2e3ec53dbfc64d13875a026b0ec93c8994171b5f1e98f34e"}
Sep 09 22:08:37.897530 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:37.897442    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podStartSLOduration=0.897416988 podStartE2EDuration="897.416988ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:08:37.895274737 +0000 UTC m=+1792.449934490" watchObservedRunningTime="2026-09-09 22:08:37.897416988 +0000 UTC m=+1792.452076720"
Sep 09 22:08:38.472651 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:38.472610    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:38.478263 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:38.478233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:38.873806 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:38.873773    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:38.874695 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:38.874674    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:08:41.076400 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.076368    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"]
Sep 09 22:08:41.078648 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.078631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.083431 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.083411    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-fcfdbf-serving-cert\""
Sep 09 22:08:41.102689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.102657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"]
Sep 09 22:08:41.153655 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.153619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpvxx\" (UniqueName: \"kubernetes.io/projected/be7f7199-ba5f-49f7-94d8-8302075d0eed-kube-api-access-dpvxx\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.153827 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.153688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.153827 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.153764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.153827 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.153785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7f7199-ba5f-49f7-94d8-8302075d0eed-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.254716 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.254674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.254933 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.254729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7f7199-ba5f-49f7-94d8-8302075d0eed-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.254933 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.254799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpvxx\" (UniqueName: \"kubernetes.io/projected/be7f7199-ba5f-49f7-94d8-8302075d0eed-kube-api-access-dpvxx\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.254933 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.254852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.254933 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:08:41.254922    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-serving-cert: secret "maas-api-e2e-ipp-cleanup-fcfdbf-serving-cert" not found
Sep 09 22:08:41.255160 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:08:41.255057    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls podName:be7f7199-ba5f-49f7-94d8-8302075d0eed nodeName:}" failed. No retries permitted until 2026-09-09 22:08:41.755010449 +0000 UTC m=+1796.309670191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" (UID: "be7f7199-ba5f-49f7-94d8-8302075d0eed") : secret "maas-api-e2e-ipp-cleanup-fcfdbf-serving-cert" not found
Sep 09 22:08:41.255658 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.255632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7f7199-ba5f-49f7-94d8-8302075d0eed-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.257789 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.257763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.269627 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.269602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpvxx\" (UniqueName: \"kubernetes.io/projected/be7f7199-ba5f-49f7-94d8-8302075d0eed-kube-api-access-dpvxx\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.758847 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.758800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.761322 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.761295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:41.989767 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:41.989722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:42.264155 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:42.264132    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"]
Sep 09 22:08:42.266520 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:08:42.266460    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7f7199_ba5f_49f7_94d8_8302075d0eed.slice/crio-2f3161fc660863c1a660604ed557c3dc8b0b0c7366022d1f4729f206013cef8a WatchSource:0}: Error finding container 2f3161fc660863c1a660604ed557c3dc8b0b0c7366022d1f4729f206013cef8a: Status 404 returned error can't find the container with id 2f3161fc660863c1a660604ed557c3dc8b0b0c7366022d1f4729f206013cef8a
Sep 09 22:08:42.894514 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:42.894460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" event={"ID":"be7f7199-ba5f-49f7-94d8-8302075d0eed","Type":"ContainerStarted","Data":"2f3161fc660863c1a660604ed557c3dc8b0b0c7366022d1f4729f206013cef8a"}
Sep 09 22:08:43.903551 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:43.903514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" event={"ID":"be7f7199-ba5f-49f7-94d8-8302075d0eed","Type":"ContainerStarted","Data":"5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df"}
Sep 09 22:08:43.903972 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:43.903611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:43.923192 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:43.923136    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" podStartSLOduration=2.168594243 podStartE2EDuration="2.92309569s" totalImagesPullingTime="754.501447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:08:43.922219212 +0000 UTC m=+1798.476878954" watchObservedRunningTime="2026-09-09 22:08:43.92309569 +0000 UTC m=+1798.477755472"
Sep 09 22:08:49.152480 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:49.152423    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:08:49.917031 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:49.916999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:08:59.983104 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:59.983064    2560 generic.go:356] "Generic (PLEG): container finished" podID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerID="365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9" exitCode=0
Sep 09 22:08:59.983550 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:59.983118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" event={"ID":"ddeb31a8-fe7d-4c23-9f75-1927e36b6315","Type":"ContainerDied","Data":"365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"}
Sep 09 22:08:59.983599 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:59.983568    2560 scope.go:117] "RemoveContainer" containerID="365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"
Sep 09 22:08:59.984815 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:59.984784    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:08:59.984889 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:59.984857    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:08:59.984937 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:08:59.984889    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 22:09:00.990089 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:00.990054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" event={"ID":"ddeb31a8-fe7d-4c23-9f75-1927e36b6315","Type":"ContainerStarted","Data":"19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c"}
Sep 09 22:09:01.472015 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:01.471980    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:09:01.472218 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:01.472164    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 09 22:09:01.472273 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:01.472214    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 09 22:09:02.472990 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:02.472933    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 09 22:09:02.473456 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:02.473012    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 09 22:09:03.472271 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:03.472228    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 09 22:09:03.472478 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:03.472293    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 09 22:09:04.472382 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:04.472339    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 09 22:09:04.472838 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:04.472410    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 09 22:09:05.473152 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:05.473108    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 09 22:09:05.473639 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:05.473182    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 09 22:09:06.472199 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:06.472154    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 09 22:09:06.472394 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:06.472222    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 09 22:09:07.476573 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:07.476537    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:09:07.477029 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:07.476821    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:09:07.477696 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:07.477677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:09:11.492368 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.492325    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"]
Sep 09 22:09:11.492842 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.492622    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" podUID="be7f7199-ba5f-49f7-94d8-8302075d0eed" containerName="maas-api" containerID="cri-o://5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df" gracePeriod=30
Sep 09 22:09:11.738097 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.738067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:09:11.820849 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.820814    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7f7199-ba5f-49f7-94d8-8302075d0eed-openshift-service-ca\") pod \"be7f7199-ba5f-49f7-94d8-8302075d0eed\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") "
Sep 09 22:09:11.821062 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.820857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls\") pod \"be7f7199-ba5f-49f7-94d8-8302075d0eed\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") "
Sep 09 22:09:11.821062 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.820886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-metrics-certs\") pod \"be7f7199-ba5f-49f7-94d8-8302075d0eed\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") "
Sep 09 22:09:11.821062 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.820963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpvxx\" (UniqueName: \"kubernetes.io/projected/be7f7199-ba5f-49f7-94d8-8302075d0eed-kube-api-access-dpvxx\") pod \"be7f7199-ba5f-49f7-94d8-8302075d0eed\" (UID: \"be7f7199-ba5f-49f7-94d8-8302075d0eed\") "
Sep 09 22:09:11.821313 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.821283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be7f7199-ba5f-49f7-94d8-8302075d0eed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be7f7199-ba5f-49f7-94d8-8302075d0eed" (UID: "be7f7199-ba5f-49f7-94d8-8302075d0eed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:09:11.823235 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.823208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "be7f7199-ba5f-49f7-94d8-8302075d0eed" (UID: "be7f7199-ba5f-49f7-94d8-8302075d0eed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:09:11.823235 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.823227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be7f7199-ba5f-49f7-94d8-8302075d0eed" (UID: "be7f7199-ba5f-49f7-94d8-8302075d0eed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:09:11.823403 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.823252    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7f7199-ba5f-49f7-94d8-8302075d0eed-kube-api-access-dpvxx" (OuterVolumeSpecName: "kube-api-access-dpvxx") pod "be7f7199-ba5f-49f7-94d8-8302075d0eed" (UID: "be7f7199-ba5f-49f7-94d8-8302075d0eed"). InnerVolumeSpecName "kube-api-access-dpvxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:09:11.921997 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.921962    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpvxx\" (UniqueName: \"kubernetes.io/projected/be7f7199-ba5f-49f7-94d8-8302075d0eed-kube-api-access-dpvxx\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:11.921997 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.921989    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7f7199-ba5f-49f7-94d8-8302075d0eed-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:11.921997 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.922001    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:11.922233 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:11.922009    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be7f7199-ba5f-49f7-94d8-8302075d0eed-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:12.053051 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.053009    2560 generic.go:356] "Generic (PLEG): container finished" podID="be7f7199-ba5f-49f7-94d8-8302075d0eed" containerID="5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df" exitCode=0
Sep 09 22:09:12.053247 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.053058    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"
Sep 09 22:09:12.053247 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.053094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" event={"ID":"be7f7199-ba5f-49f7-94d8-8302075d0eed","Type":"ContainerDied","Data":"5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df"}
Sep 09 22:09:12.053247 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.053142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m" event={"ID":"be7f7199-ba5f-49f7-94d8-8302075d0eed","Type":"ContainerDied","Data":"2f3161fc660863c1a660604ed557c3dc8b0b0c7366022d1f4729f206013cef8a"}
Sep 09 22:09:12.053247 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.053165    2560 scope.go:117] "RemoveContainer" containerID="5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df"
Sep 09 22:09:12.062337 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.062314    2560 scope.go:117] "RemoveContainer" containerID="5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df"
Sep 09 22:09:12.062618 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:09:12.062599    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df\": container with ID starting with 5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df not found: ID does not exist" containerID="5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df"
Sep 09 22:09:12.062674 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.062626    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df"} err="failed to get container status \"5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df\": rpc error: code = NotFound desc = could not find container \"5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df\": container with ID starting with 5444ade146d3bbdf59955e45f833ec021dc688559823a87298e3da2c775698df not found: ID does not exist"
Sep 09 22:09:12.069454 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.069431    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"]
Sep 09 22:09:12.075074 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:12.075017    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fcfdbf-7549b6cb66-plm4m"]
Sep 09 22:09:13.916264 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:13.916223    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7f7199-ba5f-49f7-94d8-8302075d0eed" path="/var/lib/kubelet/pods/be7f7199-ba5f-49f7-94d8-8302075d0eed/volumes"
Sep 09 22:09:16.049075 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:16.049039    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:09:18.157786 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:18.157751    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"]
Sep 09 22:09:18.158273 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:18.158035    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" containerID="cri-o://19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c" gracePeriod=30
Sep 09 22:09:22.479635 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:22.479590    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 22:09:22.480125 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:22.479660    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 22:09:23.421852 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.421782    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:09:23.524300 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524264    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhkzz\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-kube-api-access-xhkzz\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524300 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-socket\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-podinfo\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524516    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-credential-socket\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-envoy\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-data\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istiod-ca-cert\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524711    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-certs\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524720    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-token\") pod \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\" (UID: \"ddeb31a8-fe7d-4c23-9f75-1927e36b6315\") "
Sep 09 22:09:23.524881 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524946    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.524962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.525039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.525094    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.525114    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.525128    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.525308 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.525139    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.526926 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.526906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:09:23.527044 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.527023    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 22:09:23.527214 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.527194    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:09:23.527269 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.527195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-kube-api-access-xhkzz" (OuterVolumeSpecName: "kube-api-access-xhkzz") pod "ddeb31a8-fe7d-4c23-9f75-1927e36b6315" (UID: "ddeb31a8-fe7d-4c23-9f75-1927e36b6315"). InnerVolumeSpecName "kube-api-access-xhkzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:09:23.625902 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.625862    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.625902 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.625894    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.625902 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.625903    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhkzz\" (UniqueName: \"kubernetes.io/projected/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-kube-api-access-xhkzz\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.625902 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.625912    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:23.626222 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:23.625921    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeb31a8-fe7d-4c23-9f75-1927e36b6315-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:09:24.109781 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.109739    2560 generic.go:356] "Generic (PLEG): container finished" podID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerID="19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c" exitCode=0
Sep 09 22:09:24.109959 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.109788    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"
Sep 09 22:09:24.109959 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.109792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" event={"ID":"ddeb31a8-fe7d-4c23-9f75-1927e36b6315","Type":"ContainerDied","Data":"19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c"}
Sep 09 22:09:24.109959 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.109841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f" event={"ID":"ddeb31a8-fe7d-4c23-9f75-1927e36b6315","Type":"ContainerDied","Data":"293ace4531b0204b2e3ec53dbfc64d13875a026b0ec93c8994171b5f1e98f34e"}
Sep 09 22:09:24.109959 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.109865    2560 scope.go:117] "RemoveContainer" containerID="19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c"
Sep 09 22:09:24.118641 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.118624    2560 scope.go:117] "RemoveContainer" containerID="365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"
Sep 09 22:09:24.126812 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.126786    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"]
Sep 09 22:09:24.126993 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.126967    2560 scope.go:117] "RemoveContainer" containerID="19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c"
Sep 09 22:09:24.127272 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:09:24.127247    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c\": container with ID starting with 19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c not found: ID does not exist" containerID="19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c"
Sep 09 22:09:24.127382 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.127278    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c"} err="failed to get container status \"19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c\": rpc error: code = NotFound desc = could not find container \"19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c\": container with ID starting with 19c0027554a23b02396b3776d1f944525a00f6c63c062474a49811bc0131958c not found: ID does not exist"
Sep 09 22:09:24.127382 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.127299    2560 scope.go:117] "RemoveContainer" containerID="365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"
Sep 09 22:09:24.127576 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:09:24.127554    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9\": container with ID starting with 365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9 not found: ID does not exist" containerID="365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"
Sep 09 22:09:24.127633 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.127583    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9"} err="failed to get container status \"365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9\": rpc error: code = NotFound desc = could not find container \"365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9\": container with ID starting with 365a4ec4821fc674914cd704a1f45f7aaf12b061ea5bfebb2b272dc6336662a9 not found: ID does not exist"
Sep 09 22:09:24.132486 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:24.132443    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fcfdbf-openshift-default-86448c7f66-knt9f"]
Sep 09 22:09:25.917884 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:25.917846    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" path="/var/lib/kubelet/pods/ddeb31a8-fe7d-4c23-9f75-1927e36b6315/volumes"
Sep 09 22:09:34.848060 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:34.848019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:09:47.548037 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:09:47.548002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:11:00.151105 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.151061    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"]
Sep 09 22:11:00.152184 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.152145    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" podUID="921adfcc-c5d3-49b2-976d-4d0459752fa2" containerName="maas-api" containerID="cri-o://50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2" gracePeriod=30
Sep 09 22:11:00.397008 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.396978    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:11:00.508081 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.507974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-metrics-certs\") pod \"921adfcc-c5d3-49b2-976d-4d0459752fa2\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") "
Sep 09 22:11:00.508081 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.508018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls\") pod \"921adfcc-c5d3-49b2-976d-4d0459752fa2\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") "
Sep 09 22:11:00.508081 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.508054    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921adfcc-c5d3-49b2-976d-4d0459752fa2-openshift-service-ca\") pod \"921adfcc-c5d3-49b2-976d-4d0459752fa2\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") "
Sep 09 22:11:00.508385 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.508113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9hnw\" (UniqueName: \"kubernetes.io/projected/921adfcc-c5d3-49b2-976d-4d0459752fa2-kube-api-access-x9hnw\") pod \"921adfcc-c5d3-49b2-976d-4d0459752fa2\" (UID: \"921adfcc-c5d3-49b2-976d-4d0459752fa2\") "
Sep 09 22:11:00.508714 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.508680    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/921adfcc-c5d3-49b2-976d-4d0459752fa2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "921adfcc-c5d3-49b2-976d-4d0459752fa2" (UID: "921adfcc-c5d3-49b2-976d-4d0459752fa2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:11:00.508947 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.508924    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921adfcc-c5d3-49b2-976d-4d0459752fa2-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:00.511029 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.510982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "921adfcc-c5d3-49b2-976d-4d0459752fa2" (UID: "921adfcc-c5d3-49b2-976d-4d0459752fa2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:11:00.511241 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.511216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "921adfcc-c5d3-49b2-976d-4d0459752fa2" (UID: "921adfcc-c5d3-49b2-976d-4d0459752fa2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:11:00.511419 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.511395    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921adfcc-c5d3-49b2-976d-4d0459752fa2-kube-api-access-x9hnw" (OuterVolumeSpecName: "kube-api-access-x9hnw") pod "921adfcc-c5d3-49b2-976d-4d0459752fa2" (UID: "921adfcc-c5d3-49b2-976d-4d0459752fa2"). InnerVolumeSpecName "kube-api-access-x9hnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:11:00.558864 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.558821    2560 generic.go:356] "Generic (PLEG): container finished" podID="921adfcc-c5d3-49b2-976d-4d0459752fa2" containerID="50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2" exitCode=0
Sep 09 22:11:00.559039 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.558868    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"
Sep 09 22:11:00.559039 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.558879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" event={"ID":"921adfcc-c5d3-49b2-976d-4d0459752fa2","Type":"ContainerDied","Data":"50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2"}
Sep 09 22:11:00.559039 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.558934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf" event={"ID":"921adfcc-c5d3-49b2-976d-4d0459752fa2","Type":"ContainerDied","Data":"8dcef3201fc8784afaffb4ca99475b648d1d9c430bfd795c6a1cfa1172f0bacb"}
Sep 09 22:11:00.559039 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.558964    2560 scope.go:117] "RemoveContainer" containerID="50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2"
Sep 09 22:11:00.569131 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.569107    2560 scope.go:117] "RemoveContainer" containerID="50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2"
Sep 09 22:11:00.569518 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:11:00.569497    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2\": container with ID starting with 50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2 not found: ID does not exist" containerID="50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2"
Sep 09 22:11:00.569595 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.569533    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2"} err="failed to get container status \"50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2\": rpc error: code = NotFound desc = could not find container \"50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2\": container with ID starting with 50dabed38dfcd4a3a8f10ec0f66ffdbffd4783ce9ab2c8ee46cb7c3f4df44cd2 not found: ID does not exist"
Sep 09 22:11:00.580827 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.580797    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"]
Sep 09 22:11:00.584798 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.584773    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8fe6a1-58cb7dc87d-gxnmf"]
Sep 09 22:11:00.609409 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.609375    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:00.609409 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.609403    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921adfcc-c5d3-49b2-976d-4d0459752fa2-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:00.609409 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:00.609416    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9hnw\" (UniqueName: \"kubernetes.io/projected/921adfcc-c5d3-49b2-976d-4d0459752fa2-kube-api-access-x9hnw\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:01.915729 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:01.915687    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="921adfcc-c5d3-49b2-976d-4d0459752fa2" path="/var/lib/kubelet/pods/921adfcc-c5d3-49b2-976d-4d0459752fa2/volumes"
Sep 09 22:11:03.245524 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:03.245486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:11:06.631568 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:06.631530    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"]
Sep 09 22:11:06.631962 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:06.631785    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" containerID="cri-o://f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a" gracePeriod=30
Sep 09 22:11:09.157757 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:09.157714    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 22:11:09.158146 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:09.157778    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 22:11:11.885717 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.885689    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:11:11.903845 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.903743    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-data\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.903845 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.903794    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfws9\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-kube-api-access-lfws9\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.903845 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.903828    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-certs\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.903845 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.903847    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-podinfo\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.904306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.903884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-socket\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.904306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.903932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istiod-ca-cert\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.904306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-envoy\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.904306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904197    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-credential-socket\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.904306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-token\") pod \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\" (UID: \"f81d06aa-5ba5-4cb7-8001-41adcca2f666\") "
Sep 09 22:11:11.904306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904284    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-data" (OuterVolumeSpecName: "istio-data") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904390    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904553    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904667    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904683    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istiod-ca-cert\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904695    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-data\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.904987    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:11:11.905837 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.905147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:11:11.908520 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.907795    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 22:11:11.908520 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.908022    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:11:11.908520 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.908114    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-kube-api-access-lfws9" (OuterVolumeSpecName: "kube-api-access-lfws9") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "kube-api-access-lfws9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:11:11.908751 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:11.908629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-token" (OuterVolumeSpecName: "istio-token") pod "f81d06aa-5ba5-4cb7-8001-41adcca2f666" (UID: "f81d06aa-5ba5-4cb7-8001-41adcca2f666"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:11:12.005151 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.005108    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-envoy\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:12.005151 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.005143    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-credential-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:12.005151 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.005156    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-token\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:12.005395 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.005169    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfws9\" (UniqueName: \"kubernetes.io/projected/f81d06aa-5ba5-4cb7-8001-41adcca2f666-kube-api-access-lfws9\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:12.005395 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.005181    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81d06aa-5ba5-4cb7-8001-41adcca2f666-istio-podinfo\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:12.005395 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.005192    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81d06aa-5ba5-4cb7-8001-41adcca2f666-workload-socket\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:12.620556 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.620513    2560 generic.go:356] "Generic (PLEG): container finished" podID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerID="f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a" exitCode=0
Sep 09 22:11:12.620749 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.620572    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"
Sep 09 22:11:12.620749 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.620605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" event={"ID":"f81d06aa-5ba5-4cb7-8001-41adcca2f666","Type":"ContainerDied","Data":"f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a"}
Sep 09 22:11:12.620749 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.620664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq" event={"ID":"f81d06aa-5ba5-4cb7-8001-41adcca2f666","Type":"ContainerDied","Data":"a68ce319560492cdd9071b121f4199c1d7bba1e046e83b1be3148408b7d772ad"}
Sep 09 22:11:12.620749 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.620695    2560 scope.go:117] "RemoveContainer" containerID="f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a"
Sep 09 22:11:12.629533 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.629511    2560 scope.go:117] "RemoveContainer" containerID="ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"
Sep 09 22:11:12.637146 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.637117    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"]
Sep 09 22:11:12.638233 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.638212    2560 scope.go:117] "RemoveContainer" containerID="f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a"
Sep 09 22:11:12.638563 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:11:12.638540    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a\": container with ID starting with f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a not found: ID does not exist" containerID="f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a"
Sep 09 22:11:12.638659 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.638575    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a"} err="failed to get container status \"f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a\": rpc error: code = NotFound desc = could not find container \"f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a\": container with ID starting with f13ce42b79c99c0b84b12ac12ab149f0aa5984dbc7e2d3b1d00a266c6f25726a not found: ID does not exist"
Sep 09 22:11:12.638659 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.638600    2560 scope.go:117] "RemoveContainer" containerID="ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"
Sep 09 22:11:12.638878 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:11:12.638860    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98\": container with ID starting with ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98 not found: ID does not exist" containerID="ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"
Sep 09 22:11:12.638927 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.638886    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98"} err="failed to get container status \"ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98\": rpc error: code = NotFound desc = could not find container \"ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98\": container with ID starting with ea65b7f603895a2c1011d89d1191dffa75978d73abb2bf1c5a77095bea220c98 not found: ID does not exist"
Sep 09 22:11:12.642128 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:12.642105    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-8fe6a1-openshift-default-774bb94b5d-8kkjq"]
Sep 09 22:11:13.916719 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:13.916680    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" path="/var/lib/kubelet/pods/f81d06aa-5ba5-4cb7-8001-41adcca2f666/volumes"
Sep 09 22:11:17.429412 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.429370    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"]
Sep 09 22:11:17.429874 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.429687    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm" podUID="1f6e702a-7845-4f5f-8651-7fc119679dbf" containerName="maas-api" containerID="cri-o://30fb90d0f12225f4de64247d06c727d7f9518468fc16d7bc33ea3ac092c467b8" gracePeriod=30
Sep 09 22:11:17.646301 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.646264    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f6e702a-7845-4f5f-8651-7fc119679dbf" containerID="30fb90d0f12225f4de64247d06c727d7f9518468fc16d7bc33ea3ac092c467b8" exitCode=0
Sep 09 22:11:17.646534 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.646333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm" event={"ID":"1f6e702a-7845-4f5f-8651-7fc119679dbf","Type":"ContainerDied","Data":"30fb90d0f12225f4de64247d06c727d7f9518468fc16d7bc33ea3ac092c467b8"}
Sep 09 22:11:17.675121 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.675089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 22:11:17.752753 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.752649    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-metrics-certs\") pod \"1f6e702a-7845-4f5f-8651-7fc119679dbf\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") "
Sep 09 22:11:17.752753 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.752696    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-maas-api-tls\") pod \"1f6e702a-7845-4f5f-8651-7fc119679dbf\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") "
Sep 09 22:11:17.752753 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.752719    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc7s2\" (UniqueName: \"kubernetes.io/projected/1f6e702a-7845-4f5f-8651-7fc119679dbf-kube-api-access-tc7s2\") pod \"1f6e702a-7845-4f5f-8651-7fc119679dbf\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") "
Sep 09 22:11:17.753047 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.752816    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e702a-7845-4f5f-8651-7fc119679dbf-openshift-service-ca\") pod \"1f6e702a-7845-4f5f-8651-7fc119679dbf\" (UID: \"1f6e702a-7845-4f5f-8651-7fc119679dbf\") "
Sep 09 22:11:17.753143 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.753113    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6e702a-7845-4f5f-8651-7fc119679dbf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f6e702a-7845-4f5f-8651-7fc119679dbf" (UID: "1f6e702a-7845-4f5f-8651-7fc119679dbf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:11:17.755007 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.754986    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f6e702a-7845-4f5f-8651-7fc119679dbf" (UID: "1f6e702a-7845-4f5f-8651-7fc119679dbf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:11:17.755081 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.755064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f6e702a-7845-4f5f-8651-7fc119679dbf" (UID: "1f6e702a-7845-4f5f-8651-7fc119679dbf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:11:17.755144 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.755121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6e702a-7845-4f5f-8651-7fc119679dbf-kube-api-access-tc7s2" (OuterVolumeSpecName: "kube-api-access-tc7s2") pod "1f6e702a-7845-4f5f-8651-7fc119679dbf" (UID: "1f6e702a-7845-4f5f-8651-7fc119679dbf"). InnerVolumeSpecName "kube-api-access-tc7s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:11:17.853689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.853644    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:17.853689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.853681    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e702a-7845-4f5f-8651-7fc119679dbf-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:17.853689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.853695    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7s2\" (UniqueName: \"kubernetes.io/projected/1f6e702a-7845-4f5f-8651-7fc119679dbf-kube-api-access-tc7s2\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:17.853952 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:17.853708    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e702a-7845-4f5f-8651-7fc119679dbf-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:18.652020 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:18.651990    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"
Sep 09 22:11:18.652020 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:18.652016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm" event={"ID":"1f6e702a-7845-4f5f-8651-7fc119679dbf","Type":"ContainerDied","Data":"5bbd5dcdeb317482e366577468da34d114661c6b268dae63f8ec469c6808e787"}
Sep 09 22:11:18.652557 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:18.652077    2560 scope.go:117] "RemoveContainer" containerID="30fb90d0f12225f4de64247d06c727d7f9518468fc16d7bc33ea3ac092c467b8"
Sep 09 22:11:18.672920 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:18.672892    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"]
Sep 09 22:11:18.679891 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:18.679861    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ace629-7df5768665-xb5hm"]
Sep 09 22:11:19.915726 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:19.915689    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6e702a-7845-4f5f-8651-7fc119679dbf" path="/var/lib/kubelet/pods/1f6e702a-7845-4f5f-8651-7fc119679dbf/volumes"
Sep 09 22:11:20.250685 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:20.250605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:11:24.494862 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.494821    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"]
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495115    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921adfcc-c5d3-49b2-976d-4d0459752fa2" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495126    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="921adfcc-c5d3-49b2-976d-4d0459752fa2" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495136    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495142    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495154    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495159    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495170    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495175    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495180    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7f7199-ba5f-49f7-94d8-8302075d0eed" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495185    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7f7199-ba5f-49f7-94d8-8302075d0eed" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495195    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6e702a-7845-4f5f-8651-7fc119679dbf" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495200    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6e702a-7845-4f5f-8651-7fc119679dbf" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495241    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495249    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495255    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7f7199-ba5f-49f7-94d8-8302075d0eed" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495262    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6e702a-7845-4f5f-8651-7fc119679dbf" containerName="maas-api"
Sep 09 22:11:24.495352 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.495267    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="921adfcc-c5d3-49b2-976d-4d0459752fa2" containerName="maas-api"
Sep 09 22:11:24.499522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.499500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:24.502677 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.502634    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 22:11:24.502841 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.502639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nqcf2\""
Sep 09 22:11:24.505655 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.505630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"]
Sep 09 22:11:24.612481 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.612436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6207c304-affd-4f27-b4ed-eab625fd36e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8\" (UID: \"6207c304-affd-4f27-b4ed-eab625fd36e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:24.713887 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.713845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6207c304-affd-4f27-b4ed-eab625fd36e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8\" (UID: \"6207c304-affd-4f27-b4ed-eab625fd36e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:24.714491 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.714444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6207c304-affd-4f27-b4ed-eab625fd36e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8\" (UID: \"6207c304-affd-4f27-b4ed-eab625fd36e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:24.811577 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:24.811546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:25.079631 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:25.079544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"]
Sep 09 22:11:25.082632 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:11:25.082601    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6207c304_affd_4f27_b4ed_eab625fd36e4.slice/crio-a471b6350143f89d3a8a3578bb732b9902393c13daffd4b7a683a60d7120c54a WatchSource:0}: Error finding container a471b6350143f89d3a8a3578bb732b9902393c13daffd4b7a683a60d7120c54a: Status 404 returned error can't find the container with id a471b6350143f89d3a8a3578bb732b9902393c13daffd4b7a683a60d7120c54a
Sep 09 22:11:25.685859 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:25.685753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8" event={"ID":"6207c304-affd-4f27-b4ed-eab625fd36e4","Type":"ContainerStarted","Data":"da83cde60a8f06cc8d23f375c2b42787e3f13dfd27381e6821ffececc0563397"}
Sep 09 22:11:25.685859 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:25.685805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8" event={"ID":"6207c304-affd-4f27-b4ed-eab625fd36e4","Type":"ContainerStarted","Data":"a471b6350143f89d3a8a3578bb732b9902393c13daffd4b7a683a60d7120c54a"}
Sep 09 22:11:25.699739 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:25.699684    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8" podStartSLOduration=1.699664828 podStartE2EDuration="1.699664828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:11:25.699250953 +0000 UTC m=+1960.253910694" watchObservedRunningTime="2026-09-09 22:11:25.699664828 +0000 UTC m=+1960.254324567"
Sep 09 22:11:26.691816 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:26.691782    2560 generic.go:356] "Generic (PLEG): container finished" podID="6207c304-affd-4f27-b4ed-eab625fd36e4" containerID="da83cde60a8f06cc8d23f375c2b42787e3f13dfd27381e6821ffececc0563397" exitCode=0
Sep 09 22:11:26.692244 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:26.691878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8" event={"ID":"6207c304-affd-4f27-b4ed-eab625fd36e4","Type":"ContainerDied","Data":"da83cde60a8f06cc8d23f375c2b42787e3f13dfd27381e6821ffececc0563397"}
Sep 09 22:11:27.826898 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:27.826872    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:27.946558 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:27.946522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6207c304-affd-4f27-b4ed-eab625fd36e4-maas-api-service-ca\") pod \"6207c304-affd-4f27-b4ed-eab625fd36e4\" (UID: \"6207c304-affd-4f27-b4ed-eab625fd36e4\") "
Sep 09 22:11:27.946874 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:27.946850    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6207c304-affd-4f27-b4ed-eab625fd36e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6207c304-affd-4f27-b4ed-eab625fd36e4" (UID: "6207c304-affd-4f27-b4ed-eab625fd36e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:11:28.047720 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:28.047637    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6207c304-affd-4f27-b4ed-eab625fd36e4-maas-api-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:11:28.707276 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:28.707235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8" event={"ID":"6207c304-affd-4f27-b4ed-eab625fd36e4","Type":"ContainerDied","Data":"a471b6350143f89d3a8a3578bb732b9902393c13daffd4b7a683a60d7120c54a"}
Sep 09 22:11:28.707276 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:28.707269    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"
Sep 09 22:11:28.707496 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:28.707328    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a471b6350143f89d3a8a3578bb732b9902393c13daffd4b7a683a60d7120c54a"
Sep 09 22:11:35.163732 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:35.163692    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"]
Sep 09 22:11:35.164406 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:35.164382    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3b2190-xjxh8"]
Sep 09 22:11:35.917077 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:35.917032    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6207c304-affd-4f27-b4ed-eab625fd36e4" path="/var/lib/kubelet/pods/6207c304-affd-4f27-b4ed-eab625fd36e4/volumes"
Sep 09 22:11:37.663427 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:37.663327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:11:45.760810 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:11:45.760774    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:13:09.256545 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:13:09.256449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:13:33.750724 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:13:33.750686    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:13:41.452760 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:13:41.452720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:13:49.747715 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:13:49.747673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:14:09.149652 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:09.149620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:14:15.144122 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:15.144087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:14:16.756089 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:16.756056    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"]
Sep 09 22:14:16.756523 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:16.756261    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd" podUID="3f5c7185-0582-413a-9142-59fee4e8eabe" containerName="manager" containerID="cri-o://25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88" gracePeriod=10
Sep 09 22:14:19.303206 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.303179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 22:14:19.397167 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.397133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwkn2\" (UniqueName: \"kubernetes.io/projected/3f5c7185-0582-413a-9142-59fee4e8eabe-kube-api-access-fwkn2\") pod \"3f5c7185-0582-413a-9142-59fee4e8eabe\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") "
Sep 09 22:14:19.397369 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.397231    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5c7185-0582-413a-9142-59fee4e8eabe-extensions-socket-volume\") pod \"3f5c7185-0582-413a-9142-59fee4e8eabe\" (UID: \"3f5c7185-0582-413a-9142-59fee4e8eabe\") "
Sep 09 22:14:19.397612 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.397589    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f5c7185-0582-413a-9142-59fee4e8eabe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f5c7185-0582-413a-9142-59fee4e8eabe" (UID: "3f5c7185-0582-413a-9142-59fee4e8eabe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 22:14:19.399452 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.399425    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f5c7185-0582-413a-9142-59fee4e8eabe-kube-api-access-fwkn2" (OuterVolumeSpecName: "kube-api-access-fwkn2") pod "3f5c7185-0582-413a-9142-59fee4e8eabe" (UID: "3f5c7185-0582-413a-9142-59fee4e8eabe"). InnerVolumeSpecName "kube-api-access-fwkn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:14:19.457306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.457209    2560 generic.go:356] "Generic (PLEG): container finished" podID="3f5c7185-0582-413a-9142-59fee4e8eabe" containerID="25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88" exitCode=0
Sep 09 22:14:19.457306 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.457256    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"
Sep 09 22:14:19.457579 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.457299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd" event={"ID":"3f5c7185-0582-413a-9142-59fee4e8eabe","Type":"ContainerDied","Data":"25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88"}
Sep 09 22:14:19.457579 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.457360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd" event={"ID":"3f5c7185-0582-413a-9142-59fee4e8eabe","Type":"ContainerDied","Data":"a556b00dfe7f5765e149e672628728bfe79ee1f91fe04c44b03098874640502c"}
Sep 09 22:14:19.457579 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.457390    2560 scope.go:117] "RemoveContainer" containerID="25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88"
Sep 09 22:14:19.466913 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.466893    2560 scope.go:117] "RemoveContainer" containerID="25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88"
Sep 09 22:14:19.467210 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:14:19.467188    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88\": container with ID starting with 25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88 not found: ID does not exist" containerID="25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88"
Sep 09 22:14:19.467289 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.467221    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88"} err="failed to get container status \"25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88\": rpc error: code = NotFound desc = could not find container \"25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88\": container with ID starting with 25a88507f090f110a1c974b3e00e4315d81aa50ae2dac5310d6983aaef449d88 not found: ID does not exist"
Sep 09 22:14:19.479351 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.479313    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"]
Sep 09 22:14:19.483874 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.483845    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w69rd"]
Sep 09 22:14:19.498621 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.498586    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwkn2\" (UniqueName: \"kubernetes.io/projected/3f5c7185-0582-413a-9142-59fee4e8eabe-kube-api-access-fwkn2\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:14:19.498621 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.498616    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5c7185-0582-413a-9142-59fee4e8eabe-extensions-socket-volume\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:14:19.916971 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:14:19.916932    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f5c7185-0582-413a-9142-59fee4e8eabe" path="/var/lib/kubelet/pods/3f5c7185-0582-413a-9142-59fee4e8eabe/volumes"
Sep 09 22:15:00.140866 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.140823    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"]
Sep 09 22:15:00.141897 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.141865    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6207c304-affd-4f27-b4ed-eab625fd36e4" containerName="revoke-keys"
Sep 09 22:15:00.142009 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.141899    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6207c304-affd-4f27-b4ed-eab625fd36e4" containerName="revoke-keys"
Sep 09 22:15:00.142009 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.141936    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy"
Sep 09 22:15:00.142009 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.141953    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy"
Sep 09 22:15:00.142009 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.141970    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f5c7185-0582-413a-9142-59fee4e8eabe" containerName="manager"
Sep 09 22:15:00.142009 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.141984    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f5c7185-0582-413a-9142-59fee4e8eabe" containerName="manager"
Sep 09 22:15:00.142257 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.142095    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81d06aa-5ba5-4cb7-8001-41adcca2f666" containerName="istio-proxy"
Sep 09 22:15:00.142257 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.142113    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6207c304-affd-4f27-b4ed-eab625fd36e4" containerName="revoke-keys"
Sep 09 22:15:00.142257 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.142122    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f5c7185-0582-413a-9142-59fee4e8eabe" containerName="manager"
Sep 09 22:15:00.142257 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.142132    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddeb31a8-fe7d-4c23-9f75-1927e36b6315" containerName="istio-proxy"
Sep 09 22:15:00.145774 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.145745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"
Sep 09 22:15:00.149294 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.149269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nqcf2\""
Sep 09 22:15:00.151816 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.151786    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"]
Sep 09 22:15:00.157943 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.157908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"
Sep 09 22:15:00.433246 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.433104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"]
Sep 09 22:15:00.436007 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:15:00.435975    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30459740_13d5_4733_8d6b_45f042c3562f.slice/crio-90b27b6a8c31b0597853fbb535189dc2a601cddf27ef79a33bd2f341421afe99 WatchSource:0}: Error finding container 90b27b6a8c31b0597853fbb535189dc2a601cddf27ef79a33bd2f341421afe99: Status 404 returned error can't find the container with id 90b27b6a8c31b0597853fbb535189dc2a601cddf27ef79a33bd2f341421afe99
Sep 09 22:15:00.650487 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.650439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn" event={"ID":"30459740-13d5-4733-8d6b-45f042c3562f","Type":"ContainerStarted","Data":"e96af5300eba5f9856f53028de6bcf225537cbbc6077a89844ee572a80d126da"}
Sep 09 22:15:00.650655 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.650520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn" event={"ID":"30459740-13d5-4733-8d6b-45f042c3562f","Type":"ContainerStarted","Data":"90b27b6a8c31b0597853fbb535189dc2a601cddf27ef79a33bd2f341421afe99"}
Sep 09 22:15:00.665890 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:00.665831    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn" podStartSLOduration=0.665811938 podStartE2EDuration="665.811938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:15:00.665133525 +0000 UTC m=+2175.219793266" watchObservedRunningTime="2026-09-09 22:15:00.665811938 +0000 UTC m=+2175.220471677"
Sep 09 22:15:01.656939 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:01.656898    2560 generic.go:356] "Generic (PLEG): container finished" podID="30459740-13d5-4733-8d6b-45f042c3562f" containerID="e96af5300eba5f9856f53028de6bcf225537cbbc6077a89844ee572a80d126da" exitCode=0
Sep 09 22:15:01.657380 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:01.656981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn" event={"ID":"30459740-13d5-4733-8d6b-45f042c3562f","Type":"ContainerDied","Data":"e96af5300eba5f9856f53028de6bcf225537cbbc6077a89844ee572a80d126da"}
Sep 09 22:15:02.791232 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:02.791196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"
Sep 09 22:15:03.666918 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:03.666880    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn"
Sep 09 22:15:03.666918 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:03.666903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816535-mmtnn" event={"ID":"30459740-13d5-4733-8d6b-45f042c3562f","Type":"ContainerDied","Data":"90b27b6a8c31b0597853fbb535189dc2a601cddf27ef79a33bd2f341421afe99"}
Sep 09 22:15:03.667141 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:03.666955    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90b27b6a8c31b0597853fbb535189dc2a601cddf27ef79a33bd2f341421afe99"
Sep 09 22:15:17.415805 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.415766    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"]
Sep 09 22:15:17.416245 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.416074    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30459740-13d5-4733-8d6b-45f042c3562f" containerName="cleanup"
Sep 09 22:15:17.416245 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.416084    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="30459740-13d5-4733-8d6b-45f042c3562f" containerName="cleanup"
Sep 09 22:15:17.416245 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.416137    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="30459740-13d5-4733-8d6b-45f042c3562f" containerName="cleanup"
Sep 09 22:15:17.419016 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.418999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.421326 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.421301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7rl5w\""
Sep 09 22:15:17.431215 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.431184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"]
Sep 09 22:15:17.509188 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.509147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgkr5\" (UniqueName: \"kubernetes.io/projected/19a55b9d-1b54-4d55-ac2a-30c2311e02f4-kube-api-access-wgkr5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qq7t8\" (UID: \"19a55b9d-1b54-4d55-ac2a-30c2311e02f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.509387 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.509210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19a55b9d-1b54-4d55-ac2a-30c2311e02f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qq7t8\" (UID: \"19a55b9d-1b54-4d55-ac2a-30c2311e02f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.610202 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.610147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgkr5\" (UniqueName: \"kubernetes.io/projected/19a55b9d-1b54-4d55-ac2a-30c2311e02f4-kube-api-access-wgkr5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qq7t8\" (UID: \"19a55b9d-1b54-4d55-ac2a-30c2311e02f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.610202 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.610219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19a55b9d-1b54-4d55-ac2a-30c2311e02f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qq7t8\" (UID: \"19a55b9d-1b54-4d55-ac2a-30c2311e02f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.610697 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.610677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19a55b9d-1b54-4d55-ac2a-30c2311e02f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qq7t8\" (UID: \"19a55b9d-1b54-4d55-ac2a-30c2311e02f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.621918 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.621885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgkr5\" (UniqueName: \"kubernetes.io/projected/19a55b9d-1b54-4d55-ac2a-30c2311e02f4-kube-api-access-wgkr5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qq7t8\" (UID: \"19a55b9d-1b54-4d55-ac2a-30c2311e02f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:17.730132 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:17.730057    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:18.013490 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:18.013442    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"]
Sep 09 22:15:18.016485 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:15:18.016444    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a55b9d_1b54_4d55_ac2a_30c2311e02f4.slice/crio-4d1d8e2a77ffaa133573840a068141beadf331f6dcd3b180d8fe0bcfbdff269b WatchSource:0}: Error finding container 4d1d8e2a77ffaa133573840a068141beadf331f6dcd3b180d8fe0bcfbdff269b: Status 404 returned error can't find the container with id 4d1d8e2a77ffaa133573840a068141beadf331f6dcd3b180d8fe0bcfbdff269b
Sep 09 22:15:18.733894 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:18.733862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8" event={"ID":"19a55b9d-1b54-4d55-ac2a-30c2311e02f4","Type":"ContainerStarted","Data":"c43536abfb703780dc943f9b4a68bb535cb7fedd2713267a7f710b0216cec56f"}
Sep 09 22:15:18.734299 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:18.733911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8" event={"ID":"19a55b9d-1b54-4d55-ac2a-30c2311e02f4","Type":"ContainerStarted","Data":"4d1d8e2a77ffaa133573840a068141beadf331f6dcd3b180d8fe0bcfbdff269b"}
Sep 09 22:15:18.734299 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:18.733998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:18.756479 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:18.756414    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8" podStartSLOduration=1.7563960779999999 podStartE2EDuration="1.756396078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:15:18.755145797 +0000 UTC m=+2193.309805536" watchObservedRunningTime="2026-09-09 22:15:18.756396078 +0000 UTC m=+2193.311055830"
Sep 09 22:15:29.741453 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:29.741418    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qq7t8"
Sep 09 22:15:42.255596 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:42.255562    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:15:49.046502 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:15:49.046441    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:16:28.644960 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:16:28.644922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:16:34.685411 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:16:34.685373    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:16:57.713841 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:16:57.713799    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:06.552371 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:06.552330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:14.243130 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:14.243093    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:20.454482 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.454414    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:20.677369 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.677325    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"]
Sep 09 22:17:20.681016 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.680999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.684057 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.684029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-94w96\""
Sep 09 22:17:20.684200 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.684053    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 22:17:20.684200 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.684079    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 22:17:20.684200 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.684086    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 22:17:20.684200 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.684029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 22:17:20.690689 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.690664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"]
Sep 09 22:17:20.864359 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.864312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7886bc-f1b8-4828-b40f-2d05ae48db41-openshift-service-ca\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.864359 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.864358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-metrics-certs\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.864619 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.864382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzgvb\" (UniqueName: \"kubernetes.io/projected/bb7886bc-f1b8-4828-b40f-2d05ae48db41-kube-api-access-vzgvb\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.864619 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.864514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-maas-api-tls\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.965877 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.965829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7886bc-f1b8-4828-b40f-2d05ae48db41-openshift-service-ca\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.965877 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.965877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-metrics-certs\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.966136 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.965894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzgvb\" (UniqueName: \"kubernetes.io/projected/bb7886bc-f1b8-4828-b40f-2d05ae48db41-kube-api-access-vzgvb\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.966136 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.965936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-maas-api-tls\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.966545 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.966521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7886bc-f1b8-4828-b40f-2d05ae48db41-openshift-service-ca\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.968624 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.968602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-maas-api-tls\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.968709 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.968639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-metrics-certs\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.973964 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.973944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzgvb\" (UniqueName: \"kubernetes.io/projected/bb7886bc-f1b8-4828-b40f-2d05ae48db41-kube-api-access-vzgvb\") pod \"maas-api-77bd4d9968-h9cx6\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") " pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:20.994862 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:20.994822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:21.270968 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:21.270886    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"]
Sep 09 22:17:21.273967 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:17:21.273932    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7886bc_f1b8_4828_b40f_2d05ae48db41.slice/crio-c82450624b34a5cd21e4053b38d2aee5237f7b8860e759bbb764f21b05fb7d42 WatchSource:0}: Error finding container c82450624b34a5cd21e4053b38d2aee5237f7b8860e759bbb764f21b05fb7d42: Status 404 returned error can't find the container with id c82450624b34a5cd21e4053b38d2aee5237f7b8860e759bbb764f21b05fb7d42
Sep 09 22:17:21.275504 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:21.275483    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 22:17:21.288325 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:21.288287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6" event={"ID":"bb7886bc-f1b8-4828-b40f-2d05ae48db41","Type":"ContainerStarted","Data":"c82450624b34a5cd21e4053b38d2aee5237f7b8860e759bbb764f21b05fb7d42"}
Sep 09 22:17:22.294551 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:22.294512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6" event={"ID":"bb7886bc-f1b8-4828-b40f-2d05ae48db41","Type":"ContainerStarted","Data":"8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032"}
Sep 09 22:17:22.294992 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:22.294640    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:22.314998 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:22.314941    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6" podStartSLOduration=1.789917543 podStartE2EDuration="2.314920546s" totalImagesPullingTime="525.003003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:17:22.31283966 +0000 UTC m=+2316.867499399" watchObservedRunningTime="2026-09-09 22:17:22.314920546 +0000 UTC m=+2316.869580287"
Sep 09 22:17:28.040124 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:28.040086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:28.304417 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:28.304331    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:30.505650 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.505612    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"]
Sep 09 22:17:30.506041 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.505852    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6" podUID="bb7886bc-f1b8-4828-b40f-2d05ae48db41" containerName="maas-api" containerID="cri-o://8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032" gracePeriod=30
Sep 09 22:17:30.750586 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.750556    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:30.850390 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.850358    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-metrics-certs\") pod \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") "
Sep 09 22:17:30.850626 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.850402    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzgvb\" (UniqueName: \"kubernetes.io/projected/bb7886bc-f1b8-4828-b40f-2d05ae48db41-kube-api-access-vzgvb\") pod \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") "
Sep 09 22:17:30.850626 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.850434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7886bc-f1b8-4828-b40f-2d05ae48db41-openshift-service-ca\") pod \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") "
Sep 09 22:17:30.850626 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.850589    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-maas-api-tls\") pod \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\" (UID: \"bb7886bc-f1b8-4828-b40f-2d05ae48db41\") "
Sep 09 22:17:30.850887 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.850857    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb7886bc-f1b8-4828-b40f-2d05ae48db41-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb7886bc-f1b8-4828-b40f-2d05ae48db41" (UID: "bb7886bc-f1b8-4828-b40f-2d05ae48db41"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 22:17:30.852734 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.852701    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb7886bc-f1b8-4828-b40f-2d05ae48db41" (UID: "bb7886bc-f1b8-4828-b40f-2d05ae48db41"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:17:30.852734 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.852724    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bb7886bc-f1b8-4828-b40f-2d05ae48db41" (UID: "bb7886bc-f1b8-4828-b40f-2d05ae48db41"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 22:17:30.852879 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.852796    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7886bc-f1b8-4828-b40f-2d05ae48db41-kube-api-access-vzgvb" (OuterVolumeSpecName: "kube-api-access-vzgvb") pod "bb7886bc-f1b8-4828-b40f-2d05ae48db41" (UID: "bb7886bc-f1b8-4828-b40f-2d05ae48db41"). InnerVolumeSpecName "kube-api-access-vzgvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 22:17:30.951618 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.951571    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-maas-api-tls\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:17:30.951618 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.951611    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb7886bc-f1b8-4828-b40f-2d05ae48db41-metrics-certs\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:17:30.951618 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.951626    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzgvb\" (UniqueName: \"kubernetes.io/projected/bb7886bc-f1b8-4828-b40f-2d05ae48db41-kube-api-access-vzgvb\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:17:30.951861 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:30.951640    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7886bc-f1b8-4828-b40f-2d05ae48db41-openshift-service-ca\") on node \"ip-10-0-137-189.ec2.internal\" DevicePath \"\""
Sep 09 22:17:31.335356 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.335316    2560 generic.go:356] "Generic (PLEG): container finished" podID="bb7886bc-f1b8-4828-b40f-2d05ae48db41" containerID="8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032" exitCode=0
Sep 09 22:17:31.335564 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.335366    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"
Sep 09 22:17:31.335564 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.335395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6" event={"ID":"bb7886bc-f1b8-4828-b40f-2d05ae48db41","Type":"ContainerDied","Data":"8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032"}
Sep 09 22:17:31.335564 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.335452    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6" event={"ID":"bb7886bc-f1b8-4828-b40f-2d05ae48db41","Type":"ContainerDied","Data":"c82450624b34a5cd21e4053b38d2aee5237f7b8860e759bbb764f21b05fb7d42"}
Sep 09 22:17:31.335564 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.335500    2560 scope.go:117] "RemoveContainer" containerID="8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032"
Sep 09 22:17:31.344452 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.344431    2560 scope.go:117] "RemoveContainer" containerID="8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032"
Sep 09 22:17:31.344761 ip-10-0-137-189 kubenswrapper[2560]: E0909 22:17:31.344743    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032\": container with ID starting with 8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032 not found: ID does not exist" containerID="8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032"
Sep 09 22:17:31.344811 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.344771    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032"} err="failed to get container status \"8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032\": rpc error: code = NotFound desc = could not find container \"8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032\": container with ID starting with 8772840b98a7dbedd010a19b036605b74b862d8a83841159e0886984a9ee2032 not found: ID does not exist"
Sep 09 22:17:31.355962 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.355933    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"]
Sep 09 22:17:31.357479 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.357442    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bd4d9968-h9cx6"]
Sep 09 22:17:31.916516 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:31.916446    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb7886bc-f1b8-4828-b40f-2d05ae48db41" path="/var/lib/kubelet/pods/bb7886bc-f1b8-4828-b40f-2d05ae48db41/volumes"
Sep 09 22:17:34.953183 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:34.953140    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:40.749297 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:40.749205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:46.157391 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:46.157355    2560 scope.go:117] "RemoveContainer" containerID="da83cde60a8f06cc8d23f375c2b42787e3f13dfd27381e6821ffececc0563397"
Sep 09 22:17:47.652138 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:47.652100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fk9r6"]
Sep 09 22:17:56.064777 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:56.064746    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56bc947947-99ng2_3215ea4c-7857-427a-adca-ea9f1b2958d9/copy-manifests/0.log"
Sep 09 22:17:56.071275 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:56.071246    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56bc947947-99ng2_3215ea4c-7857-427a-adca-ea9f1b2958d9/manager/0.log"
Sep 09 22:17:57.013561 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:57.013522    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816535-mmtnn_30459740-13d5-4733-8d6b-45f042c3562f/cleanup/0.log"
Sep 09 22:17:58.054924 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:58.054889    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-cprsg_bb237aa2-8e39-41cf-8a99-ff006b7b0646/manager/0.log"
Sep 09 22:17:58.158953 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:58.158907    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ms9bj_9f4a3c03-a8f1-455f-a2d3-49f2a362ab11/manager/0.log"
Sep 09 22:17:58.385590 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:58.385545    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qq7t8_19a55b9d-1b54-4d55-ac2a-30c2311e02f4/manager/0.log"
Sep 09 22:17:58.491417 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:58.491387    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fk9r6_a2b2d383-983e-43c7-98b3-eb4d02da10ae/limitador/0.log"
Sep 09 22:17:59.071935 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:59.071904    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8rd2r_629adda4-95ac-4a77-a462-a53d0899ac95/discovery/0.log"
Sep 09 22:17:59.300742 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:17:59.300712    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b49d8b8f6-v9jxv_5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7/kube-auth-proxy/0.log"
Sep 09 22:18:00.100413 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:00.100379    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ksr8d_8841ef22-0a46-470a-a9f6-e734ea93650d/main/0.log"
Sep 09 22:18:00.212299 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:00.212266    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5xrlg_1d528554-7ea9-4bbf-8173-592cf4334d30/main/0.log"
Sep 09 22:18:00.652426 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:00.652382    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-f668c_1fbfcb23-f20c-496e-88af-f6710e156716/main/0.log"
Sep 09 22:18:00.762983 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:00.762954    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mq4l5_bd72d825-5c8f-4220-884a-bde057bfb28b/main/0.log"
Sep 09 22:18:08.911950 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:08.911916    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wln9x_fef28b72-2502-4a45-bd66-f7dc329645ce/global-pull-secret-syncer/0.log"
Sep 09 22:18:08.995690 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:08.995655    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f7jxd_70a8523f-369e-42d2-9cd2-63887cba73ba/konnectivity-agent/0.log"
Sep 09 22:18:09.070028 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:09.069995    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-189.ec2.internal_abe920e35dcb9eb57e7250baf75a38c8/haproxy/0.log"
Sep 09 22:18:13.833218 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:13.833177    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-cprsg_bb237aa2-8e39-41cf-8a99-ff006b7b0646/manager/0.log"
Sep 09 22:18:13.859449 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:13.859414    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ms9bj_9f4a3c03-a8f1-455f-a2d3-49f2a362ab11/manager/0.log"
Sep 09 22:18:14.020577 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:14.020536    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qq7t8_19a55b9d-1b54-4d55-ac2a-30c2311e02f4/manager/0.log"
Sep 09 22:18:14.076960 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:14.076928    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fk9r6_a2b2d383-983e-43c7-98b3-eb4d02da10ae/limitador/0.log"
Sep 09 22:18:15.949460 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:15.949430    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ph5dk_4cd180df-88f1-4e75-b85a-e219d24d9d51/node-exporter/0.log"
Sep 09 22:18:15.970980 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:15.970956    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ph5dk_4cd180df-88f1-4e75-b85a-e219d24d9d51/kube-rbac-proxy/0.log"
Sep 09 22:18:15.990951 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:15.990922    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ph5dk_4cd180df-88f1-4e75-b85a-e219d24d9d51/init-textfile/0.log"
Sep 09 22:18:19.634446 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.634408    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"]
Sep 09 22:18:19.634893 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.634733    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7886bc-f1b8-4828-b40f-2d05ae48db41" containerName="maas-api"
Sep 09 22:18:19.634893 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.634745    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7886bc-f1b8-4828-b40f-2d05ae48db41" containerName="maas-api"
Sep 09 22:18:19.634893 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.634797    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7886bc-f1b8-4828-b40f-2d05ae48db41" containerName="maas-api"
Sep 09 22:18:19.637632 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.637615    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.639942 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.639912    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjhm4\"/\"openshift-service-ca.crt\""
Sep 09 22:18:19.640678 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.640654    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjhm4\"/\"default-dockercfg-627h7\""
Sep 09 22:18:19.640798 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.640694    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjhm4\"/\"kube-root-ca.crt\""
Sep 09 22:18:19.644911 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.644876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"]
Sep 09 22:18:19.672823 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.672782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-lib-modules\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.672823 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.672828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-podres\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.673103 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.672855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpjf\" (UniqueName: \"kubernetes.io/projected/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-kube-api-access-vbpjf\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.673103 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.672881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-sys\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.673103 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.672956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-proc\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.773750 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-proc\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.773949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-lib-modules\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.773949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-podres\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.773949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-proc\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.773949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpjf\" (UniqueName: \"kubernetes.io/projected/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-kube-api-access-vbpjf\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.773949 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-sys\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.774158 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-lib-modules\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.774158 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-podres\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.774158 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.773968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-sys\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.782180 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.782150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpjf\" (UniqueName: \"kubernetes.io/projected/3c0d7247-d14e-4fe7-9a70-3bf7bae29453-kube-api-access-vbpjf\") pod \"perf-node-gather-daemonset-bmlkg\" (UID: \"3c0d7247-d14e-4fe7-9a70-3bf7bae29453\") " pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:19.948603 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:19.948511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:20.219055 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:20.218974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"]
Sep 09 22:18:20.222381 ip-10-0-137-189 kubenswrapper[2560]: W0909 22:18:20.222349    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3c0d7247_d14e_4fe7_9a70_3bf7bae29453.slice/crio-548d6ab08181cc0e52fbe17a913aca0cf7f44ab9cd00b9e6878ae095600a7672 WatchSource:0}: Error finding container 548d6ab08181cc0e52fbe17a913aca0cf7f44ab9cd00b9e6878ae095600a7672: Status 404 returned error can't find the container with id 548d6ab08181cc0e52fbe17a913aca0cf7f44ab9cd00b9e6878ae095600a7672
Sep 09 22:18:20.560665 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:20.560629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg" event={"ID":"3c0d7247-d14e-4fe7-9a70-3bf7bae29453","Type":"ContainerStarted","Data":"b2744d33fd944e8ae0393cfbf0929a85a15e5974f17f233ab9cc97c49e5aff72"}
Sep 09 22:18:20.560847 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:20.560694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg" event={"ID":"3c0d7247-d14e-4fe7-9a70-3bf7bae29453","Type":"ContainerStarted","Data":"548d6ab08181cc0e52fbe17a913aca0cf7f44ab9cd00b9e6878ae095600a7672"}
Sep 09 22:18:20.560847 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:20.560779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:20.578520 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:20.578452    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg" podStartSLOduration=1.578433189 podStartE2EDuration="1.578433189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:18:20.576385198 +0000 UTC m=+2375.131044938" watchObservedRunningTime="2026-09-09 22:18:20.578433189 +0000 UTC m=+2375.133092929"
Sep 09 22:18:21.086651 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:21.086621    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lq6q_7fc55085-829c-4a40-b719-86ca6d1298d3/dns/0.log"
Sep 09 22:18:21.109333 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:21.109307    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lq6q_7fc55085-829c-4a40-b719-86ca6d1298d3/kube-rbac-proxy/0.log"
Sep 09 22:18:21.259322 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:21.259290    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pzrbv_3c9d4ca5-2fba-402c-976a-ea2c2d1a285f/dns-node-resolver/0.log"
Sep 09 22:18:21.765164 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:21.765111    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-764c9dc9c5-64zt9_611b09e6-b946-41be-858c-268af2a77fc7/registry/0.log"
Sep 09 22:18:21.773522 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:21.773448    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-764c9dc9c5-64zt9_611b09e6-b946-41be-858c-268af2a77fc7/registry/1.log"
Sep 09 22:18:21.793303 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:21.793274    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6xrgb_f0563449-2eaa-4a6c-9bad-0adf5f89972c/node-ca/0.log"
Sep 09 22:18:22.964459 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:22.964425    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8rd2r_629adda4-95ac-4a77-a462-a53d0899ac95/discovery/0.log"
Sep 09 22:18:23.014372 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:23.014346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b49d8b8f6-v9jxv_5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7/kube-auth-proxy/0.log"
Sep 09 22:18:23.996151 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:23.996122    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj5j7_fc7565b4-ce85-43af-81e3-0995211429a8/serve-healthcheck-canary/0.log"
Sep 09 22:18:24.590527 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:24.590494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5p57q_deaa7dd6-71cb-4422-a109-6d140691d606/kube-rbac-proxy/0.log"
Sep 09 22:18:24.614290 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:24.614263    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5p57q_deaa7dd6-71cb-4422-a109-6d140691d606/exporter/0.log"
Sep 09 22:18:24.634104 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:24.634074    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5p57q_deaa7dd6-71cb-4422-a109-6d140691d606/extractor/0.log"
Sep 09 22:18:26.575421 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:26.575391    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjhm4/perf-node-gather-daemonset-bmlkg"
Sep 09 22:18:27.291842 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:27.291813    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56bc947947-99ng2_3215ea4c-7857-427a-adca-ea9f1b2958d9/manager/0.log"
Sep 09 22:18:27.311187 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:27.311158    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56bc947947-99ng2_3215ea4c-7857-427a-adca-ea9f1b2958d9/copy-manifests/0.log"
Sep 09 22:18:28.676277 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:28.676246    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-l72ng_ca83ef86-1b17-4986-be89-30cd5a0715db/openshift-lws-operator/0.log"
Sep 09 22:18:29.773250 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:29.773222    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8rd2r_629adda4-95ac-4a77-a462-a53d0899ac95/discovery/0.log"
Sep 09 22:18:29.798904 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:29.798874    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b49d8b8f6-v9jxv_5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7/kube-auth-proxy/0.log"
Sep 09 22:18:31.706092 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:31.706056    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8rd2r_629adda4-95ac-4a77-a462-a53d0899ac95/discovery/0.log"
Sep 09 22:18:31.738359 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:31.738325    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b49d8b8f6-v9jxv_5ea38d48-03ed-4a20-bdc2-5fbe487a1fc7/kube-auth-proxy/0.log"
Sep 09 22:18:35.375327 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.375288    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2c9pz_e5f750cd-1fbf-4b72-9d6e-86229e40242e/kube-multus/0.log"
Sep 09 22:18:35.397604 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.397569    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/kube-multus-additional-cni-plugins/0.log"
Sep 09 22:18:35.416509 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.416456    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/egress-router-binary-copy/0.log"
Sep 09 22:18:35.435617 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.435578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/cni-plugins/0.log"
Sep 09 22:18:35.457322 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.457295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/bond-cni-plugin/0.log"
Sep 09 22:18:35.475782 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.475749    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/routeoverride-cni/0.log"
Sep 09 22:18:35.493827 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.493794    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/whereabouts-cni-bincopy/0.log"
Sep 09 22:18:35.518079 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:35.518051    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pwpl_980ea599-e626-41a3-819e-fb3058869c07/whereabouts-cni/0.log"
Sep 09 22:18:36.012022 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.011992    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmtrr_8511045c-ea59-4fae-8704-f6e3c9fb5931/network-metrics-daemon/0.log"
Sep 09 22:18:36.027011 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.026984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmtrr_8511045c-ea59-4fae-8704-f6e3c9fb5931/kube-rbac-proxy/0.log"
Sep 09 22:18:36.841781 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.841751    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/ovn-controller/0.log"
Sep 09 22:18:36.856772 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.856746    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/ovn-acl-logging/0.log"
Sep 09 22:18:36.882120 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.882087    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/kube-rbac-proxy-node/0.log"
Sep 09 22:18:36.902519 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.902453    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 22:18:36.919047 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.918983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/northd/0.log"
Sep 09 22:18:36.938646 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.938614    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/nbdb/0.log"
Sep 09 22:18:36.958857 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:36.958825    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/sbdb/0.log"
Sep 09 22:18:37.014619 ip-10-0-137-189 kubenswrapper[2560]: I0909 22:18:37.014589    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp6d5_fe69ae00-c16f-4248-9d9c-74166f95c82d/ovnkube-controller/0.log"