Sep 18 13:42:30.832207 ip-10-0-132-83 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 13:42:30.832218 ip-10-0-132-83 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 13:42:30.832227 ip-10-0-132-83 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 13:42:30.832436 ip-10-0-132-83 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 13:42:40.893912 ip-10-0-132-83 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 13:42:40.893929 ip-10-0-132-83 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f533d93ea34e4e4890752c60dcbede80 --
Sep 18 13:44:48.100761 ip-10-0-132-83 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 13:44:51.409498 ip-10-0-132-83 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:51.409498 ip-10-0-132-83 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 13:44:51.409498 ip-10-0-132-83 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:51.409498 ip-10-0-132-83 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 13:44:51.409498 ip-10-0-132-83 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:51.410231 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.409572    2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 13:44:51.414072 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414053    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:51.414072 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414073    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414076    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414081    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414084    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414087    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414089    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414092    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414095    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414099    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414103    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414106    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414109    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414112    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414115    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414118    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414121    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414123    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414126    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414128    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:51.414143 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414131    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414133    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414136    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414139    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414141    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414144    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414146    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414149    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414152    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414155    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414157    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414161    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414164    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414167    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414169    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414173    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414176    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414178    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414181    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414183    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:51.414619 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414185    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414188    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414190    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414194    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414196    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414198    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414201    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414203    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414206    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414209    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414211    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414214    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414221    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414223    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414226    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414229    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414232    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414235    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414237    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414240    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:51.415104 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414242    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414245    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414249    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414251    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414254    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414257    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414259    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414262    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414264    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414267    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414269    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414272    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414275    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414277    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414281    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414284    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414287    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414289    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414292    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414295    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:51.415648 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414298    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414300    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414303    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414305    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414310    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414312    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414315    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414318    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414321    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414323    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414325    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414328    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414331    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414334    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414336    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414339    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414341    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414344    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.414348    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:51.416170 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415095    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415103    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415106    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415110    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415113    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415116    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415119    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415122    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415125    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415128    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415131    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415134    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415136    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415139    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415142    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415144    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415147    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415150    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415153    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415157    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:51.416645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415159    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415162    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415165    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415167    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415170    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415172    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415174    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415177    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415180    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415182    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415184    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415187    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415190    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415193    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415195    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415197    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415200    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415203    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415205    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415207    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:51.417137 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415210    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415212    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415215    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415217    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415220    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415222    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415225    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415227    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415230    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415233    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415236    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415239    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415242    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415245    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415247    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415250    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415254    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415258    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415261    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:51.417904 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415263    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415266    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415268    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415271    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415274    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415278    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415282    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415285    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415288    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415291    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415294    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415297    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415299    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415302    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415305    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415308    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415310    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415313    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415315    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:51.418468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415318    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415321    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415323    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415326    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415329    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415332    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415335    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415337    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415340    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415342    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415345    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415347    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415350    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415352    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415355    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415357    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415360    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415362    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415365    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415368    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:51.419013 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.415370    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416115    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416121    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416124    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416127    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416130    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416133    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416136    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416139    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416141    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416144    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416147    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416150    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416153    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416156    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416158    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416161    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416164    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416167    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:51.419527 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416169    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416172    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416174    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416177    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416180    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416183    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416186    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416188    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416191    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416193    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416196    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416199    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416202    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416204    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416207    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416209    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416212    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416214    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416216    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416219    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:51.419989 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416221    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416226    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416229    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416231    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416234    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416236    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416239    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416242    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416244    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416247    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416250    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416253    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416255    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416258    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416260    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416263    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416265    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416267    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416270    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416273    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:51.420481 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416275    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416277    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416280    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416283    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416285    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416288    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416290    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416293    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416295    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416299    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416302    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416306    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416308    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416312    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416315    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416318    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416321    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416323    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416326    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:51.420996 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416329    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416331    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416334    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416336    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416339    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416342    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416344    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416347    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416349    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416351    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416354    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416356    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416359    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416361    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416364    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416366    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416369    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416371    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416373    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416376    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:51.421475 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416378    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.416381    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416477    2585 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416515    2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416524    2585 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416529    2585 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416537    2585 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416542    2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416546    2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416551    2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416554    2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416557    2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416561    2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416564    2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416567    2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416570    2585 flags.go:64] FLAG: --cgroup-root=""
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416573    2585 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416576    2585 flags.go:64] FLAG: --client-ca-file=""
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416579    2585 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416582    2585 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416585    2585 flags.go:64] FLAG: --cluster-domain=""
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416588    2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416591    2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416594    2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 13:44:51.421954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416597    2585 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416601    2585 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416604    2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416607    2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416611    2585 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416614    2585 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416616    2585 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416619    2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416623    2585 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416626    2585 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416631    2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416633    2585 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416636    2585 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416640    2585 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416644    2585 flags.go:64] FLAG: --enable-server="true"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416649    2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416653    2585 flags.go:64] FLAG: --event-burst="100"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416657    2585 flags.go:64] FLAG: --event-qps="50"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416660    2585 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416664    2585 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416667    2585 flags.go:64] FLAG: --eviction-hard=""
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416670    2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416673    2585 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416676    2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416679    2585 flags.go:64] FLAG: --eviction-soft=""
Sep 18 13:44:51.422568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416682    2585 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416685    2585 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416688    2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416691    2585 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416693    2585 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416696    2585 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416699    2585 flags.go:64] FLAG: --feature-gates=""
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416702    2585 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416705    2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416708    2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416711    2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416714    2585 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416717    2585 flags.go:64] FLAG: --help="false"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416720    2585 flags.go:64] FLAG: --hostname-override="ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416723    2585 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416726    2585 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416730    2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416734    2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416737    2585 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416740    2585 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416742    2585 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416746    2585 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416750    2585 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 13:44:51.423155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416753    2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416756    2585 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416759    2585 flags.go:64] FLAG: --kube-reserved=""
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416762    2585 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416765    2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416767    2585 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416770    2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416773    2585 flags.go:64] FLAG: --lock-file=""
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416776    2585 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416778    2585 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416781    2585 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416787    2585 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416789    2585 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416792    2585 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416795    2585 flags.go:64] FLAG: --logging-format="text"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416798    2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416801    2585 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416803    2585 flags.go:64] FLAG: --manifest-url=""
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416806    2585 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416811    2585 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416813    2585 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416818    2585 flags.go:64] FLAG: --max-pods="110"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416820    2585 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416823    2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416826    2585 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 13:44:51.423761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416829    2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416832    2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416835    2585 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416838    2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416845    2585 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416849    2585 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416857    2585 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416860    2585 flags.go:64] FLAG: --pod-cidr=""
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416863    2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416869    2585 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416872    2585 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416875    2585 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416877    2585 flags.go:64] FLAG: --port="10250"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416880    2585 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416883    2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ae8dfd01d0fa14c9"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416886    2585 flags.go:64] FLAG: --qos-reserved=""
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416889    2585 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416892    2585 flags.go:64] FLAG: --register-node="true"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416895    2585 flags.go:64] FLAG: --register-with-taints=""
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416898    2585 flags.go:64] FLAG: --registry-burst="10"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416901    2585 flags.go:64] FLAG: --registry-qps="5"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416904    2585 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416907    2585 flags.go:64] FLAG: --reserved-memory=""
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416911    2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416914    2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 13:44:51.424389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416917    2585 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416920    2585 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416923    2585 flags.go:64] FLAG: --runonce="false"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416925    2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416928    2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416932    2585 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416934    2585 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416937    2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416940    2585 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416944    2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416947    2585 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416950    2585 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416953    2585 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416958    2585 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416961    2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416965    2585 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416968    2585 flags.go:64] FLAG: --system-cgroups=""
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416971    2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416976    2585 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416979    2585 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416982    2585 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416985    2585 flags.go:64] FLAG: --tls-min-version=""
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416988    2585 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416991    2585 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416994    2585 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 13:44:51.425016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416997    2585 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.416999    2585 flags.go:64] FLAG: --v="2"
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.417004    2585 flags.go:64] FLAG: --version="false"
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.417008    2585 flags.go:64] FLAG: --vmodule=""
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.417011    2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.417015    2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417449    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417469    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417475    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417480    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417484    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417494    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417499    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417503    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417507    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417512    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417517    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417521    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417526    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417530    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417535    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:51.425645 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417539    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417543    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417552    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417556    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417560    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417564    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417568    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417573    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417577    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417581    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417585    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417589    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417593    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417598    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417602    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417611    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417615    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417623    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417633    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:51.426178 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417639    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417644    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417650    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417654    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417659    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417664    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417668    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417672    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417681    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417686    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417690    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417705    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417709    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417713    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417717    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417721    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417725    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417729    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417733    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:51.426669 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417738    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417742    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417751    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417755    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417761    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417767    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417771    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417775    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417779    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417783    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417788    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417794    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417799    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417805    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417813    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417818    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417822    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417826    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417830    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417834    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:51.427140 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417838    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417842    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417846    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417850    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417854    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417859    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417868    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417872    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417877    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417881    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417885    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417890    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417894    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417898    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417903    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417907    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417911    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417916    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417921    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417930    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:51.427644 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417935    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417938    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417943    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417947    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417952    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.417956    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.418532    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.425856    2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.425875    2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.425896    2585 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.425905    2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425962    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425967    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425970    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425973    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:51.428161 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425976    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425979    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425981    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425984    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425986    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425989    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425991    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425994    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425996    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.425999    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426001    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426004    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426006    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426009    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426011    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426014    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426016    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426020    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426024    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426026    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:51.428554 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426029    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426039    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426043    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426047    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426050    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426053    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426056    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426059    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426062    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426065    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426067    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426070    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426072    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426075    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426077    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426080    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426082    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426086    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426090    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426092    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:51.429103 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426096    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426098    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426101    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426103    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426106    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426109    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426112    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426114    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426117    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426120    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426122    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426125    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426127    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426130    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426133    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426135    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426138    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426141    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426143    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426146    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:51.429651 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426148    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426151    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426154    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426156    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426159    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426161    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426164    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426166    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426169    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426171    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426173    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426176    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426178    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426181    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426184    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426187    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426192    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426195    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426198    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426201    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:51.430590 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426203    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426205    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426208    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426211    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426214    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426217    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426220    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426223    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426226    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426230    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426232    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426235    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426238    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426241    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:51.431227 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426243    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.426249    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426366    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426371    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426374    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426377    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426380    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426382    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426385    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426388    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426391    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426393    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426396    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426399    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426401    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:51.431712 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426404    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426407    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426409    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426428    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426431    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426433    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426436    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426439    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426441    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426444    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426447    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426449    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426452    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426456    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426458    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426461    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426464    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426466    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426470    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:51.432106 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426474    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426476    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426480    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426483    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426485    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426489    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426492    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426495    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426498    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426501    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426503    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426506    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426508    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426511    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426514    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426516    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426519    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426521    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426524    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:51.432625 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426526    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426528    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426531    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426533    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426536    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426539    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426541    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426544    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426547    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426549    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426552    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426554    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426557    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426559    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426562    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426564    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426567    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426569    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426572    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426574    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:51.433158 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426577    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426579    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426582    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426584    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426587    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426589    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426591    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426594    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426597    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426600    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426605    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426608    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426611    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426614    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426616    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426619    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426621    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426624    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426627    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426629    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:51.433815 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426632    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426634    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426637    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426639    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426641    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426644    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426646    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:51.426649    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.426654    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.426776    2585 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.428816    2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.429667    2585 server.go:1019] "Starting client certificate rotation"
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.429783    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.429837    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:44:51.434523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.431921    2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:44:51.434912 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.433098    2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:44:51.440163 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.440147    2585 log.go:25] "Validated CRI v1 runtime API"
Sep 18 13:44:51.441949 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.441934    2585 log.go:25] "Validated CRI v1 image API"
Sep 18 13:44:51.443367 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.443187    2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 13:44:51.445323 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.445303    2585 fs.go:135] Filesystem UUIDs: map[3bcdd516-41f3-42d5-9407-60d62792e407:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d861460a-266b-4ccc-ae2e-dfdc21dcba53:/dev/nvme0n1p4]
Sep 18 13:44:51.445393 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.445324    2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 13:44:51.450485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.450334    2585 manager.go:216] Machine: {Timestamp:2026-09-18 13:44:51.449830415 +0000 UTC m=+1.949587923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099433 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d487bf762bb1552df476867f551d SystemUUID:ec21d487-bf76-2bb1-552d-f476867f551d BootID:f533d93e-a34e-4e48-9075-2c60dcbede80 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fc:f4:65:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fc:f4:65:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:bc:89:c1:ec:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 13:44:51.450485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.450467    2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 13:44:51.450671 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.450557    2585 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 13:44:51.452274 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.452245    2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 13:44:51.452432 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.452277    2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 13:44:51.453503 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.453491    2585 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 13:44:51.453503 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.453505    2585 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 13:44:51.453585 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.453513    2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:44:51.453585 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.453525    2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:44:51.453660 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.453599    2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 13:44:51.456109 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456096    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:44:51.456254 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456244    2585 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 13:44:51.456292 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456280    2585 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 13:44:51.456292 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456290    2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 13:44:51.456345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456304    2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 13:44:51.456345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456314    2585 kubelet.go:398] "Adding apiserver pod source"
Sep 18 13:44:51.456345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456323    2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 13:44:51.456788 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456776    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:44:51.456844 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.456796    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:44:51.462700 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.462678    2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 13:44:51.464318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.464302    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:44:51.465090 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.465076    2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 13:44:51.465130 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.465107    2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 13:44:51.466172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466156    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 13:44:51.466172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466175    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466183    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466188    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466197    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.466189    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466202    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466262    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466275    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.466196    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466287    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466297    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 13:44:51.466304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466310    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 13:44:51.466662 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466318    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 13:44:51.466662 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466359    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 13:44:51.466662 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.466367    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 13:44:51.470431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.470400    2585 server.go:1268] "Started kubelet"
Sep 18 13:44:51.470531 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.470469    2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 13:44:51.470589 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.470541    2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 13:44:51.470631 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.470612    2585 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 13:44:51.471647 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.471628    2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 13:44:51.471815 ip-10-0-132-83 systemd[1]: Started Kubernetes Kubelet.
Sep 18 13:44:51.472862 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.472815    2585 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 13:44:51.475326 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.475304    2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 13:44:51.476207 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.476193    2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 13:44:51.477232 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.477211    2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 13:44:51.477232 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.477220    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 13:44:51.477404 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.477382    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:51.477890 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.477872    2585 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 13:44:51.477987 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.477919    2585 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 13:44:51.478066 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.477881    2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 13:44:51.478144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478126    2585 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 13:44:51.478144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478138    2585 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 13:44:51.478256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478142    2585 factory.go:55] Registering systemd factory
Sep 18 13:44:51.478256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478158    2585 factory.go:223] Registration of the systemd container factory successfully
Sep 18 13:44:51.478403 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478389    2585 factory.go:153] Registering CRI-O factory
Sep 18 13:44:51.478456 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478406    2585 factory.go:223] Registration of the crio container factory successfully
Sep 18 13:44:51.478485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478467    2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 13:44:51.478485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478481    2585 factory.go:103] Registering Raw factory
Sep 18 13:44:51.478556 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.478492    2585 manager.go:1196] Started watching for new ooms in manager
Sep 18 13:44:51.500307 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.500280    2585 manager.go:349] Starting recovery of all containers
Sep 18 13:44:51.500952 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.500924    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6mx8k"
Sep 18 13:44:51.501246 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.501226    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6mx8k"
Sep 18 13:44:51.507383 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.507097    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 13:44:51.507536 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.507363    2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 13:44:51.508267 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.507346    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-83.ec2.internal.18d66e38a3b6135a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-83.ec2.internal,UID:ip-10-0-132-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-83.ec2.internal,},FirstTimestamp:2026-09-18 13:44:51.470193498 +0000 UTC m=+1.969951007,LastTimestamp:2026-09-18 13:44:51.470193498 +0000 UTC m=+1.969951007,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-83.ec2.internal,}"
Sep 18 13:44:51.511529 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.511483    2585 manager.go:354] Recovery completed
Sep 18 13:44:51.515716 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.515699    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.517693 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.517676    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.517773 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.517709    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.517773 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.517721    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.518309 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.518295    2585 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 13:44:51.518309 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.518306    2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 13:44:51.518440 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.518321    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:44:51.518440 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.518345    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.519130 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.519112    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.519194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.519141    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.519194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.519152    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.519401 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.519384    2585 policy_none.go:49] "None policy: Start"
Sep 18 13:44:51.519449 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.519406    2585 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 13:44:51.519449 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.519437    2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 13:44:51.520345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.520335    2585 policy_none.go:47] "Start"
Sep 18 13:44:51.559107 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559088    2585 manager.go:337] "Starting Device Plugin manager"
Sep 18 13:44:51.559241 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.559129    2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 13:44:51.559241 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559139    2585 server.go:87] "Starting device plugin registration server"
Sep 18 13:44:51.559484 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559469    2585 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 13:44:51.559543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559498    2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 13:44:51.559806 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559613    2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 13:44:51.559806 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559704    2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 13:44:51.559806 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.559712    2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 13:44:51.560476 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.560375    2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 13:44:51.560476 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.560454    2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:51.632238 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.632199    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 13:44:51.633611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.633597    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 13:44:51.633676 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.633647    2585 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 13:44:51.633676 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.633669    2585 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 13:44:51.633736 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.633705    2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 13:44:51.636066 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.636039    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:51.660470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.660373    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.661406 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.661388    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.661520 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.661435    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.661520 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.661450    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.661520 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.661478    2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.668774 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.668759    2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.668848 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.668783    2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-83.ec2.internal\": node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:51.686856 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.686830    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:51.734388 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.734345    2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"]
Sep 18 13:44:51.734600 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.734494    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.735534 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.735513    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.735624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.735552    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.735624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.735565    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.736771 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.736758    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.736903 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.736889    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.736939 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.736922    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.737740 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.737724    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.737829 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.737754    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.737829 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.737764    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.737829 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.737724    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.737829 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.737822    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.737976 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.737834    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.739044 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.739026    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.739118 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.739055    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:51.739959 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.739943    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:51.740047 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.739970    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:51.740047 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.739983    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:51.755131 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.755105    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-83.ec2.internal\" not found" node="ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.758870 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.758849    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-83.ec2.internal\" not found" node="ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.780429 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.780393    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2efc99fa65034a5832afc3d8ace1de6d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-83.ec2.internal\" (UID: \"2efc99fa65034a5832afc3d8ace1de6d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.780549 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.780445    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b79d00582a3dc69eacd851e07e75f44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal\" (UID: \"4b79d00582a3dc69eacd851e07e75f44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.780549 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.780464    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b79d00582a3dc69eacd851e07e75f44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal\" (UID: \"4b79d00582a3dc69eacd851e07e75f44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.787458 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.787432    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:51.881566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.881528    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b79d00582a3dc69eacd851e07e75f44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal\" (UID: \"4b79d00582a3dc69eacd851e07e75f44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.881748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.881580    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b79d00582a3dc69eacd851e07e75f44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal\" (UID: \"4b79d00582a3dc69eacd851e07e75f44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.881748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.881631    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b79d00582a3dc69eacd851e07e75f44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal\" (UID: \"4b79d00582a3dc69eacd851e07e75f44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.881748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.881641    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b79d00582a3dc69eacd851e07e75f44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal\" (UID: \"4b79d00582a3dc69eacd851e07e75f44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.881748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.881682    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2efc99fa65034a5832afc3d8ace1de6d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-83.ec2.internal\" (UID: \"2efc99fa65034a5832afc3d8ace1de6d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.881748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:51.881713    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2efc99fa65034a5832afc3d8ace1de6d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-83.ec2.internal\" (UID: \"2efc99fa65034a5832afc3d8ace1de6d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:51.887636 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.887610    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:51.988523 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:51.988449    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.058676 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.058634    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:52.063059 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.062668    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:52.089393 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.089140    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.189687 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.189649    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.290328 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.290238    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.390856 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.390822    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.429999 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.429975    2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 13:44:52.430486 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.430162    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 13:44:52.490984 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.490954    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.505662 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.505626    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 13:39:51 +0000 UTC" deadline="2028-05-12 17:31:16.897531197 +0000 UTC"
Sep 18 13:44:52.505662 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.505657    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14451h46m24.391877681s"
Sep 18 13:44:52.591389 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.591306    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.608350 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.608318    2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:52.661960 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:52.661927    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b79d00582a3dc69eacd851e07e75f44.slice/crio-e89c01ad40e6d52fcd87fd6eb5b14a4dc4de19e9b53da36e9045cfe8e24efd6e WatchSource:0}: Error finding container e89c01ad40e6d52fcd87fd6eb5b14a4dc4de19e9b53da36e9045cfe8e24efd6e: Status 404 returned error can't find the container with id e89c01ad40e6d52fcd87fd6eb5b14a4dc4de19e9b53da36e9045cfe8e24efd6e
Sep 18 13:44:52.662497 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:52.662475    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efc99fa65034a5832afc3d8ace1de6d.slice/crio-4959272e9862cfbf3cf2b6a512c0c302da3b4a27cbb7b1d9706395edb04f18fe WatchSource:0}: Error finding container 4959272e9862cfbf3cf2b6a512c0c302da3b4a27cbb7b1d9706395edb04f18fe: Status 404 returned error can't find the container with id 4959272e9862cfbf3cf2b6a512c0c302da3b4a27cbb7b1d9706395edb04f18fe
Sep 18 13:44:52.668699 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.668679    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:44:52.691497 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.691457    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.719763 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.719729    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:52.791911 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:52.791862    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-83.ec2.internal\" not found"
Sep 18 13:44:52.881760 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.881681    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:52.977939 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.977900    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:52.991192 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.991167    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:44:52.992224 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:52.992209    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal"
Sep 18 13:44:53.000681 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.000659    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:44:53.457873 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.457837    2585 apiserver.go:52] "Watching apiserver"
Sep 18 13:44:53.462976 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.462940    2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 13:44:53.463426 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.463382    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-t25pb","openshift-ovn-kubernetes/ovnkube-node-pl6p5","kube-system/global-pull-secret-syncer-ndscd","kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9","openshift-image-registry/node-ca-95mk2","openshift-multus/multus-9lfs7","openshift-multus/multus-additional-cni-plugins-7m55j","openshift-multus/network-metrics-daemon-nfxvx","openshift-network-operator/iptables-alerter-sj2kh","kube-system/konnectivity-agent-plsw9","openshift-cluster-node-tuning-operator/tuned-lmmkb","openshift-dns/node-resolver-dx8b2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal"]
Sep 18 13:44:53.465244 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.465219    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.466485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.466084    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.467375 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467351    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.467479 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467400    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 13:44:53.467557 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467538    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.467671 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467645    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbhgz\""
Sep 18 13:44:53.467746 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467730    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 13:44:53.468135 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467835    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jbg5b\""
Sep 18 13:44:53.468135 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.467961    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.468304 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.468286    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 13:44:53.469164 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.469145    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.470160 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.469738    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.470160 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.469842    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.470160 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.470039    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9zpqq\""
Sep 18 13:44:53.470432 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.470401    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.471256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.471092    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.471358 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.471259    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 13:44:53.471358 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.471354    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.471504 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.471475    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6fj4k\""
Sep 18 13:44:53.471606 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.471577    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 13:44:53.472167 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.472150    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.472817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.472491    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 13:44:53.472817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.472709    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.472951 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.472904    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wp5dc\""
Sep 18 13:44:53.473191 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.473041    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.473524 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.473505    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:53.473592 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.473573    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:44:53.473656 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.473635    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.474647 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.473948    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sf5lw\""
Sep 18 13:44:53.474647 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.474386    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.478178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.475574    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.478178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.475575    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 13:44:53.478178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.477531    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 13:44:53.478178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.477567    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 13:44:53.478178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.477775    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.478178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.478054    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-msttp\""
Sep 18 13:44:53.478735 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.478715    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 13:44:53.478811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.478772    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.479015 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.478990    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 13:44:53.479088 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.479028    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 13:44:53.479254 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.479238    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.480988 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.480964    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7h7h4\""
Sep 18 13:44:53.481074 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.481022    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 13:44:53.481209 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.481192    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 13:44:53.481264 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.481239    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:53.481326 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.481304    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:44:53.482744 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.482725    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.482912 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.482810    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:44:53.484004 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.483985    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.485917 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.485730    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6m4q\""
Sep 18 13:44:53.486077 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.486021    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 13:44:53.486343 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.486325    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 13:44:53.489639 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489032    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:44:53.489733 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489641    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-registration-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.489733 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489681    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.489733 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489706    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-tmp\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.489733 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489731    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-netns\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489753    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vll\" (UniqueName: \"kubernetes.io/projected/c80e0886-d3f2-44d1-80e0-530225fed07f-kube-api-access-m4vll\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489766    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-device-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489779    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-run-netns\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489807    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-systemd\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489830    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-log-socket\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489851    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-env-overrides\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489865    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysconfig\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489878    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysctl-conf\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489893    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-var-lib-kubelet\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489915    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/853ed9f5-6e4b-4410-8907-7266a3a2da1a-iptables-alerter-script\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489938    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-sys-fs\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489959    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-kubernetes\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.489982    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-tuned\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490039    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-kubelet\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490072    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490098    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490117    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqqs\" (UniqueName: \"kubernetes.io/projected/5516f495-0ad8-4b3e-944f-af53249e703c-kube-api-access-njqqs\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490131    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-cni-netd\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490145    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysctl-d\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490163    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-k8s-cni-cncf-io\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490177    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c80e0886-d3f2-44d1-80e0-530225fed07f-tmp-dir\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490201    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-cni-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490217    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/853ed9f5-6e4b-4410-8907-7266a3a2da1a-host-slash\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490233    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-cni-bin\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmttk\" (UniqueName: \"kubernetes.io/projected/343cb484-d3fa-4680-b8dc-5a8be1ed523e-kube-api-access-wmttk\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490278    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-run\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490303    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-socket-dir-parent\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490317    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-socket-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490334    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5516f495-0ad8-4b3e-944f-af53249e703c-serviceca\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.490657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490347    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-sys\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcptw\" (UniqueName: \"kubernetes.io/projected/853ed9f5-6e4b-4410-8907-7266a3a2da1a-kube-api-access-xcptw\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490396    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-slash\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490439    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-etc-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490463    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-daemon-config\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490608    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490644    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-var-lib-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490678    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-ovn\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490705    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-modprobe-d\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-kubelet\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490790    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490836    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490869    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9-agent-certs\") pod \"konnectivity-agent-plsw9\" (UID: \"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9\") " pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490899    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6877c1c0-47e9-46b3-a58e-51d4a22c5429-cni-binary-copy\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490925    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-cni-bin\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490962    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-cni-multus\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.491522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.490988    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5516f495-0ad8-4b3e-944f-af53249e703c-host\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491042    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-systemd-units\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491085    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-lib-modules\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491106    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-node-log\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491127    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovnkube-config\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491149    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-etc-kubernetes\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491190    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfrz\" (UniqueName: \"kubernetes.io/projected/6877c1c0-47e9-46b3-a58e-51d4a22c5429-kube-api-access-hqfrz\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491222    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9-konnectivity-ca\") pod \"konnectivity-agent-plsw9\" (UID: \"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9\") " pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491249    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2d6\" (UniqueName: \"kubernetes.io/projected/e2cd1056-9bc8-46fb-b719-54a0a91badc2-kube-api-access-8b2d6\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491273    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-systemd\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491300    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-system-cni-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491321    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-hostroot\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491343    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-conf-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491366    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-multus-certs\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491393    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovn-node-metrics-cert\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491430    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovnkube-script-lib\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491452    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-host\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.492320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491474    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6xk\" (UniqueName: \"kubernetes.io/projected/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-kube-api-access-7r6xk\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.493214 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491506    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-cnibin\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.493214 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.491554    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c80e0886-d3f2-44d1-80e0-530225fed07f-hosts-file\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.514762 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.514730    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r6gnd"
Sep 18 13:44:53.524336 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.524309    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r6gnd"
Sep 18 13:44:53.539682 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.539655    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:53.579076 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.579034    2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 13:44:53.592204 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592169    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592221    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-device-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-run-netns\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592257    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-systemd\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592273    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-log-socket\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592290    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-env-overrides\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592313    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysconfig\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592335    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysctl-conf\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592349    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-var-lib-kubelet\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.592363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592366    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/853ed9f5-6e4b-4410-8907-7266a3a2da1a-iptables-alerter-script\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592382    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-sys-fs\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592398    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-kubernetes\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592466    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-tuned\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592492    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-kubelet\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592510    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-cnibin\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592526    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592541    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592559    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592579    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqqs\" (UniqueName: \"kubernetes.io/projected/5516f495-0ad8-4b3e-944f-af53249e703c-kube-api-access-njqqs\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592593    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-cni-netd\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592607    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysctl-d\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592622    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-k8s-cni-cncf-io\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592639    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c80e0886-d3f2-44d1-80e0-530225fed07f-tmp-dir\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592658    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-cni-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592673    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/853ed9f5-6e4b-4410-8907-7266a3a2da1a-host-slash\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592692    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-cni-bin\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.592845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592693    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysctl-conf\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592706    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmttk\" (UniqueName: \"kubernetes.io/projected/343cb484-d3fa-4680-b8dc-5a8be1ed523e-kube-api-access-wmttk\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592728    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-run\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592757    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-socket-dir-parent\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592762    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-device-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592773    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-socket-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592790    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5516f495-0ad8-4b3e-944f-af53249e703c-serviceca\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592813    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-sys\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592829    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcptw\" (UniqueName: \"kubernetes.io/projected/853ed9f5-6e4b-4410-8907-7266a3a2da1a-kube-api-access-xcptw\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-log-socket\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-slash\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592867    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-etc-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592889    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-daemon-config\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592908    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2bs\" (UniqueName: \"kubernetes.io/projected/15f84258-910c-46bb-8bcc-e04a71a8ab59-kube-api-access-wx2bs\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592940    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-var-lib-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592956    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-ovn\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.593612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-modprobe-d\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592996    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wps56\" (UniqueName: \"kubernetes.io/projected/a7218af0-ad36-4153-9740-4ee2df7e86e7-kube-api-access-wps56\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593011    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-system-cni-dir\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593025    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593046    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-kubelet\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593073    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593098    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593127    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9-agent-certs\") pod \"konnectivity-agent-plsw9\" (UID: \"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9\") " pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593152    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6877c1c0-47e9-46b3-a58e-51d4a22c5429-cni-binary-copy\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593178    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-cni-bin\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593202    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-cni-multus\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593226    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593251    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84b66f8e-7942-4042-9efd-70a021a82dcc-kubelet-config\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593280    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593307    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5516f495-0ad8-4b3e-944f-af53249e703c-host\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593317    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-env-overrides\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593331    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-systemd-units\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.594345 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593359    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-lib-modules\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593385    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-node-log\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593409    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovnkube-config\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593443    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysconfig\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593451    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-etc-kubernetes\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593479    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfrz\" (UniqueName: \"kubernetes.io/projected/6877c1c0-47e9-46b3-a58e-51d4a22c5429-kube-api-access-hqfrz\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593504    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593523    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9-konnectivity-ca\") pod \"konnectivity-agent-plsw9\" (UID: \"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9\") " pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593539    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2d6\" (UniqueName: \"kubernetes.io/projected/e2cd1056-9bc8-46fb-b719-54a0a91badc2-kube-api-access-8b2d6\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593560    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-systemd\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593586    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-system-cni-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593612    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-hostroot\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593628    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-conf-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593643    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-multus-certs\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593661    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovn-node-metrics-cert\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593676    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovnkube-script-lib\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593691    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-host\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593707    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6xk\" (UniqueName: \"kubernetes.io/projected/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-kube-api-access-7r6xk\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593724    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84b66f8e-7942-4042-9efd-70a021a82dcc-dbus\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593741    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-cnibin\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593759    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c80e0886-d3f2-44d1-80e0-530225fed07f-hosts-file\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593764    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-var-lib-kubelet\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593787    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-registration-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593809    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593825    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-tmp\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-netns\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.593864    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vll\" (UniqueName: \"kubernetes.io/projected/c80e0886-d3f2-44d1-80e0-530225fed07f-kube-api-access-m4vll\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594141    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-slash\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594183    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-etc-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594229    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/853ed9f5-6e4b-4410-8907-7266a3a2da1a-iptables-alerter-script\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594292    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-sys-fs\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594337    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-kubernetes\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594635    2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594666    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-daemon-config\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594913    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-var-lib-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.595638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.594960    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-ovn\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595051    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-modprobe-d\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595105    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-kubelet\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595133    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-openvswitch\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595161    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595486    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-cni-bin\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595511    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-kubelet\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595528    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595605    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-cni-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595658    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/853ed9f5-6e4b-4410-8907-7266a3a2da1a-host-slash\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595792    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595903    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-sysctl-d\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595932    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-k8s-cni-cncf-io\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595948    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-cni-netd\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.595911    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-host\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596015    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c80e0886-d3f2-44d1-80e0-530225fed07f-hosts-file\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596231    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c80e0886-d3f2-44d1-80e0-530225fed07f-tmp-dir\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596263    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-cnibin\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.596500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596299    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-systemd\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596317    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-systemd-units\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596352    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-multus-certs\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596357    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-cni-bin\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596398    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-hostroot\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596403    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-var-lib-cni-multus\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596447    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6877c1c0-47e9-46b3-a58e-51d4a22c5429-cni-binary-copy\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596009    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-system-cni-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596471    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-conf-dir\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596507    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5516f495-0ad8-4b3e-944f-af53249e703c-host\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596524    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-run\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596544    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-lib-modules\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596552    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592793    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-host-run-netns\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596577    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-multus-socket-dir-parent\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596592    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-node-log\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596647    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-registration-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.597200 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.596684    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-etc-kubernetes\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.597975 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.597590    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5516f495-0ad8-4b3e-944f-af53249e703c-serviceca\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.598031 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598000    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovnkube-config\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.598642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598153    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9-konnectivity-ca\") pod \"konnectivity-agent-plsw9\" (UID: \"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9\") " pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.598642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598253    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6877c1c0-47e9-46b3-a58e-51d4a22c5429-host-run-netns\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.598642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598320    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-sys\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.598642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.592813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/343cb484-d3fa-4680-b8dc-5a8be1ed523e-run-systemd\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.598642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598611    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2cd1056-9bc8-46fb-b719-54a0a91badc2-socket-dir\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.598642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598625    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovnkube-script-lib\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.599164 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.598795    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-etc-tuned\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.600566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.600544    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-tmp\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.602620 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.602524    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9-agent-certs\") pod \"konnectivity-agent-plsw9\" (UID: \"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9\") " pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.602837 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.602815    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:53.602917 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.602846    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:53.602917 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.602868    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:53.603009 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.602955    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:54.102924145 +0000 UTC m=+4.602681640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:53.605466 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.605021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcptw\" (UniqueName: \"kubernetes.io/projected/853ed9f5-6e4b-4410-8907-7266a3a2da1a-kube-api-access-xcptw\") pod \"iptables-alerter-sj2kh\" (UID: \"853ed9f5-6e4b-4410-8907-7266a3a2da1a\") " pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.605466 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.605139    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vll\" (UniqueName: \"kubernetes.io/projected/c80e0886-d3f2-44d1-80e0-530225fed07f-kube-api-access-m4vll\") pod \"node-resolver-dx8b2\" (UID: \"c80e0886-d3f2-44d1-80e0-530225fed07f\") " pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.607618 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.607592    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmttk\" (UniqueName: \"kubernetes.io/projected/343cb484-d3fa-4680-b8dc-5a8be1ed523e-kube-api-access-wmttk\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.607767 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.607743    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6xk\" (UniqueName: \"kubernetes.io/projected/7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2-kube-api-access-7r6xk\") pod \"tuned-lmmkb\" (UID: \"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2\") " pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.608685 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.608632    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqqs\" (UniqueName: \"kubernetes.io/projected/5516f495-0ad8-4b3e-944f-af53249e703c-kube-api-access-njqqs\") pod \"node-ca-95mk2\" (UID: \"5516f495-0ad8-4b3e-944f-af53249e703c\") " pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.609315 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.609290    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/343cb484-d3fa-4680-b8dc-5a8be1ed523e-ovn-node-metrics-cert\") pod \"ovnkube-node-pl6p5\" (UID: \"343cb484-d3fa-4680-b8dc-5a8be1ed523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.609470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.609453    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfrz\" (UniqueName: \"kubernetes.io/projected/6877c1c0-47e9-46b3-a58e-51d4a22c5429-kube-api-access-hqfrz\") pod \"multus-9lfs7\" (UID: \"6877c1c0-47e9-46b3-a58e-51d4a22c5429\") " pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.610135 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.610117    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2d6\" (UniqueName: \"kubernetes.io/projected/e2cd1056-9bc8-46fb-b719-54a0a91badc2-kube-api-access-8b2d6\") pod \"aws-ebs-csi-driver-node-pgpj9\" (UID: \"e2cd1056-9bc8-46fb-b719-54a0a91badc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.639481 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.639298    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal" event={"ID":"2efc99fa65034a5832afc3d8ace1de6d","Type":"ContainerStarted","Data":"4959272e9862cfbf3cf2b6a512c0c302da3b4a27cbb7b1d9706395edb04f18fe"}
Sep 18 13:44:53.640529 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.640496    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal" event={"ID":"4b79d00582a3dc69eacd851e07e75f44","Type":"ContainerStarted","Data":"e89c01ad40e6d52fcd87fd6eb5b14a4dc4de19e9b53da36e9045cfe8e24efd6e"}
Sep 18 13:44:53.694745 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694710    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84b66f8e-7942-4042-9efd-70a021a82dcc-dbus\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694762    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694794    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-cnibin\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694819    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694865    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2bs\" (UniqueName: \"kubernetes.io/projected/15f84258-910c-46bb-8bcc-e04a71a8ab59-kube-api-access-wx2bs\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694904    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wps56\" (UniqueName: \"kubernetes.io/projected/a7218af0-ad36-4153-9740-4ee2df7e86e7-kube-api-access-wps56\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694920    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-system-cni-dir\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.694931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694934    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.695144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694953    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:53.695144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694969    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84b66f8e-7942-4042-9efd-70a021a82dcc-kubelet-config\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.695144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.694983    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.695144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.695004    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.695525 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.695502    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.695608 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.695584    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84b66f8e-7942-4042-9efd-70a021a82dcc-dbus\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.695708 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.695694    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.695758 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.695736    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-cnibin\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.696141 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.696110    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.696570 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.696551    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f84258-910c-46bb-8bcc-e04a71a8ab59-system-cni-dir\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.696735 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.696715    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84b66f8e-7942-4042-9efd-70a021a82dcc-kubelet-config\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:53.696820 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.696804    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:53.696891 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.696876    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:54.196855808 +0000 UTC m=+4.696613304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:53.697124 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.697099    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:53.697242 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:53.697180    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:44:54.197162376 +0000 UTC m=+4.696919876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:53.697548 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.697528    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f84258-910c-46bb-8bcc-e04a71a8ab59-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.707724 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.707688    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wps56\" (UniqueName: \"kubernetes.io/projected/a7218af0-ad36-4153-9740-4ee2df7e86e7-kube-api-access-wps56\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:53.707863 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.707688    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2bs\" (UniqueName: \"kubernetes.io/projected/15f84258-910c-46bb-8bcc-e04a71a8ab59-kube-api-access-wx2bs\") pod \"multus-additional-cni-plugins-7m55j\" (UID: \"15f84258-910c-46bb-8bcc-e04a71a8ab59\") " pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:53.780503 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.780402    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sj2kh"
Sep 18 13:44:53.788764 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.788735    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:44:53.801257 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.801222    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lmmkb"
Sep 18 13:44:53.813703 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.813680    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9lfs7"
Sep 18 13:44:53.823100 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.823072    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9"
Sep 18 13:44:53.829670 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.829644    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95mk2"
Sep 18 13:44:53.838207 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.838178    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:44:53.844679 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.844652    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dx8b2"
Sep 18 13:44:53.853247 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:53.853224    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7m55j"
Sep 18 13:44:54.199330 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.199241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:54.199330 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.199289    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:54.199330 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.199313    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199427    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199410    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199410    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199504    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:44:55.199488464 +0000 UTC m=+5.699245963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199517    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:55.199510137 +0000 UTC m=+5.699267631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199457    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:54.199568 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199539    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:54.199805 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.199584    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:55.199572 +0000 UTC m=+5.699329494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:54.527840 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.527763    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:39:53 +0000 UTC" deadline="2028-04-04 07:01:36.082575287 +0000 UTC"
Sep 18 13:44:54.527840 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.527794    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13529h16m41.554784218s"
Sep 18 13:44:54.591119 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:54.591044    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80e0886_d3f2_44d1_80e0_530225fed07f.slice/crio-72378619b4a694620f1049ee7252a02eab62fc00b8e788b0a956abf71c8298b6 WatchSource:0}: Error finding container 72378619b4a694620f1049ee7252a02eab62fc00b8e788b0a956abf71c8298b6: Status 404 returned error can't find the container with id 72378619b4a694620f1049ee7252a02eab62fc00b8e788b0a956abf71c8298b6
Sep 18 13:44:54.592675 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:54.592645    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f84258_910c_46bb_8bcc_e04a71a8ab59.slice/crio-9faf1ed3e69430d262ddd45312792d7425c1c2ae74e184384c4ff4f7aaaa5d19 WatchSource:0}: Error finding container 9faf1ed3e69430d262ddd45312792d7425c1c2ae74e184384c4ff4f7aaaa5d19: Status 404 returned error can't find the container with id 9faf1ed3e69430d262ddd45312792d7425c1c2ae74e184384c4ff4f7aaaa5d19
Sep 18 13:44:54.593525 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:54.593494    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d69dbda_1a77_4a0d_b85f_80a2e9f4cae2.slice/crio-1d128bd7c6029791b998d816499a2a39f9ca4b5d0a856257c87e49a0e9b8b012 WatchSource:0}: Error finding container 1d128bd7c6029791b998d816499a2a39f9ca4b5d0a856257c87e49a0e9b8b012: Status 404 returned error can't find the container with id 1d128bd7c6029791b998d816499a2a39f9ca4b5d0a856257c87e49a0e9b8b012
Sep 18 13:44:54.594339 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:54.594320    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343cb484_d3fa_4680_b8dc_5a8be1ed523e.slice/crio-c67a3c3af59ce6d75ac10ba94070e7501646c4ef529bec58c37b4d2c969d91f1 WatchSource:0}: Error finding container c67a3c3af59ce6d75ac10ba94070e7501646c4ef529bec58c37b4d2c969d91f1: Status 404 returned error can't find the container with id c67a3c3af59ce6d75ac10ba94070e7501646c4ef529bec58c37b4d2c969d91f1
Sep 18 13:44:54.602583 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:44:54.601538    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cd1056_9bc8_46fb_b719_54a0a91badc2.slice/crio-5be65489a237a49747b7522f22b738f4d1cef9a1ac02fba872d0fcea895affcf WatchSource:0}: Error finding container 5be65489a237a49747b7522f22b738f4d1cef9a1ac02fba872d0fcea895affcf: Status 404 returned error can't find the container with id 5be65489a237a49747b7522f22b738f4d1cef9a1ac02fba872d0fcea895affcf
Sep 18 13:44:54.634363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.634330    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:54.634534 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:54.634489    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:44:54.643340 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.643304    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sj2kh" event={"ID":"853ed9f5-6e4b-4410-8907-7266a3a2da1a","Type":"ContainerStarted","Data":"0c3959ec3bfdec468e7ef21237031f2e27092352d51315f9ab09cf8209ada31b"}
Sep 18 13:44:54.644529 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.644504    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9" event={"ID":"e2cd1056-9bc8-46fb-b719-54a0a91badc2","Type":"ContainerStarted","Data":"5be65489a237a49747b7522f22b738f4d1cef9a1ac02fba872d0fcea895affcf"}
Sep 18 13:44:54.645881 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.645852    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9lfs7" event={"ID":"6877c1c0-47e9-46b3-a58e-51d4a22c5429","Type":"ContainerStarted","Data":"bd93f9e1933d1a332df7a85651f0c5081bed12d4c456c5050975c64a5ee4702a"}
Sep 18 13:44:54.648778 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.648741    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plsw9" event={"ID":"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9","Type":"ContainerStarted","Data":"0c539b9704f73267ba071420701ad6c7f048f3c9d62447e785c749038690fc9f"}
Sep 18 13:44:54.654046 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.654017    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lmmkb" event={"ID":"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2","Type":"ContainerStarted","Data":"1d128bd7c6029791b998d816499a2a39f9ca4b5d0a856257c87e49a0e9b8b012"}
Sep 18 13:44:54.655482 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.655448    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95mk2" event={"ID":"5516f495-0ad8-4b3e-944f-af53249e703c","Type":"ContainerStarted","Data":"54751512c406df90f4032ff83920e3c60eb2a1105d80a6fcc6e1dcb92e697224"}
Sep 18 13:44:54.656658 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.656635    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"c67a3c3af59ce6d75ac10ba94070e7501646c4ef529bec58c37b4d2c969d91f1"}
Sep 18 13:44:54.657899 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.657878    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerStarted","Data":"9faf1ed3e69430d262ddd45312792d7425c1c2ae74e184384c4ff4f7aaaa5d19"}
Sep 18 13:44:54.659093 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:54.659072    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dx8b2" event={"ID":"c80e0886-d3f2-44d1-80e0-530225fed07f","Type":"ContainerStarted","Data":"72378619b4a694620f1049ee7252a02eab62fc00b8e788b0a956abf71c8298b6"}
Sep 18 13:44:55.207764 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.207430    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:55.207764 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.207752    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:55.207997 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.207809    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:55.208063 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208008    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:55.208123 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208072    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:44:57.208053255 +0000 UTC m=+7.707810766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:55.208551 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208531    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:55.208651 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208557    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:55.208651 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208571    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:55.208651 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208630    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:57.208615252 +0000 UTC m=+7.708372752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:55.208808 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208696    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:55.208808 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.208728    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:57.208717065 +0000 UTC m=+7.708474564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:55.528065 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.527947    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:39:53 +0000 UTC" deadline="2028-07-06 12:52:30.249760926 +0000 UTC"
Sep 18 13:44:55.528065 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.528015    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15767h7m34.721750476s"
Sep 18 13:44:55.635391 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.634663    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:55.635391 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.634818    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:44:55.635391 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.635253    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:55.635391 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:55.635350    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:44:55.668950 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.668908    2585 generic.go:356] "Generic (PLEG): container finished" podID="4b79d00582a3dc69eacd851e07e75f44" containerID="a3bf7505f116caa5deb08817e5f311a2ef9593ecc2ec68cce3fcc849675f64a3" exitCode=0
Sep 18 13:44:55.669343 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.669234    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal" event={"ID":"4b79d00582a3dc69eacd851e07e75f44","Type":"ContainerDied","Data":"a3bf7505f116caa5deb08817e5f311a2ef9593ecc2ec68cce3fcc849675f64a3"}
Sep 18 13:44:55.675770 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:55.675295    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal" event={"ID":"2efc99fa65034a5832afc3d8ace1de6d","Type":"ContainerStarted","Data":"6a2bf656690ee16fc69010aa78b242b6b41e40650ce2d4f9326f5b314783cb02"}
Sep 18 13:44:56.634746 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:56.634176    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:56.634746 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:56.634325    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:44:56.689618 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:56.689500    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal" event={"ID":"4b79d00582a3dc69eacd851e07e75f44","Type":"ContainerStarted","Data":"508aa77549a27a5f101f2daca87856b6753ca65c56ab32b3056e76046e696e4b"}
Sep 18 13:44:56.708050 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:56.707622    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-83.ec2.internal" podStartSLOduration=4.707009868 podStartE2EDuration="4.707009868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:55.703156154 +0000 UTC m=+6.202913672" watchObservedRunningTime="2026-09-18 13:44:56.707009868 +0000 UTC m=+7.206767385"
Sep 18 13:44:57.227027 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:57.226988    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:57.227206 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:57.227064    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:57.227206 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:57.227098    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:57.227341 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227244    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:57.227341 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227300    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:45:01.227282568 +0000 UTC m=+11.727040068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:57.228041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227800    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:57.228041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227825    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:57.228041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227838    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:57.228041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227900    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:01.227884666 +0000 UTC m=+11.727642165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:57.228041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.227971    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:57.228041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.228003    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:01.227991643 +0000 UTC m=+11.727749144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:57.634624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:57.634536    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:57.634799 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.634690    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:44:57.634799 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:57.634745    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:57.635248 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:57.634852    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:44:58.634398 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:58.634228    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:44:58.634398 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:58.634359    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:44:59.635370 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:59.634871    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:44:59.635370 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:44:59.634924    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:44:59.635370 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:59.635026    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:44:59.635370 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:44:59.635139    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:00.634600 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:00.634561    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:00.634773 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:00.634690    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:01.258261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:01.258324    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:01.258353    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258509    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258574    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:45:09.258554916 +0000 UTC m=+19.758312428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258666    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258684    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258696    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258729    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:09.258719352 +0000 UTC m=+19.758476861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258801    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:01.259166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.258833    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:09.258821213 +0000 UTC m=+19.758578707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:01.635123 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:01.634407    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:01.635123 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.634541    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:01.635123 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:01.634939    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:01.635123 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:01.635030    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:02.634882 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:02.634842    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:02.635316 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:02.634978    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:03.634991 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:03.634571    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:03.634991 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:03.634610    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:03.634991 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:03.634705    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:03.634991 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:03.634845    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:04.634597 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:04.634562    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:04.634801 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:04.634694    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:05.634755 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:05.634724    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:05.635225 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:05.634848    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:05.637060 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:05.637012    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:05.637205 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:05.637128    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:06.634393 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:06.634356    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:06.634581 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:06.634503    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:07.636199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:07.636110    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:07.636684 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:07.636250    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:07.636684 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:07.636521    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:07.636684 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:07.636627    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:08.634122 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:08.634089    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:08.634321 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:08.634216    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:09.320073 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:09.320039    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:09.320098    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:09.320126    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320191    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320215    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320228    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320235    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320271    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320292    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:25.320276163 +0000 UTC m=+35.820033678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320308    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:45:25.320301637 +0000 UTC m=+35.820059132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:09.320540 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.320344    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:25.320325233 +0000 UTC m=+35.820082731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:09.634256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:09.634163    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:09.634256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:09.634211    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:09.634506 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.634299    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:09.634506 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:09.634452    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:10.634497 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:10.634459    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:10.634958 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:10.634584    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:11.637545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:11.635383    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:11.637545 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:11.635584    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:11.637545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:11.636034    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:11.637545 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:11.636151    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:12.634437 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.634234    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:12.634554 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:12.634511    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:12.725387 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.725353    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dx8b2" event={"ID":"c80e0886-d3f2-44d1-80e0-530225fed07f","Type":"ContainerStarted","Data":"6fdbb5e6b7ab45430e2885d5010dc77c745a4ec1ad90480b06feb5b89cbeb2d9"}
Sep 18 13:45:12.727219 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.727193    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9" event={"ID":"e2cd1056-9bc8-46fb-b719-54a0a91badc2","Type":"ContainerStarted","Data":"265828c944b40142ae7017ed9864eaf7fd92c0abd3ecd37e989d3e5ba79e6242"}
Sep 18 13:45:12.728635 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.728606    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9lfs7" event={"ID":"6877c1c0-47e9-46b3-a58e-51d4a22c5429","Type":"ContainerStarted","Data":"9665a406e77276bd65a23d8c9cc626732c49887f1f1299faab556851bc46e5cb"}
Sep 18 13:45:12.730061 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.730038    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plsw9" event={"ID":"b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9","Type":"ContainerStarted","Data":"9f4e94e92018137e89b626d37d036722c37d4f79cded2e87bcfcc53b49ea427e"}
Sep 18 13:45:12.731618 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.731596    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lmmkb" event={"ID":"7d69dbda-1a77-4a0d-b85f-80a2e9f4cae2","Type":"ContainerStarted","Data":"dd1ba0a80c15fe0f3c1328e30a7af041c0b68d147ebc12f659e4c86f418497cb"}
Sep 18 13:45:12.732952 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.732931    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95mk2" event={"ID":"5516f495-0ad8-4b3e-944f-af53249e703c","Type":"ContainerStarted","Data":"6749cc31f14da1a78f4e84040580617972e5c86ea4d421d9187cee5ff934ff71"}
Sep 18 13:45:12.735216 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735200    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:45:12.735514 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735493    2585 generic.go:356] "Generic (PLEG): container finished" podID="343cb484-d3fa-4680-b8dc-5a8be1ed523e" containerID="5e5e4b96c931ada066a649729bc6380feb1677516235feaa744d481c866a6fb5" exitCode=1
Sep 18 13:45:12.735592 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735554    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"29af0978b0e0e2a1f27630e23afa0e0e03ba136d00d0ed976959d7de2703ab30"}
Sep 18 13:45:12.735645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735629    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"124958f7f143695637f04436d57ccf2efc47c9c63d1cd087aa1d6e3fe8e6e42d"}
Sep 18 13:45:12.735697 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735684    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"542178e48d2cfc905ae839bdc72063ab2c9fe944ec45ca765797a3ce2e4d3555"}
Sep 18 13:45:12.735750 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735738    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerDied","Data":"5e5e4b96c931ada066a649729bc6380feb1677516235feaa744d481c866a6fb5"}
Sep 18 13:45:12.735784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.735775    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"e7df6ed5c1683c7e3528a0bf69897e583f6556ad99e76c36270ecb80c00ff797"}
Sep 18 13:45:12.737076 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.737049    2585 generic.go:356] "Generic (PLEG): container finished" podID="15f84258-910c-46bb-8bcc-e04a71a8ab59" containerID="a9cd5f1c9a47db01756eff086d7dd46247385ac83e41f8b0a116dbabdea128ae" exitCode=0
Sep 18 13:45:12.737180 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.737084    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerDied","Data":"a9cd5f1c9a47db01756eff086d7dd46247385ac83e41f8b0a116dbabdea128ae"}
Sep 18 13:45:12.745783 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.745742    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dx8b2" podStartSLOduration=3.2544779569999998 podStartE2EDuration="20.745728466s" totalImagesPullingTime="17.491250509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:12.745106223 +0000 UTC m=+23.244863739" watchObservedRunningTime="2026-09-18 13:45:12.745728466 +0000 UTC m=+23.245485983"
Sep 18 13:45:12.745911 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.745808    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-83.ec2.internal" podStartSLOduration=20.74580443 podStartE2EDuration="20.74580443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:56.70803138 +0000 UTC m=+7.207788889" watchObservedRunningTime="2026-09-18 13:45:12.74580443 +0000 UTC m=+23.245561946"
Sep 18 13:45:12.822099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.822043    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-plsw9" podStartSLOduration=12.281088844 podStartE2EDuration="21.822021048s" totalImagesPullingTime="9.540932204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:12.786657976 +0000 UTC m=+23.286415495" watchObservedRunningTime="2026-09-18 13:45:12.822021048 +0000 UTC m=+23.321778545"
Sep 18 13:45:12.856031 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.855364    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9lfs7" podStartSLOduration=4.2691499 podStartE2EDuration="21.855348458s" totalImagesPullingTime="17.586198558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:12.855203826 +0000 UTC m=+23.354961342" watchObservedRunningTime="2026-09-18 13:45:12.855348458 +0000 UTC m=+23.355105957"
Sep 18 13:45:12.856031 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.855692    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lmmkb" podStartSLOduration=4.347259251 podStartE2EDuration="21.85568455s" totalImagesPullingTime="17.508425299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:12.822206006 +0000 UTC m=+23.321963533" watchObservedRunningTime="2026-09-18 13:45:12.85568455 +0000 UTC m=+23.355442068"
Sep 18 13:45:12.875360 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:12.875302    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-95mk2" podStartSLOduration=4.729685755 podStartE2EDuration="21.875285468s" totalImagesPullingTime="17.145599713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:12.875274195 +0000 UTC m=+23.375031711" watchObservedRunningTime="2026-09-18 13:45:12.875285468 +0000 UTC m=+23.375042984"
Sep 18 13:45:13.511786 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.511753    2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 13:45:13.572694 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.572506    2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:45:13.511779598Z","UUID":"7254b3c8-79c1-4331-8f43-60e70f8cbc29","Handler":null,"Name":"","Endpoint":""}
Sep 18 13:45:13.574402 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.574377    2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 13:45:13.574540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.574426    2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 13:45:13.595817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.595729    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:45:13.596314 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.596292    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:45:13.634303 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.634268    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:13.634303 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.634301    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:13.634460 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:13.634404    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:13.634523 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:13.634503    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:13.740224 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.740189    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sj2kh" event={"ID":"853ed9f5-6e4b-4410-8907-7266a3a2da1a","Type":"ContainerStarted","Data":"20496eb44db26a32b454f222671e66ebe9f2dbcef90886ed5d3276b88eb4d77a"}
Sep 18 13:45:13.742104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.742080    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9" event={"ID":"e2cd1056-9bc8-46fb-b719-54a0a91badc2","Type":"ContainerStarted","Data":"54a5efbfd9f4c789c73f434bdd13ea13096719cd198d3962ed551d36a43f5b23"}
Sep 18 13:45:13.744842 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.744820    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:45:13.745189 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.745170    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"2cf7b40999e1ffb53a8fa41e389637974f2a0b9fde5d245461e3f83bfdf56058"}
Sep 18 13:45:13.745534 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.745512    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:45:13.745897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.745870    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-plsw9"
Sep 18 13:45:13.772953 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:13.772901    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sj2kh" podStartSLOduration=5.279730728 podStartE2EDuration="22.772885593s" totalImagesPullingTime="17.493154865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:13.759026359 +0000 UTC m=+24.258783875" watchObservedRunningTime="2026-09-18 13:45:13.772885593 +0000 UTC m=+24.272643108"
Sep 18 13:45:14.634373 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:14.634335    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:14.634581 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:14.634471    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:15.634765 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:15.634730    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:15.635234 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:15.634730    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:15.635234 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:15.634887    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:15.635234 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:15.634949    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:15.752063 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:15.752020    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9" event={"ID":"e2cd1056-9bc8-46fb-b719-54a0a91badc2","Type":"ContainerStarted","Data":"183b53138112667c9f699aea096581a6f97fd8cd3f8c9e168ceb8de81a916b7c"}
Sep 18 13:45:15.755112 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:15.755092    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:45:15.755543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:15.755523    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"11b825322d40dbf5dd90517b1705ba93552cdd399eb1012b781d062acc019966"}
Sep 18 13:45:15.770244 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:15.770193    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgpj9" podStartSLOduration=5.449823431 podStartE2EDuration="24.770173977s" totalImagesPullingTime="19.320350546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:15.769890012 +0000 UTC m=+26.269647520" watchObservedRunningTime="2026-09-18 13:45:15.770173977 +0000 UTC m=+26.269931493"
Sep 18 13:45:16.634498 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:16.634467    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:16.634681 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:16.634569    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:17.634582 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.634318    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:17.635371 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:17.634708    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:17.635517 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.635496    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:17.635626 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:17.635606    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:17.766766 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.766691    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:45:17.767099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.767067    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"9dc229e684db2e1ce9ea38f681ecaaf2279ea4c00d492c609f398129cd61753b"}
Sep 18 13:45:17.767359 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.767341    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:45:17.767452 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.767433    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:45:17.767571 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.767555    2585 scope.go:117] "RemoveContainer" containerID="5e5e4b96c931ada066a649729bc6380feb1677516235feaa744d481c866a6fb5"
Sep 18 13:45:17.769118 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.769097    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerStarted","Data":"85ef2d3e0bb554718178df2c55972cfd7834bcbf5f270eef69d8c62ed9ded04a"}
Sep 18 13:45:17.784362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:17.784338    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:45:18.634456 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.634406    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:18.634618 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:18.634520    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:18.774793 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.774714    2585 generic.go:356] "Generic (PLEG): container finished" podID="15f84258-910c-46bb-8bcc-e04a71a8ab59" containerID="85ef2d3e0bb554718178df2c55972cfd7834bcbf5f270eef69d8c62ed9ded04a" exitCode=0
Sep 18 13:45:18.774967 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.774767    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerDied","Data":"85ef2d3e0bb554718178df2c55972cfd7834bcbf5f270eef69d8c62ed9ded04a"}
Sep 18 13:45:18.782492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.780797    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:45:18.782492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.781537    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" event={"ID":"343cb484-d3fa-4680-b8dc-5a8be1ed523e","Type":"ContainerStarted","Data":"8a5c77264593f695b644140fc87b977fdd30401c9737e69f93206627995c7694"}
Sep 18 13:45:18.782492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.782401    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:45:18.817338 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.817300    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:45:18.832021 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:18.831960    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5" podStartSLOduration=10.272899128 podStartE2EDuration="27.831936919s" totalImagesPullingTime="17.559037791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:18.828051189 +0000 UTC m=+29.327808701" watchObservedRunningTime="2026-09-18 13:45:18.831936919 +0000 UTC m=+29.331694435"
Sep 18 13:45:19.418695 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:19.418450    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nfxvx"]
Sep 18 13:45:19.418892 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:19.418829    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:19.418960 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:19.418933    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:19.422271 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:19.422242    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ndscd"]
Sep 18 13:45:19.422509 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:19.422490    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:19.422585 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:19.422550    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t25pb"]
Sep 18 13:45:19.422649 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:19.422586    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:19.422649 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:19.422618    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:19.422749 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:19.422684    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:20.634891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:20.634852    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:20.634891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:20.634878    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:20.635338 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:20.634964    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:20.635338 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:20.635082    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:20.788430 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:20.788374    2585 generic.go:356] "Generic (PLEG): container finished" podID="15f84258-910c-46bb-8bcc-e04a71a8ab59" containerID="594c9e3c5da716efc5d0e14ab146f93535943f382e00bbf47bcf38d0202f935f" exitCode=0
Sep 18 13:45:20.788586 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:20.788456    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerDied","Data":"594c9e3c5da716efc5d0e14ab146f93535943f382e00bbf47bcf38d0202f935f"}
Sep 18 13:45:21.046300 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:21.046267    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dx8b2_c80e0886-d3f2-44d1-80e0-530225fed07f/dns-node-resolver/0.log"
Sep 18 13:45:21.634651 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:21.634621    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:21.634835 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:21.634723    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:22.021505 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:22.021482    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95mk2_5516f495-0ad8-4b3e-944f-af53249e703c/node-ca/0.log"
Sep 18 13:45:22.634077 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:22.634039    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:22.634274 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:22.634040    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:22.634274 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:22.634164    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:22.634274 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:22.634214    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:22.794884 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:22.794852    2585 generic.go:356] "Generic (PLEG): container finished" podID="15f84258-910c-46bb-8bcc-e04a71a8ab59" containerID="554c4b201d91a27ba98acd70e054a3045f7964612946b2b88eadd10280a4e125" exitCode=0
Sep 18 13:45:22.795043 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:22.794893    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerDied","Data":"554c4b201d91a27ba98acd70e054a3045f7964612946b2b88eadd10280a4e125"}
Sep 18 13:45:23.634368 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:23.634338    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:23.634778 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:23.634479    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:24.634022 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:24.633985    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:24.634259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:24.633990    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:24.634259 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:24.634126    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:24.634259 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:24.634202    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:25.334613 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:25.334570    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:25.334630    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:25.334647    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334736    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334734    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334763    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334774    2585 projected.go:196] Error preparing data for projected volume kube-api-access-q5gmp for pod openshift-network-diagnostics/network-check-target-t25pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334792    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334803    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret podName:84b66f8e-7942-4042-9efd-70a021a82dcc nodeName:}" failed. No retries permitted until 2026-09-18 13:45:57.334785361 +0000 UTC m=+67.834542859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret") pod "global-pull-secret-syncer-ndscd" (UID: "84b66f8e-7942-4042-9efd-70a021a82dcc") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334863    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp podName:7029fa72-27cb-488e-bf91-ca6b638d56f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:57.334843765 +0000 UTC m=+67.834601270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5gmp" (UniqueName: "kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp") pod "network-check-target-t25pb" (UID: "7029fa72-27cb-488e-bf91-ca6b638d56f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:45:25.335104 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.334878    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs podName:a7218af0-ad36-4153-9740-4ee2df7e86e7 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:57.33486941 +0000 UTC m=+67.834626920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs") pod "network-metrics-daemon-nfxvx" (UID: "a7218af0-ad36-4153-9740-4ee2df7e86e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:45:25.634620 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:25.634586    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:25.634896 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:25.634732    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:26.634853 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:26.634815    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:26.635273 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:26.634815    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:26.635273 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:26.634933    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:26.635273 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:26.635053    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:27.634084 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:27.633994    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:27.634240 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:27.634122    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:27.809575 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:27.809533    2585 generic.go:356] "Generic (PLEG): container finished" podID="15f84258-910c-46bb-8bcc-e04a71a8ab59" containerID="d3eb077af5bf8f312b8887b591e65d88003f2eaa00050e17159c8510492303b7" exitCode=0
Sep 18 13:45:27.809965 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:27.809582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerDied","Data":"d3eb077af5bf8f312b8887b591e65d88003f2eaa00050e17159c8510492303b7"}
Sep 18 13:45:28.634950 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:28.634912    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:28.634950 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:28.634951    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:28.635166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:28.635030    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:28.635166 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:28.635099    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:28.814784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:28.814750    2585 generic.go:356] "Generic (PLEG): container finished" podID="15f84258-910c-46bb-8bcc-e04a71a8ab59" containerID="aa90d1c95ff9ba3c9b9ec4d55d55072ffb714abbb70e70727e1181d4c28a64f9" exitCode=0
Sep 18 13:45:28.815239 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:28.814796    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerDied","Data":"aa90d1c95ff9ba3c9b9ec4d55d55072ffb714abbb70e70727e1181d4c28a64f9"}
Sep 18 13:45:29.634562 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:29.634508    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:29.634760 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:29.634658    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:29.820300 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:29.820259    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m55j" event={"ID":"15f84258-910c-46bb-8bcc-e04a71a8ab59","Type":"ContainerStarted","Data":"305fd5cdec65a45669d63acea1fe0f7a863a3c37babe821510936941ba3f40fd"}
Sep 18 13:45:29.848659 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:29.848593    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7m55j" podStartSLOduration=8.819332959 podStartE2EDuration="37.848573108s" totalImagesPullingTime="29.029240149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:29.848205199 +0000 UTC m=+40.347962715" watchObservedRunningTime="2026-09-18 13:45:29.848573108 +0000 UTC m=+40.348330626"
Sep 18 13:45:30.634428 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:30.634380    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:30.634428 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:30.634401    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:30.634665 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:30.634501    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:30.634665 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:30.634651    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:31.635628 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:31.635594    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:31.636010 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:31.635679    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:32.634673 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:32.634633    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:32.634860 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:32.634743    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:32.634860 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:32.634795    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:32.634940 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:32.634886    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:33.634513 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:33.634475    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:33.634882 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:33.634593    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:34.634219 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:34.634176    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:34.634521 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:34.634294    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:34.634521 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:34.634351    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:34.634521 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:34.634490    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:35.634228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:35.634195    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:35.634393 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:35.634285    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:36.634841 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:36.634815    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:36.635208 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:36.634819    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:36.635208 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:36.634905    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:36.635208 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:36.634981    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:37.634648 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:37.634608    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:37.634814 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:37.634723    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:38.634713 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:38.634680    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:38.635075 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:38.634788    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:38.635075 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:38.634839    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:38.635075 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:38.634934    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:39.634487 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:39.634453    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:39.634664 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:39.634557    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:40.634074 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:40.634037    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:40.634481 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:40.634146    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:40.634481 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:40.634199    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:40.634481 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:40.634294    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:41.634635 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:41.634594    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:41.635071 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:41.634714    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:42.634788 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:42.634754    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:42.635199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:42.634754    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:42.635199 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:42.634903    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:42.635199 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:42.634923    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:43.634294 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:43.634260    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:43.634549 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:43.634369    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t25pb" podUID="7029fa72-27cb-488e-bf91-ca6b638d56f2"
Sep 18 13:45:44.634469 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:44.634436    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:44.634841 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:44.634439    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:44.634841 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:44.634544    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndscd" podUID="84b66f8e-7942-4042-9efd-70a021a82dcc"
Sep 18 13:45:44.634841 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:45:44.634639    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nfxvx" podUID="a7218af0-ad36-4153-9740-4ee2df7e86e7"
Sep 18 13:45:44.958428 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:44.958399    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-83.ec2.internal" event="NodeReady"
Sep 18 13:45:44.958594 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:44.958576    2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 13:45:45.103549 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.103509    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4zk86"]
Sep 18 13:45:45.124574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.124543    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rjstv"]
Sep 18 13:45:45.124728 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.124683    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.127126 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.127066    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlrx5\""
Sep 18 13:45:45.127386 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.127365    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 13:45:45.127540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.127470    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 13:45:45.148647 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.148613    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4zk86"]
Sep 18 13:45:45.148796 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.148654    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.148796 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.148667    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjstv"]
Sep 18 13:45:45.151853 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.151828    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 13:45:45.152306 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.152058    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 13:45:45.152607 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.152589    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 13:45:45.152704 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.152653    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8k78s\""
Sep 18 13:45:45.152704 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.152594    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 13:45:45.187104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.187071    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bbg95"]
Sep 18 13:45:45.208560 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.208481    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbg95"]
Sep 18 13:45:45.208694 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.208577    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.211218 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.211198    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 13:45:45.211218 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.211215    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 13:45:45.211346 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.211198    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 13:45:45.211576 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.211558    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p62gx\""
Sep 18 13:45:45.268108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268070    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-config-volume\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.268108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268109    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-tmp-dir\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.268318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268129    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-metrics-tls\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.268318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268153    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.268318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268173    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.268318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268221    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lvm\" (UniqueName: \"kubernetes.io/projected/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-kube-api-access-p6lvm\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.268318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268251    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-crio-socket\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.268318 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268314    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfz7\" (UniqueName: \"kubernetes.io/projected/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-kube-api-access-hwfz7\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.268586 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.268335    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-data-volume\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369025 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.368989    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369025 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369026    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369053    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4662\" (UniqueName: \"kubernetes.io/projected/ab7c2cf7-0685-45d0-9266-7ee4ed4e9092-kube-api-access-h4662\") pod \"ingress-canary-bbg95\" (UID: \"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092\") " pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369072    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7c2cf7-0685-45d0-9266-7ee4ed4e9092-cert\") pod \"ingress-canary-bbg95\" (UID: \"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092\") " pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lvm\" (UniqueName: \"kubernetes.io/projected/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-kube-api-access-p6lvm\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369120    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-crio-socket\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369170    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfz7\" (UniqueName: \"kubernetes.io/projected/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-kube-api-access-hwfz7\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369199    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-data-volume\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369233    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-config-volume\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369244    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-crio-socket\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369263    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-tmp-dir\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.369691 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369299    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-metrics-tls\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.369691 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369594    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-data-volume\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.369691 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369676    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-tmp-dir\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.369872 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369853    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-config-volume\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.369922 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.369857    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.373311 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.373291    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.373388 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.373326    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-metrics-tls\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.377725 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.377700    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lvm\" (UniqueName: \"kubernetes.io/projected/397cdb97-e628-45dc-9eb3-4c9c2d625a4f-kube-api-access-p6lvm\") pod \"dns-default-4zk86\" (UID: \"397cdb97-e628-45dc-9eb3-4c9c2d625a4f\") " pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.377833 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.377773    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfz7\" (UniqueName: \"kubernetes.io/projected/0980c7b1-f1b1-4041-ba15-8e2a773f1d52-kube-api-access-hwfz7\") pod \"insights-runtime-extractor-rjstv\" (UID: \"0980c7b1-f1b1-4041-ba15-8e2a773f1d52\") " pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.434966 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.434932    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:45.457167 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.457131    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjstv"
Sep 18 13:45:45.470509 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.470439    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4662\" (UniqueName: \"kubernetes.io/projected/ab7c2cf7-0685-45d0-9266-7ee4ed4e9092-kube-api-access-h4662\") pod \"ingress-canary-bbg95\" (UID: \"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092\") " pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.470509 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.470469    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7c2cf7-0685-45d0-9266-7ee4ed4e9092-cert\") pod \"ingress-canary-bbg95\" (UID: \"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092\") " pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.473341 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.473318    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7c2cf7-0685-45d0-9266-7ee4ed4e9092-cert\") pod \"ingress-canary-bbg95\" (UID: \"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092\") " pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.478761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.478741    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4662\" (UniqueName: \"kubernetes.io/projected/ab7c2cf7-0685-45d0-9266-7ee4ed4e9092-kube-api-access-h4662\") pod \"ingress-canary-bbg95\" (UID: \"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092\") " pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.517639 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.517605    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbg95"
Sep 18 13:45:45.634916 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.634886    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:45.638158 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.638134    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7x5xj\""
Sep 18 13:45:45.638303 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.638203    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:45:45.638677 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.638660    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:45:45.791410 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.791369    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjstv"]
Sep 18 13:45:45.792003 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.791985    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4zk86"]
Sep 18 13:45:45.794070 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:45.794039    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0980c7b1_f1b1_4041_ba15_8e2a773f1d52.slice/crio-df0bf280a085d353650afdb16e272ffb98c84a325f9fd2ba2e85fc03803cd555 WatchSource:0}: Error finding container df0bf280a085d353650afdb16e272ffb98c84a325f9fd2ba2e85fc03803cd555: Status 404 returned error can't find the container with id df0bf280a085d353650afdb16e272ffb98c84a325f9fd2ba2e85fc03803cd555
Sep 18 13:45:45.794679 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:45.794654    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397cdb97_e628_45dc_9eb3_4c9c2d625a4f.slice/crio-b68e186bebeedca9e563efd74654ce7afcd49d6b6830b767332b6a0103e4823c WatchSource:0}: Error finding container b68e186bebeedca9e563efd74654ce7afcd49d6b6830b767332b6a0103e4823c: Status 404 returned error can't find the container with id b68e186bebeedca9e563efd74654ce7afcd49d6b6830b767332b6a0103e4823c
Sep 18 13:45:45.846851 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.846815    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbg95"]
Sep 18 13:45:45.854477 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:45.854448    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7c2cf7_0685_45d0_9266_7ee4ed4e9092.slice/crio-4043fa34dc2b254f24cf4734a9ec913fa66f4e6b922bb7bf132d5d6c32d825e6 WatchSource:0}: Error finding container 4043fa34dc2b254f24cf4734a9ec913fa66f4e6b922bb7bf132d5d6c32d825e6: Status 404 returned error can't find the container with id 4043fa34dc2b254f24cf4734a9ec913fa66f4e6b922bb7bf132d5d6c32d825e6
Sep 18 13:45:45.857394 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.857362    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4zk86" event={"ID":"397cdb97-e628-45dc-9eb3-4c9c2d625a4f","Type":"ContainerStarted","Data":"b68e186bebeedca9e563efd74654ce7afcd49d6b6830b767332b6a0103e4823c"}
Sep 18 13:45:45.858679 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:45.858654    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjstv" event={"ID":"0980c7b1-f1b1-4041-ba15-8e2a773f1d52","Type":"ContainerStarted","Data":"df0bf280a085d353650afdb16e272ffb98c84a325f9fd2ba2e85fc03803cd555"}
Sep 18 13:45:46.634377 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.634344    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:46.634717 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.634705    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:46.637245 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.637214    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:45:46.644207 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.644180    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:45:46.644628 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.644473    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cttxw\""
Sep 18 13:45:46.864486 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.864434    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbg95" event={"ID":"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092","Type":"ContainerStarted","Data":"4043fa34dc2b254f24cf4734a9ec913fa66f4e6b922bb7bf132d5d6c32d825e6"}
Sep 18 13:45:46.866501 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:46.866452    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjstv" event={"ID":"0980c7b1-f1b1-4041-ba15-8e2a773f1d52","Type":"ContainerStarted","Data":"4b78729778d4bde9f5cb4005dcf9df37ca7d64b1b679cfdd93c02f01a9d666f0"}
Sep 18 13:45:47.871626 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:47.871582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjstv" event={"ID":"0980c7b1-f1b1-4041-ba15-8e2a773f1d52","Type":"ContainerStarted","Data":"3a8a4fdbeed02d6e987c0177b629a5515f4eba65990b758645eec5ee57fba640"}
Sep 18 13:45:48.878300 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:48.878258    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4zk86" event={"ID":"397cdb97-e628-45dc-9eb3-4c9c2d625a4f","Type":"ContainerStarted","Data":"14ffdb683a3459df7e210090cb1fe696f6502e9dc174b24f7f1570f557677ea8"}
Sep 18 13:45:48.882893 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:48.882396    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbg95" event={"ID":"ab7c2cf7-0685-45d0-9266-7ee4ed4e9092","Type":"ContainerStarted","Data":"c23c85e8f631d9b6d197543aa1627e4b9a03c9a2395aed8b9d8b5d18d2d51dab"}
Sep 18 13:45:48.900787 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:48.900741    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bbg95" podStartSLOduration=1.039875497 podStartE2EDuration="3.900724332s" totalImagesPullingTime="2.860848835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:48.899554333 +0000 UTC m=+59.399311850" watchObservedRunningTime="2026-09-18 13:45:48.900724332 +0000 UTC m=+59.400481848"
Sep 18 13:45:49.887939 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:49.887841    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4zk86" event={"ID":"397cdb97-e628-45dc-9eb3-4c9c2d625a4f","Type":"ContainerStarted","Data":"c0c90b24d4adaa14ffd2795e1a889a13cbb2ad54879a83d7456b5a492c945c23"}
Sep 18 13:45:49.887939 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:49.887914    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:49.893046 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:49.893006    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjstv" event={"ID":"0980c7b1-f1b1-4041-ba15-8e2a773f1d52","Type":"ContainerStarted","Data":"244220e987421e527802fab2d3d5653d0bf77c1b716894d313bba06fc18df21d"}
Sep 18 13:45:49.908143 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:49.908094    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4zk86" podStartSLOduration=1.990943128 podStartE2EDuration="4.908080516s" totalImagesPullingTime="2.917137388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:49.907542963 +0000 UTC m=+60.407300480" watchObservedRunningTime="2026-09-18 13:45:49.908080516 +0000 UTC m=+60.407838033"
Sep 18 13:45:49.926363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:49.926310    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rjstv" podStartSLOduration=1.399080044 podStartE2EDuration="4.926294433s" totalImagesPullingTime="3.527214389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:45:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:49.926177269 +0000 UTC m=+60.425934786" watchObservedRunningTime="2026-09-18 13:45:49.926294433 +0000 UTC m=+60.426051943"
Sep 18 13:45:50.799392 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:50.799364    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl6p5"
Sep 18 13:45:51.257381 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.257344    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"]
Sep 18 13:45:51.259449 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.259405    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:51.262010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.261991    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zh9vz\""
Sep 18 13:45:51.262135 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.262118    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 13:45:51.273954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.273919    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"]
Sep 18 13:45:51.411553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.411521    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d555ce44-2e52-4391-b18f-b34ccd31e32f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-lshww\" (UID: \"d555ce44-2e52-4391-b18f-b34ccd31e32f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:51.512110 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.512015    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d555ce44-2e52-4391-b18f-b34ccd31e32f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-lshww\" (UID: \"d555ce44-2e52-4391-b18f-b34ccd31e32f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:51.514517 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.514499    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 13:45:51.527785 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.525127    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d555ce44-2e52-4391-b18f-b34ccd31e32f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-lshww\" (UID: \"d555ce44-2e52-4391-b18f-b34ccd31e32f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:51.569687 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.569657    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zh9vz\""
Sep 18 13:45:51.577543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.577508    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:51.845592 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.845518    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"]
Sep 18 13:45:51.848877 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:51.848849    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd555ce44_2e52_4391_b18f_b34ccd31e32f.slice/crio-bb3c65f36dc8a67444ffaf995823dca3cfa6d4541ac4c3e9fd1caefd781a9075 WatchSource:0}: Error finding container bb3c65f36dc8a67444ffaf995823dca3cfa6d4541ac4c3e9fd1caefd781a9075: Status 404 returned error can't find the container with id bb3c65f36dc8a67444ffaf995823dca3cfa6d4541ac4c3e9fd1caefd781a9075
Sep 18 13:45:51.900587 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:51.900551    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww" event={"ID":"d555ce44-2e52-4391-b18f-b34ccd31e32f","Type":"ContainerStarted","Data":"bb3c65f36dc8a67444ffaf995823dca3cfa6d4541ac4c3e9fd1caefd781a9075"}
Sep 18 13:45:52.905185 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:52.905152    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww" event={"ID":"d555ce44-2e52-4391-b18f-b34ccd31e32f","Type":"ContainerStarted","Data":"b41fd9fd246abbf1564d3c94e3d1078c233b953d01425bf4e49d40107ea603c9"}
Sep 18 13:45:52.905607 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:52.905285    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:52.909821 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:52.909803    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww"
Sep 18 13:45:52.923143 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:52.923104    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-lshww" podStartSLOduration=0.964646647 podStartE2EDuration="1.923089699s" totalImagesPullingTime="958.443052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:52.92276847 +0000 UTC m=+63.422525998" watchObservedRunningTime="2026-09-18 13:45:52.923089699 +0000 UTC m=+63.422847209"
Sep 18 13:45:53.317050 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.317019    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"]
Sep 18 13:45:53.318837 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.318822    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.321369 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.321341    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 18 13:45:53.321528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.321380    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 18 13:45:53.321528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.321390    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 13:45:53.321528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.321404    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 13:45:53.321528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.321472    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 13:45:53.321703 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.321531    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l82cw\""
Sep 18 13:45:53.329169 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.329146    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"]
Sep 18 13:45:53.424370 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.424331    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/132ef21b-5fb2-4810-8a2c-35cc263c1c49-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.424370 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.424371    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjwg\" (UniqueName: \"kubernetes.io/projected/132ef21b-5fb2-4810-8a2c-35cc263c1c49-kube-api-access-fsjwg\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.424614 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.424400    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/132ef21b-5fb2-4810-8a2c-35cc263c1c49-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.424614 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.424452    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/132ef21b-5fb2-4810-8a2c-35cc263c1c49-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.525669 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.525635    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/132ef21b-5fb2-4810-8a2c-35cc263c1c49-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.525815 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.525715    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/132ef21b-5fb2-4810-8a2c-35cc263c1c49-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.525815 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.525740    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjwg\" (UniqueName: \"kubernetes.io/projected/132ef21b-5fb2-4810-8a2c-35cc263c1c49-kube-api-access-fsjwg\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.525815 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.525759    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/132ef21b-5fb2-4810-8a2c-35cc263c1c49-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.526547 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.526478    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/132ef21b-5fb2-4810-8a2c-35cc263c1c49-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.528194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.528168    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/132ef21b-5fb2-4810-8a2c-35cc263c1c49-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.528378 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.528358    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/132ef21b-5fb2-4810-8a2c-35cc263c1c49-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.535233 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.535204    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjwg\" (UniqueName: \"kubernetes.io/projected/132ef21b-5fb2-4810-8a2c-35cc263c1c49-kube-api-access-fsjwg\") pod \"prometheus-operator-7bd5d56d6-2lrls\" (UID: \"132ef21b-5fb2-4810-8a2c-35cc263c1c49\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.627913 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.627835    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"
Sep 18 13:45:53.899560 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.899485    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls"]
Sep 18 13:45:53.902687 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:53.902661    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132ef21b_5fb2_4810_8a2c_35cc263c1c49.slice/crio-e6be8710c25e03e72dec0bc8c2ff6682be303816c35e4d28b261af14556e40af WatchSource:0}: Error finding container e6be8710c25e03e72dec0bc8c2ff6682be303816c35e4d28b261af14556e40af: Status 404 returned error can't find the container with id e6be8710c25e03e72dec0bc8c2ff6682be303816c35e4d28b261af14556e40af
Sep 18 13:45:53.909513 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:53.909486    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls" event={"ID":"132ef21b-5fb2-4810-8a2c-35cc263c1c49","Type":"ContainerStarted","Data":"e6be8710c25e03e72dec0bc8c2ff6682be303816c35e4d28b261af14556e40af"}
Sep 18 13:45:55.918247 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:55.918210    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls" event={"ID":"132ef21b-5fb2-4810-8a2c-35cc263c1c49","Type":"ContainerStarted","Data":"4ddf49d36f315d8a89a73ce2dca0843666065abb50f264e9db7d36cc878b4fc5"}
Sep 18 13:45:55.918646 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:55.918269    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls" event={"ID":"132ef21b-5fb2-4810-8a2c-35cc263c1c49","Type":"ContainerStarted","Data":"3bf0108bcda0d4ce4828489fcda124411f12a8e49040382ea7e7edf0d80b48c9"}
Sep 18 13:45:55.940905 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:55.940850    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2lrls" podStartSLOduration=1.8498084700000001 podStartE2EDuration="2.940835519s" totalImagesPullingTime="1.091027049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:55.940117545 +0000 UTC m=+66.439875062" watchObservedRunningTime="2026-09-18 13:45:55.940835519 +0000 UTC m=+66.440593034"
Sep 18 13:45:57.349886 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.349848    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:57.349886 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.349888    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:57.350457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.349912    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:57.351993 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.351969    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:45:57.352113 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.352024    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:45:57.352476 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.352458    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:45:57.362562 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.362539    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:45:57.363169 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.363144    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84b66f8e-7942-4042-9efd-70a021a82dcc-original-pull-secret\") pod \"global-pull-secret-syncer-ndscd\" (UID: \"84b66f8e-7942-4042-9efd-70a021a82dcc\") " pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:57.363263 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.363187    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7218af0-ad36-4153-9740-4ee2df7e86e7-metrics-certs\") pod \"network-metrics-daemon-nfxvx\" (UID: \"a7218af0-ad36-4153-9740-4ee2df7e86e7\") " pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:57.374054 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.374030    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5gmp\" (UniqueName: \"kubernetes.io/projected/7029fa72-27cb-488e-bf91-ca6b638d56f2-kube-api-access-q5gmp\") pod \"network-check-target-t25pb\" (UID: \"7029fa72-27cb-488e-bf91-ca6b638d56f2\") " pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:57.452874 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.452818    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndscd"
Sep 18 13:45:57.464749 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.464717    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cttxw\""
Sep 18 13:45:57.472823 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.472798    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nfxvx"
Sep 18 13:45:57.646518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.646441    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7x5xj\""
Sep 18 13:45:57.655296 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.655249    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:45:57.673136 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.673108    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"]
Sep 18 13:45:57.675198 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.675179    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.677228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.677204    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 18 13:45:57.677310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.677275    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 18 13:45:57.677375 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.677357    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-brs9n\""
Sep 18 13:45:57.692997 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.692964    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"]
Sep 18 13:45:57.697146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.697121    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-6blnb"]
Sep 18 13:45:57.699240 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.699225    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.701356 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.701336    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 13:45:57.701500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.701471    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 13:45:57.701564 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.701512    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8fnw9\""
Sep 18 13:45:57.701797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.701777    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 13:45:57.706624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.705825    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5dp2d"]
Sep 18 13:45:57.709688 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.709663    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.712334 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.712306    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 13:45:57.712729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.712710    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h4fd4\""
Sep 18 13:45:57.712965 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.712947    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 13:45:57.714793 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.714769    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-6blnb"]
Sep 18 13:45:57.715055 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.715039    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 13:45:57.730575 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.730547    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ndscd"]
Sep 18 13:45:57.734468 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:57.734443    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b66f8e_7942_4042_9efd_70a021a82dcc.slice/crio-8fd8a5a115ef0ede66193813a5f760ff140ebf401642fb83ba2a41f17a801395 WatchSource:0}: Error finding container 8fd8a5a115ef0ede66193813a5f760ff140ebf401642fb83ba2a41f17a801395: Status 404 returned error can't find the container with id 8fd8a5a115ef0ede66193813a5f760ff140ebf401642fb83ba2a41f17a801395
Sep 18 13:45:57.753001 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:57.752972    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7218af0_ad36_4153_9740_4ee2df7e86e7.slice/crio-21dc5833c7d66f31e93a39e661903438b11b19d4e01273178512c67e7ef0854c WatchSource:0}: Error finding container 21dc5833c7d66f31e93a39e661903438b11b19d4e01273178512c67e7ef0854c: Status 404 returned error can't find the container with id 21dc5833c7d66f31e93a39e661903438b11b19d4e01273178512c67e7ef0854c
Sep 18 13:45:57.758787 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.758768    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nfxvx"]
Sep 18 13:45:57.853780 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853742    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57ca3ede-b204-497b-b8a6-2e4553956f59-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.853780 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853778    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plgjq\" (UniqueName: \"kubernetes.io/projected/6c517134-a308-4f7a-9873-20711558c4bf-kube-api-access-plgjq\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.853992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853801    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c517134-a308-4f7a-9873-20711558c4bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.853992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853819    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.853992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853871    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.853992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853892    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-textfile\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.853992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853914    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-wtmp\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.853992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.853976    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c517134-a308-4f7a-9873-20711558c4bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854022    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpcz\" (UniqueName: \"kubernetes.io/projected/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-api-access-2cpcz\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854053    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91a04d31-8407-43af-9fd0-80930a4aa722-metrics-client-ca\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854075    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8jpt\" (UniqueName: \"kubernetes.io/projected/91a04d31-8407-43af-9fd0-80930a4aa722-kube-api-access-s8jpt\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854104    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854125    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-tls\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854140    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c517134-a308-4f7a-9873-20711558c4bf-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.854171 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854155    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-sys\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.854400 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854180    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.854400 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854209    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-accelerators-collector-config\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.854400 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854243    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ca3ede-b204-497b-b8a6-2e4553956f59-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.854400 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.854257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-root\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.926223 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.926116    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ndscd" event={"ID":"84b66f8e-7942-4042-9efd-70a021a82dcc","Type":"ContainerStarted","Data":"8fd8a5a115ef0ede66193813a5f760ff140ebf401642fb83ba2a41f17a801395"}
Sep 18 13:45:57.927256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.927233    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nfxvx" event={"ID":"a7218af0-ad36-4153-9740-4ee2df7e86e7","Type":"ContainerStarted","Data":"21dc5833c7d66f31e93a39e661903438b11b19d4e01273178512c67e7ef0854c"}
Sep 18 13:45:57.933445 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.933376    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t25pb"]
Sep 18 13:45:57.937082 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:57.937059    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7029fa72_27cb_488e_bf91_ca6b638d56f2.slice/crio-f2c73bcafead32487f82b7759bf0f5d18bb1c1cc6afeffa70c970719de18df5f WatchSource:0}: Error finding container f2c73bcafead32487f82b7759bf0f5d18bb1c1cc6afeffa70c970719de18df5f: Status 404 returned error can't find the container with id f2c73bcafead32487f82b7759bf0f5d18bb1c1cc6afeffa70c970719de18df5f
Sep 18 13:45:57.955035 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955011    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpcz\" (UniqueName: \"kubernetes.io/projected/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-api-access-2cpcz\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.955154 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955051    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91a04d31-8407-43af-9fd0-80930a4aa722-metrics-client-ca\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955154 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955071    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8jpt\" (UniqueName: \"kubernetes.io/projected/91a04d31-8407-43af-9fd0-80930a4aa722-kube-api-access-s8jpt\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955237 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955163    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.955237 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955196    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-tls\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955237 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955217    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c517134-a308-4f7a-9873-20711558c4bf-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.955431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-sys\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955277    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955302    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-accelerators-collector-config\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955337    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ca3ede-b204-497b-b8a6-2e4553956f59-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.955431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955359    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-root\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955431 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955391    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57ca3ede-b204-497b-b8a6-2e4553956f59-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955438    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plgjq\" (UniqueName: \"kubernetes.io/projected/6c517134-a308-4f7a-9873-20711558c4bf-kube-api-access-plgjq\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955468    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c517134-a308-4f7a-9873-20711558c4bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955492    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955522    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955561    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-textfile\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955583    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-wtmp\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.955727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955612    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c517134-a308-4f7a-9873-20711558c4bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.956112 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955746    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91a04d31-8407-43af-9fd0-80930a4aa722-metrics-client-ca\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.956112 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955887    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-accelerators-collector-config\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.956112 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955963    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-root\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.956865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.955807    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-sys\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.956865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.956404    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.956865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.956671    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ca3ede-b204-497b-b8a6-2e4553956f59-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.956865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.956809    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c517134-a308-4f7a-9873-20711558c4bf-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.956865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.956815    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57ca3ede-b204-497b-b8a6-2e4553956f59-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.956865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.956829    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-textfile\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.957186 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.956962    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-wtmp\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.958313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.958286    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-tls\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.958578 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.958559    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c517134-a308-4f7a-9873-20711558c4bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.958646 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.958606    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c517134-a308-4f7a-9873-20711558c4bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.958721 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.958705    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91a04d31-8407-43af-9fd0-80930a4aa722-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.959086 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.959065    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.959162 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.959134    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.964143 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.964118    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpcz\" (UniqueName: \"kubernetes.io/projected/57ca3ede-b204-497b-b8a6-2e4553956f59-kube-api-access-2cpcz\") pod \"kube-state-metrics-84c885658c-6blnb\" (UID: \"57ca3ede-b204-497b-b8a6-2e4553956f59\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:57.964483 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.964468    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8jpt\" (UniqueName: \"kubernetes.io/projected/91a04d31-8407-43af-9fd0-80930a4aa722-kube-api-access-s8jpt\") pod \"node-exporter-5dp2d\" (UID: \"91a04d31-8407-43af-9fd0-80930a4aa722\") " pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:57.964698 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.964682    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plgjq\" (UniqueName: \"kubernetes.io/projected/6c517134-a308-4f7a-9873-20711558c4bf-kube-api-access-plgjq\") pod \"openshift-state-metrics-86c5bc79d6-b9r6t\" (UID: \"6c517134-a308-4f7a-9873-20711558c4bf\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:57.984668 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:57.984639    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"
Sep 18 13:45:58.012492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.012456    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb"
Sep 18 13:45:58.023839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.023814    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5dp2d"
Sep 18 13:45:58.256121 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.256034    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t"]
Sep 18 13:45:58.259759 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:58.259723    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c517134_a308_4f7a_9873_20711558c4bf.slice/crio-28ef4375bb6de16679aff494e3e4ec7ea656f93e387bcc713f3ca153d8c75767 WatchSource:0}: Error finding container 28ef4375bb6de16679aff494e3e4ec7ea656f93e387bcc713f3ca153d8c75767: Status 404 returned error can't find the container with id 28ef4375bb6de16679aff494e3e4ec7ea656f93e387bcc713f3ca153d8c75767
Sep 18 13:45:58.299114 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.299086    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-6blnb"]
Sep 18 13:45:58.304455 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:45:58.304400    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ca3ede_b204_497b_b8a6_2e4553956f59.slice/crio-a1a49429df0972856757b364e30e722c0b1b12b5fd7acd7b00c46741c3215f92 WatchSource:0}: Error finding container a1a49429df0972856757b364e30e722c0b1b12b5fd7acd7b00c46741c3215f92: Status 404 returned error can't find the container with id a1a49429df0972856757b364e30e722c0b1b12b5fd7acd7b00c46741c3215f92
Sep 18 13:45:58.797071 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.797032    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:45:58.804464 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.804406    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.807882 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.807645    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.808118    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.808268    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.808381    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.808625    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.808789    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h6zlv\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.808952    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.809125    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 13:45:58.809450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.809308    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 13:45:58.810696 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.810401    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 13:45:58.833586 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.833499    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:45:58.934931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.934891    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t" event={"ID":"6c517134-a308-4f7a-9873-20711558c4bf","Type":"ContainerStarted","Data":"2807ec00eb7507dcfec00795c772b6342b93cb6a86b56231b4f59c1d2ca4a95f"}
Sep 18 13:45:58.935099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.934968    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t" event={"ID":"6c517134-a308-4f7a-9873-20711558c4bf","Type":"ContainerStarted","Data":"13d63169f0c9e8dd09e49f6cdc63ce53b4ce78e26e5978d579d96e7db01b4517"}
Sep 18 13:45:58.935099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.935000    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t" event={"ID":"6c517134-a308-4f7a-9873-20711558c4bf","Type":"ContainerStarted","Data":"28ef4375bb6de16679aff494e3e4ec7ea656f93e387bcc713f3ca153d8c75767"}
Sep 18 13:45:58.937807 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.937753    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dp2d" event={"ID":"91a04d31-8407-43af-9fd0-80930a4aa722","Type":"ContainerStarted","Data":"9d991d05ee84a7da3f2e91f995be6da81f6a3828cfe158317b23b94a37d5c913"}
Sep 18 13:45:58.940811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.940781    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb" event={"ID":"57ca3ede-b204-497b-b8a6-2e4553956f59","Type":"ContainerStarted","Data":"a1a49429df0972856757b364e30e722c0b1b12b5fd7acd7b00c46741c3215f92"}
Sep 18 13:45:58.942610 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.942586    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t25pb" event={"ID":"7029fa72-27cb-488e-bf91-ca6b638d56f2","Type":"ContainerStarted","Data":"f2c73bcafead32487f82b7759bf0f5d18bb1c1cc6afeffa70c970719de18df5f"}
Sep 18 13:45:58.962528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962269    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962326    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-config-out\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962355    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962380    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962407    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962570    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962603    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962643    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962682    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962712    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962734    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-web-config\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962759    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtp2h\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-kube-api-access-xtp2h\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:58.962985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:58.962787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063677    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063742    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-config-out\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063769    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063807    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063834    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063905    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063942    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.063979    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.064010    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.064071    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-web-config\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.064097    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtp2h\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-kube-api-access-xtp2h\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.064825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.064130    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.067068 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.064998    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.067068 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.066536    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.068169 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.067831    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.072001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.071563    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.072001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.071938    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-web-config\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.072001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.071943    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.072793 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.072495    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-config-out\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.073753 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.073723    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.074549 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.074529    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.075401 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.075380    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.076693 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.076656    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.077601 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.077579    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.078681 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.078642    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtp2h\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-kube-api-access-xtp2h\") pod \"alertmanager-main-0\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.123329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.123290    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:45:59.518964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.518921    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846887dfbb-fp6qj"]
Sep 18 13:45:59.522065 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.521341    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.524377 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.524036    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 13:45:59.524570 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.524543    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r6kn9\""
Sep 18 13:45:59.525002 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.524763    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 13:45:59.525002 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.524788    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 13:45:59.525002 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.524791    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 13:45:59.525002 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.524769    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 13:45:59.525448 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.525404    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 13:45:59.525664 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.525648    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 13:45:59.541043 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.540968    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846887dfbb-fp6qj"]
Sep 18 13:45:59.668983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.668670    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-serving-cert\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.668983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.668720    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckl2n\" (UniqueName: \"kubernetes.io/projected/4e055b75-4611-4448-8729-805a75ce48a8-kube-api-access-ckl2n\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.668983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.668768    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-oauth-serving-cert\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.668983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.668799    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-oauth-config\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.668983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.668822    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-service-ca\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.668983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.668859    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-console-config\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.692766 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.692643    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"]
Sep 18 13:45:59.696220 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.696164    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.702718 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.702686    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z6clt\""
Sep 18 13:45:59.703115 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.703031    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 13:45:59.703276 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.703256    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-chbtlvrl7niqa\""
Sep 18 13:45:59.704303 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.704096    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 13:45:59.704303 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.704129    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 13:45:59.704596 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.704574    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 13:45:59.705022 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.704890    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 13:45:59.720439 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.720387    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"]
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.769313    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-serving-cert\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.769363    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckl2n\" (UniqueName: \"kubernetes.io/projected/4e055b75-4611-4448-8729-805a75ce48a8-kube-api-access-ckl2n\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.769406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-oauth-serving-cert\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.769447    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-oauth-config\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.769471    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-service-ca\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.769503    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-console-config\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.770493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.770315    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-console-config\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.780817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.780538    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-oauth-serving-cert\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.780817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.780766    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-service-ca\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.785876 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.785844    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-serving-cert\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.793721 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.793591    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-oauth-config\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.794157 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.794108    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckl2n\" (UniqueName: \"kubernetes.io/projected/4e055b75-4611-4448-8729-805a75ce48a8-kube-api-access-ckl2n\") pod \"console-846887dfbb-fp6qj\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") " pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.834440 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.834116    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:45:59.870346 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870293    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8nq8\" (UniqueName: \"kubernetes.io/projected/cd8773e0-c384-428b-8766-88b19277968f-kube-api-access-b8nq8\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870537 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870360    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870537 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870430    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-tls\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870537 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870459    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd8773e0-c384-428b-8766-88b19277968f-metrics-client-ca\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870537 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870491    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870537 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870507    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-grpc-tls\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870810 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870541    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.870810 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.870562    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.898465 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.898437    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4zk86"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971204    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971271    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-tls\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971302    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd8773e0-c384-428b-8766-88b19277968f-metrics-client-ca\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971337    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971363    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-grpc-tls\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971402    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971452    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.972310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.971504    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8nq8\" (UniqueName: \"kubernetes.io/projected/cd8773e0-c384-428b-8766-88b19277968f-kube-api-access-b8nq8\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.974326 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.974273    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd8773e0-c384-428b-8766-88b19277968f-metrics-client-ca\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.978199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.977470    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.978199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.978000    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-tls\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.978199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.978118    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.978521 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.978475    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.979066 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.979021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.979471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.979334    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd8773e0-c384-428b-8766-88b19277968f-secret-grpc-tls\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:45:59.987015 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:45:59.986983    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8nq8\" (UniqueName: \"kubernetes.io/projected/cd8773e0-c384-428b-8766-88b19277968f-kube-api-access-b8nq8\") pod \"thanos-querier-f4f75dfc4-pjnrn\" (UID: \"cd8773e0-c384-428b-8766-88b19277968f\") " pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:46:00.012645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.012606    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:46:00.391574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.391354    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:46:00.437211 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:46:00.436603    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d947c40_8913_4afe_8aca_202c2134753d.slice/crio-527004edd982a56590589cf9d6041ff6b51b57b2c1f6819d00cf4b3d217f011b WatchSource:0}: Error finding container 527004edd982a56590589cf9d6041ff6b51b57b2c1f6819d00cf4b3d217f011b: Status 404 returned error can't find the container with id 527004edd982a56590589cf9d6041ff6b51b57b2c1f6819d00cf4b3d217f011b
Sep 18 13:46:00.763549 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.763468    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846887dfbb-fp6qj"]
Sep 18 13:46:00.811790 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.809867    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"]
Sep 18 13:46:00.956795 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.956667    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"f41cbd9cafcf14f8105d5301d5987501fa82382a10f2221aae3a6d51781e1aa8"}
Sep 18 13:46:00.959523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.959351    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nfxvx" event={"ID":"a7218af0-ad36-4153-9740-4ee2df7e86e7","Type":"ContainerStarted","Data":"77f519a8d5c6ff5347431790fb013beed7b312b6c7c000ff08f5a7e6d723f047"}
Sep 18 13:46:00.959523 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.959405    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nfxvx" event={"ID":"a7218af0-ad36-4153-9740-4ee2df7e86e7","Type":"ContainerStarted","Data":"95d330c8b5ce53a95baee362623abe15d1bca2ac66cad0a2d2ee67548697dcae"}
Sep 18 13:46:00.962445 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.962150    2585 generic.go:356] "Generic (PLEG): container finished" podID="91a04d31-8407-43af-9fd0-80930a4aa722" containerID="b30d16474d8751636e033352b21669a52472abbbd845c5bccfa19e9b4d677a65" exitCode=0
Sep 18 13:46:00.962445 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.962219    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dp2d" event={"ID":"91a04d31-8407-43af-9fd0-80930a4aa722","Type":"ContainerDied","Data":"b30d16474d8751636e033352b21669a52472abbbd845c5bccfa19e9b4d677a65"}
Sep 18 13:46:00.966559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.966272    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"527004edd982a56590589cf9d6041ff6b51b57b2c1f6819d00cf4b3d217f011b"}
Sep 18 13:46:00.970842 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.970698    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb" event={"ID":"57ca3ede-b204-497b-b8a6-2e4553956f59","Type":"ContainerStarted","Data":"a6ccac7beaf3e253d5502a6212125b153f6db720f136efe45fb83d7622591ac1"}
Sep 18 13:46:00.970842 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.970754    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb" event={"ID":"57ca3ede-b204-497b-b8a6-2e4553956f59","Type":"ContainerStarted","Data":"8197a84a9d4768b14a9bded7639533c1f7ea8ff89405910295c8ac82b53edf6a"}
Sep 18 13:46:00.970842 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.970784    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb" event={"ID":"57ca3ede-b204-497b-b8a6-2e4553956f59","Type":"ContainerStarted","Data":"f03f84d6ee631bb4a44ce422306f9132b2e35b0070ce8284f8a86654c5e56d10"}
Sep 18 13:46:00.972875 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.972850    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846887dfbb-fp6qj" event={"ID":"4e055b75-4611-4448-8729-805a75ce48a8","Type":"ContainerStarted","Data":"cf2cada3c916904e28b598b4acfed3d0cc8de3978bf78bc54d2ffa3876448173"}
Sep 18 13:46:00.977743 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.977694    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nfxvx" podStartSLOduration=66.292660485 podStartE2EDuration="1m8.977674353s" totalImagesPullingTime="2.685013868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:00.975315039 +0000 UTC m=+71.475072563" watchObservedRunningTime="2026-09-18 13:46:00.977674353 +0000 UTC m=+71.477431870"
Sep 18 13:46:00.979673 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.979617    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t" event={"ID":"6c517134-a308-4f7a-9873-20711558c4bf","Type":"ContainerStarted","Data":"93d38d9487456bda633a720a4a09ba9181f04b8891bba6ac4912a9846f190396"}
Sep 18 13:46:00.994742 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:00.993396    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-6blnb" podStartSLOduration=1.859799378 podStartE2EDuration="3.993375787s" totalImagesPullingTime="2.133576409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:00.992646993 +0000 UTC m=+71.492404509" watchObservedRunningTime="2026-09-18 13:46:00.993375787 +0000 UTC m=+71.493133320"
Sep 18 13:46:01.036954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:01.036542    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-b9r6t" podStartSLOduration=1.954901031 podStartE2EDuration="4.036523156s" totalImagesPullingTime="2.081622125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:01.035844468 +0000 UTC m=+71.535601999" watchObservedRunningTime="2026-09-18 13:46:01.036523156 +0000 UTC m=+71.536280695"
Sep 18 13:46:02.053766 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.053630    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bc7f59784-xqgtz"]
Sep 18 13:46:02.055838 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.055817    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.058047 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.058020    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 18 13:46:02.058173 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.058092    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 18 13:46:02.058482 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.058465    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 13:46:02.058873 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.058845    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d35c4f3bjqbmv\""
Sep 18 13:46:02.058972 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.058887    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 18 13:46:02.058972 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.058961    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pmxgn\""
Sep 18 13:46:02.068942 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.068916    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bc7f59784-xqgtz"]
Sep 18 13:46:02.194018 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.193982    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c12235-a374-4f3c-9ffa-63875b4e3220-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.194018 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.194023    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-client-ca-bundle\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.194268 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.194087    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs22c\" (UniqueName: \"kubernetes.io/projected/b5c12235-a374-4f3c-9ffa-63875b4e3220-kube-api-access-xs22c\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.194268 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.194145    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b5c12235-a374-4f3c-9ffa-63875b4e3220-metrics-server-audit-profiles\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.194268 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.194190    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-secret-metrics-server-tls\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.194268 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.194228    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b5c12235-a374-4f3c-9ffa-63875b4e3220-audit-log\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.194268 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.194261    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-secret-metrics-server-client-certs\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295023 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.294976    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-secret-metrics-server-client-certs\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295053    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c12235-a374-4f3c-9ffa-63875b4e3220-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295075    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-client-ca-bundle\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295105    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs22c\" (UniqueName: \"kubernetes.io/projected/b5c12235-a374-4f3c-9ffa-63875b4e3220-kube-api-access-xs22c\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295132    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b5c12235-a374-4f3c-9ffa-63875b4e3220-metrics-server-audit-profiles\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295157    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-secret-metrics-server-tls\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295184    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b5c12235-a374-4f3c-9ffa-63875b4e3220-audit-log\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.295830 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.295631    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b5c12235-a374-4f3c-9ffa-63875b4e3220-audit-log\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.296140 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.296121    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c12235-a374-4f3c-9ffa-63875b4e3220-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.296266 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.296245    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b5c12235-a374-4f3c-9ffa-63875b4e3220-metrics-server-audit-profiles\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.298227 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.298183    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-secret-metrics-server-client-certs\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.298652 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.298630    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-secret-metrics-server-tls\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.299149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.299125    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5c12235-a374-4f3c-9ffa-63875b4e3220-client-ca-bundle\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.304954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.304897    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs22c\" (UniqueName: \"kubernetes.io/projected/b5c12235-a374-4f3c-9ffa-63875b4e3220-kube-api-access-xs22c\") pod \"metrics-server-5bc7f59784-xqgtz\" (UID: \"b5c12235-a374-4f3c-9ffa-63875b4e3220\") " pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.367277 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.367248    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:02.469794 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.468392    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"]
Sep 18 13:46:02.471674 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.471292    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:02.475041 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.473387    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k5rxj\""
Sep 18 13:46:02.475041 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.473683    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 13:46:02.480950 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.480915    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"]
Sep 18 13:46:02.596945 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.596823    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkr4p\" (UniqueName: \"kubernetes.io/projected/de53dcc7-67ed-4179-8b1a-d8e731d51027-kube-api-access-dkr4p\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:02.596945 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.596923    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de53dcc7-67ed-4179-8b1a-d8e731d51027-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:02.698185 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.697703    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr4p\" (UniqueName: \"kubernetes.io/projected/de53dcc7-67ed-4179-8b1a-d8e731d51027-kube-api-access-dkr4p\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:02.698185 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.697768    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de53dcc7-67ed-4179-8b1a-d8e731d51027-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:02.698880 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:46:02.697971    2585 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 18 13:46:02.698880 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:46:02.698640    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de53dcc7-67ed-4179-8b1a-d8e731d51027-monitoring-plugin-cert podName:de53dcc7-67ed-4179-8b1a-d8e731d51027 nodeName:}" failed. No retries permitted until 2026-09-18 13:46:03.198614503 +0000 UTC m=+73.698372010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/de53dcc7-67ed-4179-8b1a-d8e731d51027-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-qmwpv" (UID: "de53dcc7-67ed-4179-8b1a-d8e731d51027") : secret "monitoring-plugin-cert" not found
Sep 18 13:46:02.708316 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:02.708284    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkr4p\" (UniqueName: \"kubernetes.io/projected/de53dcc7-67ed-4179-8b1a-d8e731d51027-kube-api-access-dkr4p\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:03.204651 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:03.204609    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de53dcc7-67ed-4179-8b1a-d8e731d51027-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:03.207964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:03.207939    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de53dcc7-67ed-4179-8b1a-d8e731d51027-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-qmwpv\" (UID: \"de53dcc7-67ed-4179-8b1a-d8e731d51027\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:03.387516 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:03.387470    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:04.052079 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.052041    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:46:04.058794 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.058765    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.061181 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061154    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 13:46:04.061326 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061195    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2dpgcmdunhp4c\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061479    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061538    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061636    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061647    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061694    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061745    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061756    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061787    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061817    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 13:46:04.061956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.061948    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 13:46:04.062522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.062025    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2fl6v\""
Sep 18 13:46:04.062522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.062081    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 13:46:04.064631 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.064612    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 13:46:04.065677 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.065659    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 13:46:04.072954 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.072931    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:46:04.222041 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222000    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222053    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222142    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222192    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222232    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222260    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222288    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222316    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222338    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222387    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-config\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222472    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222490    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222511    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222541    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222652    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222696    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222720    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkbs\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-kube-api-access-fpkbs\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.222964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.222753    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.323860    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-config\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.323903    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.323931    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.323960    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.323995    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324020    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324046    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324089    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324113    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkbs\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-kube-api-access-fpkbs\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324146    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324192    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324213    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324243    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324270    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324301    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324326    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.326355 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324357    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.327559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324381    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.327559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324401    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.327559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.324443    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.327559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.325739    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.327559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.326991    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.332491 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.332466    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.332598 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.332552    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.333656 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.333632    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.333850 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.333827    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.334146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.334123    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.334220 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.334198    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.334327 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.334304    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.336140 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.336093    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.336678 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.336635    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.336770 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.336750    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.338387 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.338339    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.343128 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.342958    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.343935 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.343634    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.355498 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.355379    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkbs\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-kube-api-access-fpkbs\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.371194 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.371124    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.371884 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.371832    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-config\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.372396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.372331    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.375890 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.375845    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:04.549855 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.548787    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"]
Sep 18 13:46:04.561510 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.561248    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bc7f59784-xqgtz"]
Sep 18 13:46:04.674159 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:04.673793    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:05.117382 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:46:05.117297    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c12235_a374_4f3c_9ffa_63875b4e3220.slice/crio-07119302bc6c0237b658f7dee717eb7d4f61e2e983b7e0d7c9406f7b3215d784 WatchSource:0}: Error finding container 07119302bc6c0237b658f7dee717eb7d4f61e2e983b7e0d7c9406f7b3215d784: Status 404 returned error can't find the container with id 07119302bc6c0237b658f7dee717eb7d4f61e2e983b7e0d7c9406f7b3215d784
Sep 18 13:46:05.119805 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:46:05.119767    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde53dcc7_67ed_4179_8b1a_d8e731d51027.slice/crio-77864ea6670beec140b3afed126a47776b882bdcff5fe6c19f1e94a42e21b91f WatchSource:0}: Error finding container 77864ea6670beec140b3afed126a47776b882bdcff5fe6c19f1e94a42e21b91f: Status 404 returned error can't find the container with id 77864ea6670beec140b3afed126a47776b882bdcff5fe6c19f1e94a42e21b91f
Sep 18 13:46:05.423749 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:05.423724    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:46:06.008284 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.008239    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dp2d" event={"ID":"91a04d31-8407-43af-9fd0-80930a4aa722","Type":"ContainerStarted","Data":"e9f07ef74099ff15a19f9672a899fb9f94e5a21116f64ea5813b2ae1063bd77a"}
Sep 18 13:46:06.008482 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.008319    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dp2d" event={"ID":"91a04d31-8407-43af-9fd0-80930a4aa722","Type":"ContainerStarted","Data":"c09f246ace9c050721ff6c785e1922da7a29d0d4f0432a343df541cfe639e0ff"}
Sep 18 13:46:06.011329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.011293    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b"}
Sep 18 13:46:06.014572 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.014540    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t25pb" event={"ID":"7029fa72-27cb-488e-bf91-ca6b638d56f2","Type":"ContainerStarted","Data":"31055fca08c7c31acdd01fe32de3b4383c1cf059669e01f13bf3368ba2f72da9"}
Sep 18 13:46:06.014709 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.014616    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:46:06.016201 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.016173    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz" event={"ID":"b5c12235-a374-4f3c-9ffa-63875b4e3220","Type":"ContainerStarted","Data":"07119302bc6c0237b658f7dee717eb7d4f61e2e983b7e0d7c9406f7b3215d784"}
Sep 18 13:46:06.017880 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.017855    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ndscd" event={"ID":"84b66f8e-7942-4042-9efd-70a021a82dcc","Type":"ContainerStarted","Data":"d2bca21655ac7ea98d41573569d98b26cdd0b544b5e9ce82cf8b27a0cdde0627"}
Sep 18 13:46:06.019823 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.019797    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"3cda9e5ebc157b85a99319b1a1c392be81d68419e5f2cf16453c0fd73fff1b05"}
Sep 18 13:46:06.025165 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.025128    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv" event={"ID":"de53dcc7-67ed-4179-8b1a-d8e731d51027","Type":"ContainerStarted","Data":"77864ea6670beec140b3afed126a47776b882bdcff5fe6c19f1e94a42e21b91f"}
Sep 18 13:46:06.032314 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.032254    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5dp2d" podStartSLOduration=6.489246147 podStartE2EDuration="9.032237498s" totalImagesPullingTime="2.399897749s" totalInitContainerRuntime="143.093602ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:06.031016417 +0000 UTC m=+76.530773952" watchObservedRunningTime="2026-09-18 13:46:06.032237498 +0000 UTC m=+76.531995015"
Sep 18 13:46:06.084388 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.084314    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t25pb" podStartSLOduration=68.76155681 podStartE2EDuration="1m15.084293784s" totalImagesPullingTime="6.322736974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:06.083254387 +0000 UTC m=+76.583011903" watchObservedRunningTime="2026-09-18 13:46:06.084293784 +0000 UTC m=+76.584051300"
Sep 18 13:46:06.101311 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:06.101229    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ndscd" podStartSLOduration=66.713563687 podStartE2EDuration="1m14.101210103s" totalImagesPullingTime="7.387646416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:06.10023445 +0000 UTC m=+76.599991966" watchObservedRunningTime="2026-09-18 13:46:06.101210103 +0000 UTC m=+76.600967621"
Sep 18 13:46:06.195773 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:46:06.195612    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21cca0a_627e_414d_acf3_72586b48b09f.slice/crio-7dc75ae4ac8324fc55a8172e3106b35b3284ffcd4c3e0d80759f859bc133579c WatchSource:0}: Error finding container 7dc75ae4ac8324fc55a8172e3106b35b3284ffcd4c3e0d80759f859bc133579c: Status 404 returned error can't find the container with id 7dc75ae4ac8324fc55a8172e3106b35b3284ffcd4c3e0d80759f859bc133579c
Sep 18 13:46:07.030932 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:07.030890    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b" exitCode=0
Sep 18 13:46:07.031403 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:07.030936    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b"}
Sep 18 13:46:07.032477 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:07.032449    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"7dc75ae4ac8324fc55a8172e3106b35b3284ffcd4c3e0d80759f859bc133579c"}
Sep 18 13:46:09.043787 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:09.043746    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"b34d068e91f1ecc9977319da7efff007ffb952766efbba893485831762b56d58"}
Sep 18 13:46:10.051353 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.051256    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"40c66e68186406457cc797a161e50afde75b515bd5ea6e74f3a939b6047e7522"}
Sep 18 13:46:10.053111 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.053078    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv" event={"ID":"de53dcc7-67ed-4179-8b1a-d8e731d51027","Type":"ContainerStarted","Data":"6c1a4a099904ce8432d399245317361359aa1ab1ec7778a082a9fb06d43d83d5"}
Sep 18 13:46:10.053249 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.053153    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:10.057368 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.057334    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b"}
Sep 18 13:46:10.057553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.057449    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec"}
Sep 18 13:46:10.057553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.057495    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6"}
Sep 18 13:46:10.057553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.057534    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4"}
Sep 18 13:46:10.057698 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.057572    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988"}
Sep 18 13:46:10.059745 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.059717    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76" exitCode=0
Sep 18 13:46:10.059903 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.059797    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"}
Sep 18 13:46:10.060057 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.060037    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv"
Sep 18 13:46:10.061748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.061724    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846887dfbb-fp6qj" event={"ID":"4e055b75-4611-4448-8729-805a75ce48a8","Type":"ContainerStarted","Data":"6d7c45a084d9feb34e7ece20fd02b5023b4f68bd809e9dd8dd50f56e353302df"}
Sep 18 13:46:10.063726 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.063701    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz" event={"ID":"b5c12235-a374-4f3c-9ffa-63875b4e3220","Type":"ContainerStarted","Data":"61bb6818ee9e17b4ac0dffb779e27b7314062d15240ddb7707514ed722239175"}
Sep 18 13:46:10.069571 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.069520    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-qmwpv" podStartSLOduration=3.899823741 podStartE2EDuration="8.069500004s" totalImagesPullingTime="4.169676263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:10.0679338 +0000 UTC m=+80.567691353" watchObservedRunningTime="2026-09-18 13:46:10.069500004 +0000 UTC m=+80.569257517"
Sep 18 13:46:10.086714 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.086630    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846887dfbb-fp6qj" podStartSLOduration=2.587281735 podStartE2EDuration="11.086612841s" totalImagesPullingTime="8.499331106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:10.08537872 +0000 UTC m=+80.585136237" watchObservedRunningTime="2026-09-18 13:46:10.086612841 +0000 UTC m=+80.586370356"
Sep 18 13:46:10.153782 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:10.153710    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz" podStartSLOduration=3.985014723 podStartE2EDuration="8.153685785s" totalImagesPullingTime="4.168671062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:10.150606222 +0000 UTC m=+80.650363735" watchObservedRunningTime="2026-09-18 13:46:10.153685785 +0000 UTC m=+80.653443302"
Sep 18 13:46:11.072866 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:11.072828    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerStarted","Data":"788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0"}
Sep 18 13:46:11.077172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:11.076600    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"38548d8ac67f128a5feea9d3125a1f8188768750395691c10341654186c58a49"}
Sep 18 13:46:11.077172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:11.076683    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"43ac3c0d9c503c2c544e6ee0e242697cd31e54af55231387be174df2bff50684"}
Sep 18 13:46:11.077172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:11.076727    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" event={"ID":"cd8773e0-c384-428b-8766-88b19277968f","Type":"ContainerStarted","Data":"dcd7d0204daa3d483ad0122ef60ec386391515e9ed8a3746610a75a5b86bf59c"}
Sep 18 13:46:11.103101 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:11.101816    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.610027821 podStartE2EDuration="13.101790694s" totalImagesPullingTime="6.468360512s" totalInitContainerRuntime="23.402361ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:11.099548354 +0000 UTC m=+81.599305873" watchObservedRunningTime="2026-09-18 13:46:11.101790694 +0000 UTC m=+81.601548211"
Sep 18 13:46:11.161449 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:11.161338    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn" podStartSLOduration=7.086636739 podStartE2EDuration="12.161314832s" totalImagesPullingTime="5.074678093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:11.15439256 +0000 UTC m=+81.654150075" watchObservedRunningTime="2026-09-18 13:46:11.161314832 +0000 UTC m=+81.661072349"
Sep 18 13:46:12.083494 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:12.083464    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:46:13.090133 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:13.089950    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"}
Sep 18 13:46:13.090133 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:13.090043    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"}
Sep 18 13:46:13.090133 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:13.090083    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"}
Sep 18 13:46:13.101593 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:13.101363    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f4f75dfc4-pjnrn"
Sep 18 13:46:14.101147 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:14.101091    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"}
Sep 18 13:46:14.101797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:14.101761    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"}
Sep 18 13:46:14.101966 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:14.101816    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerStarted","Data":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"}
Sep 18 13:46:14.130370 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:14.130314    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.35318085 podStartE2EDuration="10.13029105s" totalImagesPullingTime="2.74958803s" totalInitContainerRuntime="27.52217ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:14.129533186 +0000 UTC m=+84.629290702" watchObservedRunningTime="2026-09-18 13:46:14.13029105 +0000 UTC m=+84.630048568"
Sep 18 13:46:14.674239 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:14.674204    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:46:16.778720 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:16.778679    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846887dfbb-fp6qj"]
Sep 18 13:46:19.835221 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:19.835184    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:46:22.368306 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:22.368266    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:22.368704 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:22.368329    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:30.254115 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:30.254084    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbg95_ab7c2cf7-0685-45d0-9266-7ee4ed4e9092/serve-healthcheck-canary/0.log"
Sep 18 13:46:37.035210 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:37.035173    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t25pb"
Sep 18 13:46:41.798324 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:41.798261    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-846887dfbb-fp6qj" podUID="4e055b75-4611-4448-8729-805a75ce48a8" containerName="console" containerID="cri-o://6d7c45a084d9feb34e7ece20fd02b5023b4f68bd809e9dd8dd50f56e353302df" gracePeriod=15
Sep 18 13:46:42.226207 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.226171    2585 generic.go:356] "Generic (PLEG): container finished" podID="4e055b75-4611-4448-8729-805a75ce48a8" containerID="6d7c45a084d9feb34e7ece20fd02b5023b4f68bd809e9dd8dd50f56e353302df" exitCode=0
Sep 18 13:46:42.226377 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.226234    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846887dfbb-fp6qj" event={"ID":"4e055b75-4611-4448-8729-805a75ce48a8","Type":"ContainerDied","Data":"6d7c45a084d9feb34e7ece20fd02b5023b4f68bd809e9dd8dd50f56e353302df"}
Sep 18 13:46:42.380162 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.378869    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:42.384842 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.384818    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bc7f59784-xqgtz"
Sep 18 13:46:42.611995 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.611671    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:46:42.773310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.773215    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-serving-cert\") pod \"4e055b75-4611-4448-8729-805a75ce48a8\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") "
Sep 18 13:46:42.773756 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.773735    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-oauth-serving-cert\") pod \"4e055b75-4611-4448-8729-805a75ce48a8\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") "
Sep 18 13:46:42.774242 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.774168    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e055b75-4611-4448-8729-805a75ce48a8" (UID: "4e055b75-4611-4448-8729-805a75ce48a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:42.775470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.774471    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckl2n\" (UniqueName: \"kubernetes.io/projected/4e055b75-4611-4448-8729-805a75ce48a8-kube-api-access-ckl2n\") pod \"4e055b75-4611-4448-8729-805a75ce48a8\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") "
Sep 18 13:46:42.775470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.774516    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-service-ca\") pod \"4e055b75-4611-4448-8729-805a75ce48a8\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") "
Sep 18 13:46:42.775470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.774592    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-oauth-config\") pod \"4e055b75-4611-4448-8729-805a75ce48a8\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") "
Sep 18 13:46:42.775470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.774641    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-console-config\") pod \"4e055b75-4611-4448-8729-805a75ce48a8\" (UID: \"4e055b75-4611-4448-8729-805a75ce48a8\") "
Sep 18 13:46:42.775470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.774947    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-oauth-serving-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:46:42.776428 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.776085    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e055b75-4611-4448-8729-805a75ce48a8" (UID: "4e055b75-4611-4448-8729-805a75ce48a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:42.776428 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.776371    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-console-config" (OuterVolumeSpecName: "console-config") pod "4e055b75-4611-4448-8729-805a75ce48a8" (UID: "4e055b75-4611-4448-8729-805a75ce48a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:42.780676 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.780621    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e055b75-4611-4448-8729-805a75ce48a8" (UID: "4e055b75-4611-4448-8729-805a75ce48a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:42.781118 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.780873    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e055b75-4611-4448-8729-805a75ce48a8" (UID: "4e055b75-4611-4448-8729-805a75ce48a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:42.782325 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.782273    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e055b75-4611-4448-8729-805a75ce48a8-kube-api-access-ckl2n" (OuterVolumeSpecName: "kube-api-access-ckl2n") pod "4e055b75-4611-4448-8729-805a75ce48a8" (UID: "4e055b75-4611-4448-8729-805a75ce48a8"). InnerVolumeSpecName "kube-api-access-ckl2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:42.875994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.875867    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-oauth-config\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:46:42.875994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.875909    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-console-config\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:46:42.875994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.875925    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e055b75-4611-4448-8729-805a75ce48a8-console-serving-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:46:42.875994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.875940    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckl2n\" (UniqueName: \"kubernetes.io/projected/4e055b75-4611-4448-8729-805a75ce48a8-kube-api-access-ckl2n\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:46:42.875994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:42.875956    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e055b75-4611-4448-8729-805a75ce48a8-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:46:43.233864 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:43.233828    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846887dfbb-fp6qj" event={"ID":"4e055b75-4611-4448-8729-805a75ce48a8","Type":"ContainerDied","Data":"cf2cada3c916904e28b598b4acfed3d0cc8de3978bf78bc54d2ffa3876448173"}
Sep 18 13:46:43.233864 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:43.233865    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846887dfbb-fp6qj"
Sep 18 13:46:43.234145 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:43.233901    2585 scope.go:117] "RemoveContainer" containerID="6d7c45a084d9feb34e7ece20fd02b5023b4f68bd809e9dd8dd50f56e353302df"
Sep 18 13:46:43.258725 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:43.258652    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846887dfbb-fp6qj"]
Sep 18 13:46:43.264389 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:43.264282    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846887dfbb-fp6qj"]
Sep 18 13:46:43.641001 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:46:43.640916    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e055b75-4611-4448-8729-805a75ce48a8" path="/var/lib/kubelet/pods/4e055b75-4611-4448-8729-805a75ce48a8/volumes"
Sep 18 13:47:04.674507 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:04.674471    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:04.694817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:04.694785    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:05.341374 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:05.341350    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:18.099235 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099195    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:18.099825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099634    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="alertmanager" containerID="cri-o://1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988" gracePeriod=120
Sep 18 13:47:18.099825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099723    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-metric" containerID="cri-o://ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b" gracePeriod=120
Sep 18 13:47:18.099825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099781    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy" containerID="cri-o://4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec" gracePeriod=120
Sep 18 13:47:18.099825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099770    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-web" containerID="cri-o://a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6" gracePeriod=120
Sep 18 13:47:18.099825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099747    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="prom-label-proxy" containerID="cri-o://788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0" gracePeriod=120
Sep 18 13:47:18.100112 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.099782    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="config-reloader" containerID="cri-o://855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4" gracePeriod=120
Sep 18 13:47:18.379611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379517    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0" exitCode=0
Sep 18 13:47:18.379611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379544    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b" exitCode=0
Sep 18 13:47:18.379611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379552    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec" exitCode=0
Sep 18 13:47:18.379611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379560    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4" exitCode=0
Sep 18 13:47:18.379611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379568    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988" exitCode=0
Sep 18 13:47:18.379611 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379585    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0"}
Sep 18 13:47:18.379891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379655    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b"}
Sep 18 13:47:18.379891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379691    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec"}
Sep 18 13:47:18.379891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379720    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4"}
Sep 18 13:47:18.379891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:18.379746    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988"}
Sep 18 13:47:19.336898 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.336869    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.388245 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.388203    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d947c40-8913-4afe-8aca-202c2134753d" containerID="a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6" exitCode=0
Sep 18 13:47:19.388407 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.388286    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6"}
Sep 18 13:47:19.388407 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.388311    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.388407 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.388378    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d947c40-8913-4afe-8aca-202c2134753d","Type":"ContainerDied","Data":"527004edd982a56590589cf9d6041ff6b51b57b2c1f6819d00cf4b3d217f011b"}
Sep 18 13:47:19.388607 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.388472    2585 scope.go:117] "RemoveContainer" containerID="788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0"
Sep 18 13:47:19.396780 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.396762    2585 scope.go:117] "RemoveContainer" containerID="ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b"
Sep 18 13:47:19.404835 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.404814    2585 scope.go:117] "RemoveContainer" containerID="4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec"
Sep 18 13:47:19.413902 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.413866    2585 scope.go:117] "RemoveContainer" containerID="a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6"
Sep 18 13:47:19.421957 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.421923    2585 scope.go:117] "RemoveContainer" containerID="855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4"
Sep 18 13:47:19.430019 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.429996    2585 scope.go:117] "RemoveContainer" containerID="1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988"
Sep 18 13:47:19.438128 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.438108    2585 scope.go:117] "RemoveContainer" containerID="1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b"
Sep 18 13:47:19.446068 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.446048    2585 scope.go:117] "RemoveContainer" containerID="788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0"
Sep 18 13:47:19.446406 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.446378    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0\": container with ID starting with 788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0 not found: ID does not exist" containerID="788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0"
Sep 18 13:47:19.446522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.446434    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0"} err="failed to get container status \"788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0\": rpc error: code = NotFound desc = could not find container \"788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0\": container with ID starting with 788ac80105448e2386ba90a62b0e7cf41d2060d534812cac1fbfce65d7f3f2a0 not found: ID does not exist"
Sep 18 13:47:19.446522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.446473    2585 scope.go:117] "RemoveContainer" containerID="ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b"
Sep 18 13:47:19.446768 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.446752    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b\": container with ID starting with ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b not found: ID does not exist" containerID="ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b"
Sep 18 13:47:19.446816 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.446772    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b"} err="failed to get container status \"ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b\": rpc error: code = NotFound desc = could not find container \"ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b\": container with ID starting with ebf25f09df46f07caa17fe91441e2b7ff23d5c93522b5661a0e732245b46751b not found: ID does not exist"
Sep 18 13:47:19.446816 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.446792    2585 scope.go:117] "RemoveContainer" containerID="4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec"
Sep 18 13:47:19.447041 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.447022    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec\": container with ID starting with 4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec not found: ID does not exist" containerID="4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec"
Sep 18 13:47:19.447080 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447047    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec"} err="failed to get container status \"4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec\": rpc error: code = NotFound desc = could not find container \"4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec\": container with ID starting with 4bda8003b155b650ddab1248fccfef19d9f133b4e0ff42884da1f332d01c1eec not found: ID does not exist"
Sep 18 13:47:19.447080 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447063    2585 scope.go:117] "RemoveContainer" containerID="a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6"
Sep 18 13:47:19.447318 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.447302    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6\": container with ID starting with a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6 not found: ID does not exist" containerID="a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6"
Sep 18 13:47:19.447365 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447320    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6"} err="failed to get container status \"a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6\": rpc error: code = NotFound desc = could not find container \"a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6\": container with ID starting with a047a4e63e43ef45fd5ac3c467bd6d69eca44197be9a71ec2e3c94785052a2f6 not found: ID does not exist"
Sep 18 13:47:19.447365 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447333    2585 scope.go:117] "RemoveContainer" containerID="855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4"
Sep 18 13:47:19.447616 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.447601    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4\": container with ID starting with 855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4 not found: ID does not exist" containerID="855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4"
Sep 18 13:47:19.447657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447620    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4"} err="failed to get container status \"855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4\": rpc error: code = NotFound desc = could not find container \"855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4\": container with ID starting with 855954f4a206e592163b06dd81dc5372bae9c0bda2a5b3869d89ca23aa6df1d4 not found: ID does not exist"
Sep 18 13:47:19.447657 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447637    2585 scope.go:117] "RemoveContainer" containerID="1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988"
Sep 18 13:47:19.447893 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.447871    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988\": container with ID starting with 1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988 not found: ID does not exist" containerID="1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988"
Sep 18 13:47:19.447980 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447897    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988"} err="failed to get container status \"1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988\": rpc error: code = NotFound desc = could not find container \"1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988\": container with ID starting with 1314cee05374c1173e62eea67308a14fbeb409e598dee1293d924bed75f2b988 not found: ID does not exist"
Sep 18 13:47:19.447980 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.447916    2585 scope.go:117] "RemoveContainer" containerID="1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b"
Sep 18 13:47:19.448173 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:19.448156    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b\": container with ID starting with 1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b not found: ID does not exist" containerID="1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b"
Sep 18 13:47:19.448215 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.448178    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b"} err="failed to get container status \"1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b\": rpc error: code = NotFound desc = could not find container \"1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b\": container with ID starting with 1f20c1d096382b33961f7c12d3be29d32b8432402b2edcfeae9d62398f8d5b2b not found: ID does not exist"
Sep 18 13:47:19.497282 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497248    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-config-volume\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497282 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497285    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-tls-assets\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497542 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497312    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-metrics-client-ca\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497542 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497336    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497539    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-web\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497588    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-main-db\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497615    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtp2h\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-kube-api-access-xtp2h\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497678    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-web-config\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497723    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497755    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-main-tls\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.497797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497766    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:19.497797 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497795    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-cluster-tls-config\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.498068 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497836    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-trusted-ca-bundle\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.498068 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.497879    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-config-out\") pod \"8d947c40-8913-4afe-8aca-202c2134753d\" (UID: \"8d947c40-8913-4afe-8aca-202c2134753d\") "
Sep 18 13:47:19.498192 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.498173    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-metrics-client-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.498720 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.498488    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:19.498720 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.498710    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:19.501604 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.501499    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.501741 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.501718    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-config-out" (OuterVolumeSpecName: "config-out") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:19.501810 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.501744    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.501883 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.501857    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:19.502025 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.502001    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.502269 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.502249    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-kube-api-access-xtp2h" (OuterVolumeSpecName: "kube-api-access-xtp2h") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "kube-api-access-xtp2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:19.502330 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.502282    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-config-volume" (OuterVolumeSpecName: "config-volume") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.502709 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.502686    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.505956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.505826    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.512933 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.512906    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-web-config" (OuterVolumeSpecName: "web-config") pod "8d947c40-8913-4afe-8aca-202c2134753d" (UID: "8d947c40-8913-4afe-8aca-202c2134753d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:19.599566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599529    2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599558    2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-config-out\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599569    2585 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599577    2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-tls-assets\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599585    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599594    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599605    2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d947c40-8913-4afe-8aca-202c2134753d-alertmanager-main-db\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599613    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtp2h\" (UniqueName: \"kubernetes.io/projected/8d947c40-8913-4afe-8aca-202c2134753d-kube-api-access-xtp2h\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599621    2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-web-config\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599629    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599637    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-secret-alertmanager-main-tls\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.599822 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.599645    2585 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d947c40-8913-4afe-8aca-202c2134753d-cluster-tls-config\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:19.707114 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.707076    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:19.716196 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.716167    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:19.743990 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.743956    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:19.744270 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744258    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="init-config-reloader"
Sep 18 13:47:19.744313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744273    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="init-config-reloader"
Sep 18 13:47:19.744313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744283    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e055b75-4611-4448-8729-805a75ce48a8" containerName="console"
Sep 18 13:47:19.744313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744288    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e055b75-4611-4448-8729-805a75ce48a8" containerName="console"
Sep 18 13:47:19.744313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744295    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="config-reloader"
Sep 18 13:47:19.744313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744300    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="config-reloader"
Sep 18 13:47:19.744313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744314    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-web"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744320    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-web"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744326    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744331    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744337    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="alertmanager"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744342    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="alertmanager"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744346    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="prom-label-proxy"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744351    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="prom-label-proxy"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744359    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-metric"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744364    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-metric"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744406    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="alertmanager"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744428    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-web"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744439    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="config-reloader"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744448    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy-metric"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744457    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="prom-label-proxy"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744463    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e055b75-4611-4448-8729-805a75ce48a8" containerName="console"
Sep 18 13:47:19.744518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.744470    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d947c40-8913-4afe-8aca-202c2134753d" containerName="kube-rbac-proxy"
Sep 18 13:47:19.748235 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.748209    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.750693 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.750669    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 13:47:19.751007 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.750991    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 13:47:19.751295 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.751275    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 13:47:19.751383 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.751364    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 13:47:19.751455 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.751368    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 13:47:19.751876 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.751844    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 13:47:19.751876 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.751844    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 13:47:19.752008 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.751844    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h6zlv\""
Sep 18 13:47:19.752314 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.752297    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 13:47:19.758644 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.758620    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 13:47:19.765371 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.765347    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:19.902445 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902382    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902455    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902506    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902525    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902549    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndxn\" (UniqueName: \"kubernetes.io/projected/0cad684c-2b16-4ca2-8075-04a1ecc972f2-kube-api-access-fndxn\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902577    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cad684c-2b16-4ca2-8075-04a1ecc972f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902598    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cad684c-2b16-4ca2-8075-04a1ecc972f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902836 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cad684c-2b16-4ca2-8075-04a1ecc972f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902836 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902723    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cad684c-2b16-4ca2-8075-04a1ecc972f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902836 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902744    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cad684c-2b16-4ca2-8075-04a1ecc972f2-config-out\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902836 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902762    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:19.902836 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:19.902828    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-web-config\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.003945 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003854    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cad684c-2b16-4ca2-8075-04a1ecc972f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.003945 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cad684c-2b16-4ca2-8075-04a1ecc972f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.003945 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003915    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cad684c-2b16-4ca2-8075-04a1ecc972f2-config-out\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.003945 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003933    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003962    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-web-config\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003982    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.003999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004016    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004035    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004058    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndxn\" (UniqueName: \"kubernetes.io/projected/0cad684c-2b16-4ca2-8075-04a1ecc972f2-kube-api-access-fndxn\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cad684c-2b16-4ca2-8075-04a1ecc972f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004130    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cad684c-2b16-4ca2-8075-04a1ecc972f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004154    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.004760 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.004349    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cad684c-2b16-4ca2-8075-04a1ecc972f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.005053 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.005032    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cad684c-2b16-4ca2-8075-04a1ecc972f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.005873 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.005841    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cad684c-2b16-4ca2-8075-04a1ecc972f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.007241 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.007213    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cad684c-2b16-4ca2-8075-04a1ecc972f2-config-out\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.007346 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.007326    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.007465 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.007441    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.007540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.007506    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.007651 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.007631    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.007718 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.007700    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.008175 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.008153    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.008586 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.008563    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cad684c-2b16-4ca2-8075-04a1ecc972f2-web-config\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.009457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.009438    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cad684c-2b16-4ca2-8075-04a1ecc972f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.014399 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.014376    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndxn\" (UniqueName: \"kubernetes.io/projected/0cad684c-2b16-4ca2-8075-04a1ecc972f2-kube-api-access-fndxn\") pod \"alertmanager-main-0\" (UID: \"0cad684c-2b16-4ca2-8075-04a1ecc972f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.062248 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.062213    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 13:47:20.342746 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.342723    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 13:47:20.344779 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:47:20.344755    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cad684c_2b16_4ca2_8075_04a1ecc972f2.slice/crio-d096370fae5415fdaf21f29aca5b4d53e94fbc8fc3e6fadc70ceb560db58796b WatchSource:0}: Error finding container d096370fae5415fdaf21f29aca5b4d53e94fbc8fc3e6fadc70ceb560db58796b: Status 404 returned error can't find the container with id d096370fae5415fdaf21f29aca5b4d53e94fbc8fc3e6fadc70ceb560db58796b
Sep 18 13:47:20.394790 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:20.394752    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"d096370fae5415fdaf21f29aca5b4d53e94fbc8fc3e6fadc70ceb560db58796b"}
Sep 18 13:47:21.401252 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:21.401216    2585 generic.go:356] "Generic (PLEG): container finished" podID="0cad684c-2b16-4ca2-8075-04a1ecc972f2" containerID="f31089be5fabcd4066cbfa4d4371730d76fd55a23e13b65e602367005b732e55" exitCode=0
Sep 18 13:47:21.401649 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:21.401281    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerDied","Data":"f31089be5fabcd4066cbfa4d4371730d76fd55a23e13b65e602367005b732e55"}
Sep 18 13:47:21.640031 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:21.639999    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d947c40-8913-4afe-8aca-202c2134753d" path="/var/lib/kubelet/pods/8d947c40-8913-4afe-8aca-202c2134753d/volumes"
Sep 18 13:47:22.412089 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.412058    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"f9d875720999c7ab3d166d2990fbb7297d606422f213cb8efa2958891cabd172"}
Sep 18 13:47:22.412543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.412160    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"9e41e3d521a92f2a4939be20cca28f15bd134b92a4683f5758c53dc2d6fe85c8"}
Sep 18 13:47:22.412543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.412197    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"4bb4091fcf2d2551fe2d998cabcc1788106104ebf0776c3abfa06238f6ad8254"}
Sep 18 13:47:22.412543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.412224    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"6f31879a8aff3e6a59d37a82a29729f11512b76db408b7b328ea49cc657835a7"}
Sep 18 13:47:22.412543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.412248    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"29abef4d9dfdd5e868e8e1e248ba8d4be95ab6351be8f03da48dcee29b79c948"}
Sep 18 13:47:22.412543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.412283    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cad684c-2b16-4ca2-8075-04a1ecc972f2","Type":"ContainerStarted","Data":"b184fd985fab83d5fe85ab84e7b5e4af05985ead01c1aef80ff7666128686351"}
Sep 18 13:47:22.455465 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.455430    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:22.455786 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.455755    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="prometheus" containerID="cri-o://b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37" gracePeriod=600
Sep 18 13:47:22.455904 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.455794    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="config-reloader" containerID="cri-o://5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a" gracePeriod=600
Sep 18 13:47:22.455904 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.455766    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="thanos-sidecar" containerID="cri-o://26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda" gracePeriod=600
Sep 18 13:47:22.455904 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.455766    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy" containerID="cri-o://4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e" gracePeriod=600
Sep 18 13:47:22.456066 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.455767    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-web" containerID="cri-o://50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042" gracePeriod=600
Sep 18 13:47:22.456066 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.456026    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3" gracePeriod=600
Sep 18 13:47:22.528720 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.528666    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5087076379999997 podStartE2EDuration="3.528646332s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.938694ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:47:22.526462021 +0000 UTC m=+153.026219556" watchObservedRunningTime="2026-09-18 13:47:22.528646332 +0000 UTC m=+153.028403848"
Sep 18 13:47:22.709221 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.709195    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:22.833406 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833373    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-2\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833406 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833408    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-grpc-tls\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833474    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-metrics-client-ca\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833500    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833531    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-config-out\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833566    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-config\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833600    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-kubelet-serving-ca-bundle\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833634    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-kube-rbac-proxy\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833656    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-0\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.833702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833705    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-trusted-ca-bundle\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833729    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpkbs\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-kube-api-access-fpkbs\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833770    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-metrics-client-certs\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833803    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-1\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833840    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-thanos-prometheus-http-client-file\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833867    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-db\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833883    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833890    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-web-config\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833913    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833939    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.833981    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-serving-certs-ca-bundle\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834005    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-tls\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834062    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-tls-assets\") pod \"b21cca0a-627e-414d-acf3-72586b48b09f\" (UID: \"b21cca0a-627e-414d-acf3-72586b48b09f\") "
Sep 18 13:47:22.834897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834197    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.834897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834495    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.834897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834515    2585 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-metrics-client-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.834897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834529    2585 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.834897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.834875    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.837138 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.836598    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.837138 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.836798    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.837138 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.837047    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-kube-api-access-fpkbs" (OuterVolumeSpecName: "kube-api-access-fpkbs") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "kube-api-access-fpkbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:22.837739 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.837550    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:47:22.837739 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.837645    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.838069 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.838039    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:47:22.838494 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.838465    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:22.838586 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.838546    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-config" (OuterVolumeSpecName: "config") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.838913 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.838892    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.839453 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.839397    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-config-out" (OuterVolumeSpecName: "config-out") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:47:22.839453 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.839403    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.839591 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.839524    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.839633 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.839609    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.839697 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.839675    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.839956 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.839935    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.849405 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.849382    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-web-config" (OuterVolumeSpecName: "web-config") pod "b21cca0a-627e-414d-acf3-72586b48b09f" (UID: "b21cca0a-627e-414d-acf3-72586b48b09f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:47:22.935019 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.934970    2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-tls-assets\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935019 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935010    2585 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-grpc-tls\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935019 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935021    2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935019 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935032    2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-config-out\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935019 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935041    2585 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-config\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935050    2585 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-kube-rbac-proxy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935059    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935067    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935075    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpkbs\" (UniqueName: \"kubernetes.io/projected/b21cca0a-627e-414d-acf3-72586b48b09f-kube-api-access-fpkbs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935083    2585 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-metrics-client-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935091    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935099    2585 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935108    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b21cca0a-627e-414d-acf3-72586b48b09f-prometheus-k8s-db\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935116    2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-web-config\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935124    2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935132    2585 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b21cca0a-627e-414d-acf3-72586b48b09f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:22.935329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:22.935140    2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b21cca0a-627e-414d-acf3-72586b48b09f-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420139    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3" exitCode=0
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420165    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e" exitCode=0
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420172    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042" exitCode=0
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420178    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda" exitCode=0
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420184    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a" exitCode=0
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420190    2585 generic.go:356] "Generic (PLEG): container finished" podID="b21cca0a-627e-414d-acf3-72586b48b09f" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37" exitCode=0
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420216    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"}
Sep 18 13:47:23.420228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420231    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420280    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"}
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420307    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"}
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420330    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"}
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420358    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"}
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420345    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"}
Sep 18 13:47:23.421149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.420408    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b21cca0a-627e-414d-acf3-72586b48b09f","Type":"ContainerDied","Data":"7dc75ae4ac8324fc55a8172e3106b35b3284ffcd4c3e0d80759f859bc133579c"}
Sep 18 13:47:23.429191 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.429172    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.436493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.436474    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.443483 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.443466    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.445548 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.445523    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:23.450972 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.450955    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.453698 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.453676    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:23.458719 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.458577    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.466280 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.466263    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.473289 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.473270    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.473629 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.473609    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.473690 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.473638    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"} err="failed to get container status \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist"
Sep 18 13:47:23.473690 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.473656    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.473926 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.473899    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.474021 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.473932    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"} err="failed to get container status \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist"
Sep 18 13:47:23.474021 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.473963    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.474244 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.474227    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.474284 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.474250    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"} err="failed to get container status \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist"
Sep 18 13:47:23.474284 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.474266    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.474549 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.474528    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.474629 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.474561    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"} err="failed to get container status \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist"
Sep 18 13:47:23.474629 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.474576    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.474820 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.474803    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.474867 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.474825    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"} err="failed to get container status \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist"
Sep 18 13:47:23.474867 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.474839    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.475099 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.475082    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.475147 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475104    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"} err="failed to get container status \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist"
Sep 18 13:47:23.475147 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475119    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.475342 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:47:23.475325    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.475387 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475345    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"} err="failed to get container status \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist"
Sep 18 13:47:23.475387 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475357    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.475586 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475571    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"} err="failed to get container status \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist"
Sep 18 13:47:23.475628 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475586    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.475801 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475786    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"} err="failed to get container status \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist"
Sep 18 13:47:23.475855 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475801    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.476010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.475994    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"} err="failed to get container status \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist"
Sep 18 13:47:23.476056 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476010    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.476204 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476190    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"} err="failed to get container status \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist"
Sep 18 13:47:23.476249 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476205    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.476396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476382    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"} err="failed to get container status \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist"
Sep 18 13:47:23.476470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476396    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.476626 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476611    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"} err="failed to get container status \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist"
Sep 18 13:47:23.476665 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476626    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.476817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476802    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"} err="failed to get container status \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist"
Sep 18 13:47:23.476864 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476819    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.477010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.476995    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"} err="failed to get container status \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist"
Sep 18 13:47:23.477049 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477010    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.477189 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477175    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"} err="failed to get container status \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist"
Sep 18 13:47:23.477231 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477189    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.477368 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477354    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"} err="failed to get container status \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist"
Sep 18 13:47:23.477409 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477368    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.477567 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477553    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"} err="failed to get container status \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist"
Sep 18 13:47:23.477606 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.477568    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478044    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"} err="failed to get container status \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478068    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478370    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"} err="failed to get container status \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478404    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478671    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"} err="failed to get container status \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478693    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478965    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"} err="failed to get container status \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.478983    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.479212    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"} err="failed to get container status \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.479230    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.479554    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"} err="failed to get container status \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.479571    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.479809    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"} err="failed to get container status \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.479825    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.480056    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"} err="failed to get container status \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist"
Sep 18 13:47:23.480362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.480070    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.481271 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.480550    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"} err="failed to get container status \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist"
Sep 18 13:47:23.481271 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.480618    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.481271 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.481198    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"} err="failed to get container status \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist"
Sep 18 13:47:23.481271 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.481217    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.481574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.481540    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"} err="failed to get container status \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist"
Sep 18 13:47:23.481574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.481562    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.482080 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482055    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"} err="failed to get container status \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist"
Sep 18 13:47:23.482173 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482080    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.482372 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482348    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"} err="failed to get container status \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist"
Sep 18 13:47:23.482478 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482375    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.482660 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482642    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"} err="failed to get container status \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist"
Sep 18 13:47:23.482720 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482660    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.482907 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482885    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"} err="failed to get container status \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist"
Sep 18 13:47:23.482964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.482908    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.483113 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483095    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:23.483176 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483152    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"} err="failed to get container status \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist"
Sep 18 13:47:23.483176 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483167    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.483408 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483390    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"} err="failed to get container status \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist"
Sep 18 13:47:23.483408 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483407    2585 scope.go:117] "RemoveContainer" containerID="854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"
Sep 18 13:47:23.483545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483487    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="prometheus"
Sep 18 13:47:23.483545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483504    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="prometheus"
Sep 18 13:47:23.483545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483526    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="config-reloader"
Sep 18 13:47:23.483545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483535    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="config-reloader"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483553    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="init-config-reloader"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483562    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="init-config-reloader"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483572    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483580    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483589    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-thanos"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483599    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-thanos"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483612    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-web"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483621    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-web"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483635    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="thanos-sidecar"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483643    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="thanos-sidecar"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483643    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3"} err="failed to get container status \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": rpc error: code = NotFound desc = could not find container \"854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3\": container with ID starting with 854118d4827a791042c2c0c35b4878437c981011d10ba1181d4ed0169bdb96d3 not found: ID does not exist"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483661    2585 scope.go:117] "RemoveContainer" containerID="4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483718    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="config-reloader"
Sep 18 13:47:23.483729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483731    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="thanos-sidecar"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483740    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483751    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-web"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483761    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="kube-rbac-proxy-thanos"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483774    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" containerName="prometheus"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483866    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e"} err="failed to get container status \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": rpc error: code = NotFound desc = could not find container \"4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e\": container with ID starting with 4d3ab2393c06f03cc7a08731806f68b6f73b5d1516b7ef92c279da8aa74bb01e not found: ID does not exist"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.483887    2585 scope.go:117] "RemoveContainer" containerID="50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484091    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042"} err="failed to get container status \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": rpc error: code = NotFound desc = could not find container \"50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042\": container with ID starting with 50d2bf7bb2e57c90d836ca89c35804d5a55cf09f8e82dbe9fc0936f3f9435042 not found: ID does not exist"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484105    2585 scope.go:117] "RemoveContainer" containerID="26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484351    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda"} err="failed to get container status \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": rpc error: code = NotFound desc = could not find container \"26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda\": container with ID starting with 26d7f48a04a4573796a7f77bcc277697a75a20f1a284d0b3c2ed0da5029ddcda not found: ID does not exist"
Sep 18 13:47:23.484457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484364    2585 scope.go:117] "RemoveContainer" containerID="5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"
Sep 18 13:47:23.484925 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484556    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a"} err="failed to get container status \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": rpc error: code = NotFound desc = could not find container \"5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a\": container with ID starting with 5487c0e1a1c5c21cdb14c40a404bd42b9d64edeb7284cde93f1e566431e1ca6a not found: ID does not exist"
Sep 18 13:47:23.484925 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484569    2585 scope.go:117] "RemoveContainer" containerID="b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"
Sep 18 13:47:23.484925 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484777    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37"} err="failed to get container status \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": rpc error: code = NotFound desc = could not find container \"b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37\": container with ID starting with b48590895e3936e2ccd116155d914ac3d32bdde6f774979e291f61efcb44ca37 not found: ID does not exist"
Sep 18 13:47:23.484925 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.484793    2585 scope.go:117] "RemoveContainer" containerID="a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"
Sep 18 13:47:23.485115 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.485010    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76"} err="failed to get container status \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": rpc error: code = NotFound desc = could not find container \"a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76\": container with ID starting with a4a8306078052d531a0e45773bfb339098847266f2a09987ef18e21ea8ce4a76 not found: ID does not exist"
Sep 18 13:47:23.489036 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.489014    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.491470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.491452    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 13:47:23.491649 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.491636    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 13:47:23.491874 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.491857    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 13:47:23.491874 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.491867    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 13:47:23.491999 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.491855    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 13:47:23.492131 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.492087    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 13:47:23.492527 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.492513    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 13:47:23.492594 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.492526    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 13:47:23.494033 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.494008    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 13:47:23.494136 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.494128    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 13:47:23.494287 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.494270    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2fl6v\""
Sep 18 13:47:23.494619 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.494605    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 13:47:23.494690 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.494680    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2dpgcmdunhp4c\""
Sep 18 13:47:23.494748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.494708    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 13:47:23.497344 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.497327    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 13:47:23.506298 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.502958    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 13:47:23.511678 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.511652    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:23.640674 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.640640    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21cca0a-627e-414d-acf3-72586b48b09f" path="/var/lib/kubelet/pods/b21cca0a-627e-414d-acf3-72586b48b09f/volumes"
Sep 18 13:47:23.642395 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642366    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642406    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-config\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642456    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642480    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642506    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642528    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642579    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642611    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642633    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642657    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40134054-bdbd-4913-82c5-44f5f2cb7af8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642713    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40134054-bdbd-4913-82c5-44f5f2cb7af8-config-out\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642738    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642760    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-web-config\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.642805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642785    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.643146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642821    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.643146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642853    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.643146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642890    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.643146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642931    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.643146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.642957    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwl9b\" (UniqueName: \"kubernetes.io/projected/40134054-bdbd-4913-82c5-44f5f2cb7af8-kube-api-access-lwl9b\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743744 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743705    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743748    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743780    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743800    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743820    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743840    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743870    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40134054-bdbd-4913-82c5-44f5f2cb7af8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.743914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.743896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40134054-bdbd-4913-82c5-44f5f2cb7af8-config-out\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.744910 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.744881    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745060 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.744884    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745158 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745133    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745326 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.744920    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745451 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745346    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-web-config\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745451 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745376    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745451 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745434    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745619 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745472    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745619 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745506    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745619 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745555    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745619 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745579    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwl9b\" (UniqueName: \"kubernetes.io/projected/40134054-bdbd-4913-82c5-44f5f2cb7af8-kube-api-access-lwl9b\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745819 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745641    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745819 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745679    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-config\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745819 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745701    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.745819 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.745725    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.746049 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.746027    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.746627 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.746601    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.747094 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.747071    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40134054-bdbd-4913-82c5-44f5f2cb7af8-config-out\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.747382 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.747356    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.747495 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.747388    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.747560 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.747498    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.747670 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.747644    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.747761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.747735    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40134054-bdbd-4913-82c5-44f5f2cb7af8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.748450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.748308    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.748568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.748543    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.749144 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.749122    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-web-config\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.750042 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.750021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.750281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.750265    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.750319 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.750302    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-config\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.750787 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.750771    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40134054-bdbd-4913-82c5-44f5f2cb7af8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.750842 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.750827    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40134054-bdbd-4913-82c5-44f5f2cb7af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.755558 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.755541    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwl9b\" (UniqueName: \"kubernetes.io/projected/40134054-bdbd-4913-82c5-44f5f2cb7af8-kube-api-access-lwl9b\") pod \"prometheus-k8s-0\" (UID: \"40134054-bdbd-4913-82c5-44f5f2cb7af8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:23.799678 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:23.799639    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:47:24.084475 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:24.084399    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 13:47:24.086982 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:47:24.086960    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40134054_bdbd_4913_82c5_44f5f2cb7af8.slice/crio-954b01aadeddc2f5312971c2ab2f56c20a3f1181d84fa4a69ac92e09959a7508 WatchSource:0}: Error finding container 954b01aadeddc2f5312971c2ab2f56c20a3f1181d84fa4a69ac92e09959a7508: Status 404 returned error can't find the container with id 954b01aadeddc2f5312971c2ab2f56c20a3f1181d84fa4a69ac92e09959a7508
Sep 18 13:47:24.427170 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:24.427134    2585 generic.go:356] "Generic (PLEG): container finished" podID="40134054-bdbd-4913-82c5-44f5f2cb7af8" containerID="755905b47a17eede0772acbab6825adc3036fcf9bb2ed0d8190e8f6adbc52ae9" exitCode=0
Sep 18 13:47:24.427589 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:24.427180    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerDied","Data":"755905b47a17eede0772acbab6825adc3036fcf9bb2ed0d8190e8f6adbc52ae9"}
Sep 18 13:47:24.427589 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:24.427246    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"954b01aadeddc2f5312971c2ab2f56c20a3f1181d84fa4a69ac92e09959a7508"}
Sep 18 13:47:25.435295 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.435247    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"ed47050491af21dd4947dcb102809a5437343355d848117d07c8f2143f52834a"}
Sep 18 13:47:25.435812 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.435363    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"cbf9b62855aa4da9d8a66a86a3dd9e0f3821eafaf63b7cc3901112c5e1d8feef"}
Sep 18 13:47:25.435812 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.435409    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"4cdf6bff2df6870581b566859938c848d86c09732f0bcdaf9ff52ba468acb460"}
Sep 18 13:47:25.435812 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.435482    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"fc5e176fbcee8475257f3eda7a91810af82ae1780705e65cb408891ea03286cc"}
Sep 18 13:47:25.435812 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.435518    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"8bc9f07f5b70e67b24729fd4ca46f4c5d454b2e7c95fffe78d152ab9b3aded06"}
Sep 18 13:47:25.435812 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.435554    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40134054-bdbd-4913-82c5-44f5f2cb7af8","Type":"ContainerStarted","Data":"3341744c85af68e6db4e4c816ac771c2627f46e3270c12e837c280d26439a3aa"}
Sep 18 13:47:25.465322 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:25.465103    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.444192675 podStartE2EDuration="2.46508215s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.889475ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:47:25.462688574 +0000 UTC m=+155.962446089" watchObservedRunningTime="2026-09-18 13:47:25.46508215 +0000 UTC m=+155.964839666"
Sep 18 13:47:28.800010 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:47:28.799979    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:23.800575 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:48:23.800541    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:23.816703 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:48:23.816673    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:48:24.695701 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:48:24.695677    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 13:49:51.497510 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:51.497472    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:49:51.499827 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:51.499808    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:49:51.504946 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:51.504925    2585 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 13:49:54.122772 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.122731    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rxgtm"]
Sep 18 13:49:54.125962 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.125942    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.128512 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.128490    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 13:49:54.130486 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.130471    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 13:49:54.147625 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.147592    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rxgtm"]
Sep 18 13:49:54.223369 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.223334    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84x92\" (UniqueName: \"kubernetes.io/projected/41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90-kube-api-access-84x92\") pod \"cert-manager-webhook-6486ffd997-rxgtm\" (UID: \"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.223587 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.223448    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rxgtm\" (UID: \"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.324025 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.323981    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rxgtm\" (UID: \"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.324172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.324032    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84x92\" (UniqueName: \"kubernetes.io/projected/41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90-kube-api-access-84x92\") pod \"cert-manager-webhook-6486ffd997-rxgtm\" (UID: \"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.352824 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.352790    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rxgtm\" (UID: \"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.353179 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.353157    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84x92\" (UniqueName: \"kubernetes.io/projected/41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90-kube-api-access-84x92\") pod \"cert-manager-webhook-6486ffd997-rxgtm\" (UID: \"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.451343 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.451305    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:54.727188 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.727161    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rxgtm"]
Sep 18 13:49:54.729055 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:49:54.729029    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41efc9ad_5bc0_4a3b_bfa6_421cfd74ce90.slice/crio-43d446ffc6a21cdc65a7a1c63e753a20f4d3e40752d9806abfdcc189c1460054 WatchSource:0}: Error finding container 43d446ffc6a21cdc65a7a1c63e753a20f4d3e40752d9806abfdcc189c1460054: Status 404 returned error can't find the container with id 43d446ffc6a21cdc65a7a1c63e753a20f4d3e40752d9806abfdcc189c1460054
Sep 18 13:49:54.730754 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:54.730739    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:49:55.046953 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:55.046860    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm" event={"ID":"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90","Type":"ContainerStarted","Data":"43d446ffc6a21cdc65a7a1c63e753a20f4d3e40752d9806abfdcc189c1460054"}
Sep 18 13:49:57.505588 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.505553    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"]
Sep 18 13:49:57.509310 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.509286    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.514218 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.511884    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jqjjk\""
Sep 18 13:49:57.519678 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.519651    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"]
Sep 18 13:49:57.553800 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.553760    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nslvd\" (UniqueName: \"kubernetes.io/projected/f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03-kube-api-access-nslvd\") pod \"cert-manager-cainjector-559cdd8c87-wpr8t\" (UID: \"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.553991 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.553857    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wpr8t\" (UID: \"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.655092 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.655059    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslvd\" (UniqueName: \"kubernetes.io/projected/f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03-kube-api-access-nslvd\") pod \"cert-manager-cainjector-559cdd8c87-wpr8t\" (UID: \"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.655251 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.655111    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wpr8t\" (UID: \"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.664445 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.664398    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wpr8t\" (UID: \"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.664882 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.664863    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nslvd\" (UniqueName: \"kubernetes.io/projected/f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03-kube-api-access-nslvd\") pod \"cert-manager-cainjector-559cdd8c87-wpr8t\" (UID: \"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:57.825872 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:57.825826    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"
Sep 18 13:49:58.061698 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:58.061607    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm" event={"ID":"41efc9ad-5bc0-4a3b-bfa6-421cfd74ce90","Type":"ContainerStarted","Data":"dc82a8f596112d6123adfb481e08d9e1e95379947098474cc3a3ff3be8074ff0"}
Sep 18 13:49:58.061698 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:58.061648    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:49:58.078540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:58.078495    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm" podStartSLOduration=1.106449505 podStartE2EDuration="4.0784801s" totalImagesPullingTime="2.972030595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:49:58.077237083 +0000 UTC m=+308.576994600" watchObservedRunningTime="2026-09-18 13:49:58.0784801 +0000 UTC m=+308.578237615"
Sep 18 13:49:58.104267 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:58.104234    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t"]
Sep 18 13:49:58.107309 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:49:58.107287    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf28f39ce_90b1_451b_8f5d_5c1c1b1bcd03.slice/crio-10f372ab28306871eb4d0f63ca888a5b9f11ab318ff9302c8add09d198248bb2 WatchSource:0}: Error finding container 10f372ab28306871eb4d0f63ca888a5b9f11ab318ff9302c8add09d198248bb2: Status 404 returned error can't find the container with id 10f372ab28306871eb4d0f63ca888a5b9f11ab318ff9302c8add09d198248bb2
Sep 18 13:49:59.067695 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:59.067656    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t" event={"ID":"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03","Type":"ContainerStarted","Data":"6d41b538e8453a255fb5b956b405e41901f9d1a9368a15d50e8da45fe1f998d7"}
Sep 18 13:49:59.067695 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:59.067699    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t" event={"ID":"f28f39ce-90b1-451b-8f5d-5c1c1b1bcd03","Type":"ContainerStarted","Data":"10f372ab28306871eb4d0f63ca888a5b9f11ab318ff9302c8add09d198248bb2"}
Sep 18 13:49:59.086069 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:49:59.086008    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wpr8t" podStartSLOduration=2.085993219 podStartE2EDuration="2.085993219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:49:59.0842007 +0000 UTC m=+309.583958207" watchObservedRunningTime="2026-09-18 13:49:59.085993219 +0000 UTC m=+309.585750735"
Sep 18 13:50:04.070396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:04.070365    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rxgtm"
Sep 18 13:50:34.703712 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.703636    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"]
Sep 18 13:50:34.705962 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.705946    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.709178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.709158    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 13:50:34.709311 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.709291    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g9q4g\""
Sep 18 13:50:34.709510 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.709489    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 13:50:34.709784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.709769    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 13:50:34.711119 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.711103    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 13:50:34.806346 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.806314    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"]
Sep 18 13:50:34.877596 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.877563    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znnsx\" (UniqueName: \"kubernetes.io/projected/68ea6f09-8002-47b7-ab3a-a54ee263dc04-kube-api-access-znnsx\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.877596 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.877602    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68ea6f09-8002-47b7-ab3a-a54ee263dc04-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.877888 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.877623    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68ea6f09-8002-47b7-ab3a-a54ee263dc04-manifests\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.877888 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.877735    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ea6f09-8002-47b7-ab3a-a54ee263dc04-tmp\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.877888 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.877787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68ea6f09-8002-47b7-ab3a-a54ee263dc04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.978946 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.978855    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ea6f09-8002-47b7-ab3a-a54ee263dc04-tmp\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.978946 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.978905    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68ea6f09-8002-47b7-ab3a-a54ee263dc04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.978946 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.978937    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znnsx\" (UniqueName: \"kubernetes.io/projected/68ea6f09-8002-47b7-ab3a-a54ee263dc04-kube-api-access-znnsx\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.979180 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.978960    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68ea6f09-8002-47b7-ab3a-a54ee263dc04-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.979180 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.978978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68ea6f09-8002-47b7-ab3a-a54ee263dc04-manifests\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.979402 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.979378    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68ea6f09-8002-47b7-ab3a-a54ee263dc04-manifests\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.981366 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.981342    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ea6f09-8002-47b7-ab3a-a54ee263dc04-tmp\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.981662 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.981588    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68ea6f09-8002-47b7-ab3a-a54ee263dc04-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.981761 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.981738    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68ea6f09-8002-47b7-ab3a-a54ee263dc04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:34.987364 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:34.987341    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znnsx\" (UniqueName: \"kubernetes.io/projected/68ea6f09-8002-47b7-ab3a-a54ee263dc04-kube-api-access-znnsx\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-thpx8\" (UID: \"68ea6f09-8002-47b7-ab3a-a54ee263dc04\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:35.016038 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:35.016003    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:35.289817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:35.289736    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"]
Sep 18 13:50:35.293338 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:50:35.293311    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ea6f09_8002_47b7_ab3a_a54ee263dc04.slice/crio-b1d430c0a563ae69272691753e4a664f5e4e8c03ffd46242fe73b11d9c109c9f WatchSource:0}: Error finding container b1d430c0a563ae69272691753e4a664f5e4e8c03ffd46242fe73b11d9c109c9f: Status 404 returned error can't find the container with id b1d430c0a563ae69272691753e4a664f5e4e8c03ffd46242fe73b11d9c109c9f
Sep 18 13:50:36.220387 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:36.220344    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8" event={"ID":"68ea6f09-8002-47b7-ab3a-a54ee263dc04","Type":"ContainerStarted","Data":"b1d430c0a563ae69272691753e4a664f5e4e8c03ffd46242fe73b11d9c109c9f"}
Sep 18 13:50:38.230749 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:38.230715    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8" event={"ID":"68ea6f09-8002-47b7-ab3a-a54ee263dc04","Type":"ContainerStarted","Data":"f608139b294008510fa7b68423b1d1c8842173eba28120254375f475124fa99b"}
Sep 18 13:50:39.237905 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:39.237870    2585 generic.go:356] "Generic (PLEG): container finished" podID="68ea6f09-8002-47b7-ab3a-a54ee263dc04" containerID="f608139b294008510fa7b68423b1d1c8842173eba28120254375f475124fa99b" exitCode=0
Sep 18 13:50:39.238350 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:39.237923    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8" event={"ID":"68ea6f09-8002-47b7-ab3a-a54ee263dc04","Type":"ContainerDied","Data":"f608139b294008510fa7b68423b1d1c8842173eba28120254375f475124fa99b"}
Sep 18 13:50:40.244979 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:40.244935    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8" event={"ID":"68ea6f09-8002-47b7-ab3a-a54ee263dc04","Type":"ContainerStarted","Data":"5e7d978bc5ca52d1df451197a080df6fa8473d5d3e4e69755c32515056234fc9"}
Sep 18 13:50:40.245430 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:40.245071    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:40.266660 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:40.266603    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8" podStartSLOduration=1.9886486410000002 podStartE2EDuration="6.266584804s" totalImagesPullingTime="3.269772631s" totalInitContainerRuntime="1.008163532s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:40.2648307 +0000 UTC m=+350.764588215" watchObservedRunningTime="2026-09-18 13:50:40.266584804 +0000 UTC m=+350.766342387"
Sep 18 13:50:51.252845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:51.252809    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-thpx8"
Sep 18 13:50:59.528405 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.528370    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d77c5f84-6h7v4"]
Sep 18 13:50:59.538704 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.538678    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.542207 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542181    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 13:50:59.542362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542241    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 13:50:59.542362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542257    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 13:50:59.542362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542278    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 13:50:59.542362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542242    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 13:50:59.542362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542320    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 13:50:59.542362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542284    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r6kn9\""
Sep 18 13:50:59.542683 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.542623    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 13:50:59.548403 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.548382    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d77c5f84-6h7v4"]
Sep 18 13:50:59.552123 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.552099    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 13:50:59.583155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583126    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab386b76-992f-4d75-822c-9e535632d5aa-console-serving-cert\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.583155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583167    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz66l\" (UniqueName: \"kubernetes.io/projected/ab386b76-992f-4d75-822c-9e535632d5aa-kube-api-access-hz66l\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.583348 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583194    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab386b76-992f-4d75-822c-9e535632d5aa-console-oauth-config\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.583348 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583241    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-console-config\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.583348 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583303    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-trusted-ca-bundle\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.583471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583344    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-oauth-serving-cert\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.583471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.583406    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-service-ca\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684378 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684349    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz66l\" (UniqueName: \"kubernetes.io/projected/ab386b76-992f-4d75-822c-9e535632d5aa-kube-api-access-hz66l\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684388    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab386b76-992f-4d75-822c-9e535632d5aa-console-oauth-config\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684405    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-console-config\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684461    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-trusted-ca-bundle\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684483    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-oauth-serving-cert\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684512    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-service-ca\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.684818 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.684591    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab386b76-992f-4d75-822c-9e535632d5aa-console-serving-cert\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.685574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.685547    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-oauth-serving-cert\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.685719 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.685591    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-service-ca\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.685809 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.685785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-trusted-ca-bundle\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.685925 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.685790    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab386b76-992f-4d75-822c-9e535632d5aa-console-config\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.687191 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.687166    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab386b76-992f-4d75-822c-9e535632d5aa-console-oauth-config\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.687282 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.687172    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab386b76-992f-4d75-822c-9e535632d5aa-console-serving-cert\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.693091 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.693065    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz66l\" (UniqueName: \"kubernetes.io/projected/ab386b76-992f-4d75-822c-9e535632d5aa-kube-api-access-hz66l\") pod \"console-59d77c5f84-6h7v4\" (UID: \"ab386b76-992f-4d75-822c-9e535632d5aa\") " pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:50:59.849096 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:50:59.849009    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:51:00.126449 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:00.126337    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d77c5f84-6h7v4"]
Sep 18 13:51:00.129997 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:51:00.129969    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab386b76_992f_4d75_822c_9e535632d5aa.slice/crio-d680950eeb6881b683a567d330aec5f8c72b78f750206f97becbf6c7d91b8bc2 WatchSource:0}: Error finding container d680950eeb6881b683a567d330aec5f8c72b78f750206f97becbf6c7d91b8bc2: Status 404 returned error can't find the container with id d680950eeb6881b683a567d330aec5f8c72b78f750206f97becbf6c7d91b8bc2
Sep 18 13:51:00.339674 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:00.339643    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d77c5f84-6h7v4" event={"ID":"ab386b76-992f-4d75-822c-9e535632d5aa","Type":"ContainerStarted","Data":"f55d5e2a57e0db5580296fbf0bbaae739d2c416d7c60bebc3fd78ed5cbc8b7a4"}
Sep 18 13:51:00.339841 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:00.339694    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d77c5f84-6h7v4" event={"ID":"ab386b76-992f-4d75-822c-9e535632d5aa","Type":"ContainerStarted","Data":"d680950eeb6881b683a567d330aec5f8c72b78f750206f97becbf6c7d91b8bc2"}
Sep 18 13:51:04.684825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.684766    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d77c5f84-6h7v4" podStartSLOduration=5.684748979 podStartE2EDuration="5.684748979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:00.360498107 +0000 UTC m=+370.860255624" watchObservedRunningTime="2026-09-18 13:51:04.684748979 +0000 UTC m=+375.184506495"
Sep 18 13:51:04.685568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.685552    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ksxrr"]
Sep 18 13:51:04.688688 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.688667    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:04.690795 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.690770    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 18 13:51:04.690940 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.690923    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ltxqs\""
Sep 18 13:51:04.704005 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.703980    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ksxrr"]
Sep 18 13:51:04.828559 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.828521    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-cert\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:04.828748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.828595    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7dzk\" (UniqueName: \"kubernetes.io/projected/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-kube-api-access-p7dzk\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:04.929565 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.929528    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7dzk\" (UniqueName: \"kubernetes.io/projected/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-kube-api-access-p7dzk\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:04.929746 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.929586    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-cert\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:04.929746 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:51:04.929698    2585 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 18 13:51:04.929821 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:51:04.929758    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-cert podName:6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548 nodeName:}" failed. No retries permitted until 2026-09-18 13:51:05.429739729 +0000 UTC m=+375.929497224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-cert") pod "odh-model-controller-7998c67dc4-ksxrr" (UID: "6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548") : secret "odh-model-controller-webhook-cert" not found
Sep 18 13:51:04.941114 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:04.941049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7dzk\" (UniqueName: \"kubernetes.io/projected/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-kube-api-access-p7dzk\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:05.435134 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:05.435101    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-cert\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:05.437707 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:05.437683    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548-cert\") pod \"odh-model-controller-7998c67dc4-ksxrr\" (UID: \"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:05.600718 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:05.600679    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:05.891558 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:05.891476    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ksxrr"]
Sep 18 13:51:05.894831 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:51:05.894805    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3cb0f4_ca2a_4ca0_8d21_7a88b9015548.slice/crio-94ad9b3e4b5d657dc191435191f7438c659a470b8c8c9d14937b2d1b3772aec0 WatchSource:0}: Error finding container 94ad9b3e4b5d657dc191435191f7438c659a470b8c8c9d14937b2d1b3772aec0: Status 404 returned error can't find the container with id 94ad9b3e4b5d657dc191435191f7438c659a470b8c8c9d14937b2d1b3772aec0
Sep 18 13:51:06.373668 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:06.373635    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr" event={"ID":"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548","Type":"ContainerStarted","Data":"94ad9b3e4b5d657dc191435191f7438c659a470b8c8c9d14937b2d1b3772aec0"}
Sep 18 13:51:09.392492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:09.392455    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr" event={"ID":"6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548","Type":"ContainerStarted","Data":"006dfb27de691b5b0f394108a8d41213a8c25ea37f7b913077089867e35d62a8"}
Sep 18 13:51:09.392881 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:09.392544    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:09.411294 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:09.410921    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr" podStartSLOduration=2.8385551959999997 podStartE2EDuration="5.410899995s" totalImagesPullingTime="2.572344799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:09.410211971 +0000 UTC m=+379.909969500" watchObservedRunningTime="2026-09-18 13:51:09.410899995 +0000 UTC m=+379.910657489"
Sep 18 13:51:09.850008 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:09.849969    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:51:09.850239 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:09.850037    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:51:09.855308 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:09.855283    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:51:10.401807 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.401773    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d77c5f84-6h7v4"
Sep 18 13:51:10.592466 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.592431    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"]
Sep 18 13:51:10.595850 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.595827    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.598576 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.598547    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-44st8\""
Sep 18 13:51:10.598717 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.598585    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 18 13:51:10.598717 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.598636    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 13:51:10.598717 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.598650    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:51:10.598717 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.598700    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 18 13:51:10.599003 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.598939    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 18 13:51:10.607950 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.607923    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"]
Sep 18 13:51:10.687120 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.687083    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98a7dc55-9f23-44d4-afc2-492760d62fd4-metrics-cert\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.687120 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.687124    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98a7dc55-9f23-44d4-afc2-492760d62fd4-manager-config\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.687325 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.687274    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj2rs\" (UniqueName: \"kubernetes.io/projected/98a7dc55-9f23-44d4-afc2-492760d62fd4-kube-api-access-bj2rs\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.687325 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.687305    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a7dc55-9f23-44d4-afc2-492760d62fd4-cert\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.788810 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.788774    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj2rs\" (UniqueName: \"kubernetes.io/projected/98a7dc55-9f23-44d4-afc2-492760d62fd4-kube-api-access-bj2rs\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.788986 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.788820    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a7dc55-9f23-44d4-afc2-492760d62fd4-cert\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.788986 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.788849    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98a7dc55-9f23-44d4-afc2-492760d62fd4-metrics-cert\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.788986 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.788878    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98a7dc55-9f23-44d4-afc2-492760d62fd4-manager-config\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.789780 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.789759    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98a7dc55-9f23-44d4-afc2-492760d62fd4-manager-config\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.791642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.791621    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a7dc55-9f23-44d4-afc2-492760d62fd4-cert\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.791803 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.791781    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98a7dc55-9f23-44d4-afc2-492760d62fd4-metrics-cert\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.807618 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.807575    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj2rs\" (UniqueName: \"kubernetes.io/projected/98a7dc55-9f23-44d4-afc2-492760d62fd4-kube-api-access-bj2rs\") pod \"lws-controller-manager-5f877cc68b-krq7z\" (UID: \"98a7dc55-9f23-44d4-afc2-492760d62fd4\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:10.905384 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:10.905353    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:11.185923 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:11.185895    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"]
Sep 18 13:51:11.187951 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:51:11.187925    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a7dc55_9f23_44d4_afc2_492760d62fd4.slice/crio-d294512dec21b6107f3792c066403234a3d8a17da30c4b47cea8b0050eed9bd2 WatchSource:0}: Error finding container d294512dec21b6107f3792c066403234a3d8a17da30c4b47cea8b0050eed9bd2: Status 404 returned error can't find the container with id d294512dec21b6107f3792c066403234a3d8a17da30c4b47cea8b0050eed9bd2
Sep 18 13:51:11.403329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:11.403251    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z" event={"ID":"98a7dc55-9f23-44d4-afc2-492760d62fd4","Type":"ContainerStarted","Data":"d294512dec21b6107f3792c066403234a3d8a17da30c4b47cea8b0050eed9bd2"}
Sep 18 13:51:14.420729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:14.420694    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z" event={"ID":"98a7dc55-9f23-44d4-afc2-492760d62fd4","Type":"ContainerStarted","Data":"ffbcd7a66528edf343e28d3d69ee946886d3f53530c36d21a6fdbc07ac44b756"}
Sep 18 13:51:14.421121 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:14.420825    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:14.460932 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:14.460877    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z" podStartSLOduration=2.029515551 podStartE2EDuration="4.460855652s" totalImagesPullingTime="2.431340101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:14.459480213 +0000 UTC m=+384.959237725" watchObservedRunningTime="2026-09-18 13:51:14.460855652 +0000 UTC m=+384.960613168"
Sep 18 13:51:15.651027 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.650996    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"]
Sep 18 13:51:15.654703 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.654616    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.657302 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.657278    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 18 13:51:15.657392 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.657375    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-v4ckq\""
Sep 18 13:51:15.670844 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.670811    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"]
Sep 18 13:51:15.743817 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.743781    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9a20003-2003-42ed-b83d-c65844bffee3-cert\") pod \"kserve-controller-manager-d6f4b65b8-7ll9m\" (UID: \"e9a20003-2003-42ed-b83d-c65844bffee3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.744024 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.743940    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8c7\" (UniqueName: \"kubernetes.io/projected/e9a20003-2003-42ed-b83d-c65844bffee3-kube-api-access-md8c7\") pod \"kserve-controller-manager-d6f4b65b8-7ll9m\" (UID: \"e9a20003-2003-42ed-b83d-c65844bffee3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.844878 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.844843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9a20003-2003-42ed-b83d-c65844bffee3-cert\") pod \"kserve-controller-manager-d6f4b65b8-7ll9m\" (UID: \"e9a20003-2003-42ed-b83d-c65844bffee3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.845099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.844919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8c7\" (UniqueName: \"kubernetes.io/projected/e9a20003-2003-42ed-b83d-c65844bffee3-kube-api-access-md8c7\") pod \"kserve-controller-manager-d6f4b65b8-7ll9m\" (UID: \"e9a20003-2003-42ed-b83d-c65844bffee3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.847528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.847503    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9a20003-2003-42ed-b83d-c65844bffee3-cert\") pod \"kserve-controller-manager-d6f4b65b8-7ll9m\" (UID: \"e9a20003-2003-42ed-b83d-c65844bffee3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.862363 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.862327    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8c7\" (UniqueName: \"kubernetes.io/projected/e9a20003-2003-42ed-b83d-c65844bffee3-kube-api-access-md8c7\") pod \"kserve-controller-manager-d6f4b65b8-7ll9m\" (UID: \"e9a20003-2003-42ed-b83d-c65844bffee3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:15.965108 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:15.965072    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:16.262115 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:16.262026    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"]
Sep 18 13:51:16.264883 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:51:16.264856    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a20003_2003_42ed_b83d_c65844bffee3.slice/crio-348057eb352e85bae56f305c44324c43e78324881ba26f58a6d218b97d8d429d WatchSource:0}: Error finding container 348057eb352e85bae56f305c44324c43e78324881ba26f58a6d218b97d8d429d: Status 404 returned error can't find the container with id 348057eb352e85bae56f305c44324c43e78324881ba26f58a6d218b97d8d429d
Sep 18 13:51:16.431696 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:16.431658    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m" event={"ID":"e9a20003-2003-42ed-b83d-c65844bffee3","Type":"ContainerStarted","Data":"348057eb352e85bae56f305c44324c43e78324881ba26f58a6d218b97d8d429d"}
Sep 18 13:51:19.454103 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:19.454070    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m" event={"ID":"e9a20003-2003-42ed-b83d-c65844bffee3","Type":"ContainerStarted","Data":"ca50cac235c684cee84ebd37c2f8a5040d2d35d0f4553f25f3971722dcb6255e"}
Sep 18 13:51:19.454567 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:19.454184    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:51:19.482926 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:19.482868    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m" podStartSLOduration=1.919981264 podStartE2EDuration="4.482851027s" totalImagesPullingTime="2.562869763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:19.482567691 +0000 UTC m=+389.982325233" watchObservedRunningTime="2026-09-18 13:51:19.482851027 +0000 UTC m=+389.982608544"
Sep 18 13:51:20.399321 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:20.399286    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ksxrr"
Sep 18 13:51:25.427574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:25.427534    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-krq7z"
Sep 18 13:51:50.464949 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:51:50.464920    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7ll9m"
Sep 18 13:52:23.094259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.094176    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"]
Sep 18 13:52:23.096863 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.096844    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.098751 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.098736    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 13:52:23.099082 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.099062    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 13:52:23.099323 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.099307    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r7g84\""
Sep 18 13:52:23.117070 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.117046    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"]
Sep 18 13:52:23.149378 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.149344    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjbmq\" (UniqueName: \"kubernetes.io/projected/06099622-c204-4ca9-823e-465e7600a7cf-kube-api-access-xjbmq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.149561 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.149394    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06099622-c204-4ca9-823e-465e7600a7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.250749 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.250717    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06099622-c204-4ca9-823e-465e7600a7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.250919 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.250810    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjbmq\" (UniqueName: \"kubernetes.io/projected/06099622-c204-4ca9-823e-465e7600a7cf-kube-api-access-xjbmq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.251141 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.251115    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06099622-c204-4ca9-823e-465e7600a7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.259968 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.259939    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjbmq\" (UniqueName: \"kubernetes.io/projected/06099622-c204-4ca9-823e-465e7600a7cf-kube-api-access-xjbmq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.406676 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.406590    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:23.706232 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.706195    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"]
Sep 18 13:52:23.709905 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:52:23.709877    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06099622_c204_4ca9_823e_465e7600a7cf.slice/crio-698a1892c745f7f6695415e9576e44e141a30fdc5c9d254fd95c572c0fc6341a WatchSource:0}: Error finding container 698a1892c745f7f6695415e9576e44e141a30fdc5c9d254fd95c572c0fc6341a: Status 404 returned error can't find the container with id 698a1892c745f7f6695415e9576e44e141a30fdc5c9d254fd95c572c0fc6341a
Sep 18 13:52:23.765475 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:23.765437    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8" event={"ID":"06099622-c204-4ca9-823e-465e7600a7cf","Type":"ContainerStarted","Data":"698a1892c745f7f6695415e9576e44e141a30fdc5c9d254fd95c572c0fc6341a"}
Sep 18 13:52:27.884471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:27.884436    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"]
Sep 18 13:52:27.887076 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:27.887054    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:27.892485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:27.892459    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bqlqp\""
Sep 18 13:52:27.903232 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:27.903201    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"]
Sep 18 13:52:28.001614 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.001588    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwchj\" (UniqueName: \"kubernetes.io/projected/1a5cc259-9cea-40c7-bd77-f7f732df343e-kube-api-access-vwchj\") pod \"limitador-operator-controller-manager-74495c69f8-5g885\" (UID: \"1a5cc259-9cea-40c7-bd77-f7f732df343e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:28.103080 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.103044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwchj\" (UniqueName: \"kubernetes.io/projected/1a5cc259-9cea-40c7-bd77-f7f732df343e-kube-api-access-vwchj\") pod \"limitador-operator-controller-manager-74495c69f8-5g885\" (UID: \"1a5cc259-9cea-40c7-bd77-f7f732df343e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:28.113754 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.113725    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwchj\" (UniqueName: \"kubernetes.io/projected/1a5cc259-9cea-40c7-bd77-f7f732df343e-kube-api-access-vwchj\") pod \"limitador-operator-controller-manager-74495c69f8-5g885\" (UID: \"1a5cc259-9cea-40c7-bd77-f7f732df343e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:28.199045 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.199018    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:28.481164 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.481137    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"]
Sep 18 13:52:28.484244 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:52:28.484215    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5cc259_9cea_40c7_bd77_f7f732df343e.slice/crio-8a9e2114cd85d895ac2695fcda1a04a567dac2b00bac06d8965bc1be36fbc40d WatchSource:0}: Error finding container 8a9e2114cd85d895ac2695fcda1a04a567dac2b00bac06d8965bc1be36fbc40d: Status 404 returned error can't find the container with id 8a9e2114cd85d895ac2695fcda1a04a567dac2b00bac06d8965bc1be36fbc40d
Sep 18 13:52:28.798168 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.798064    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885" event={"ID":"1a5cc259-9cea-40c7-bd77-f7f732df343e","Type":"ContainerStarted","Data":"8a9e2114cd85d895ac2695fcda1a04a567dac2b00bac06d8965bc1be36fbc40d"}
Sep 18 13:52:28.800058 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.800027    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8" event={"ID":"06099622-c204-4ca9-823e-465e7600a7cf","Type":"ContainerStarted","Data":"089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612"}
Sep 18 13:52:28.800199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.800178    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:28.827545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:28.827489    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8" podStartSLOduration=1.5965990300000001 podStartE2EDuration="5.827471709s" totalImagesPullingTime="4.230872679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:28.827315875 +0000 UTC m=+459.327073392" watchObservedRunningTime="2026-09-18 13:52:28.827471709 +0000 UTC m=+459.327229224"
Sep 18 13:52:30.814155 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:30.814093    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885" event={"ID":"1a5cc259-9cea-40c7-bd77-f7f732df343e","Type":"ContainerStarted","Data":"7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b"}
Sep 18 13:52:30.814634 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:30.814364    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:30.841121 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:30.840931    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885" podStartSLOduration=2.261282121 podStartE2EDuration="3.840910008s" totalImagesPullingTime="1.579627887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:30.839590174 +0000 UTC m=+461.339347691" watchObservedRunningTime="2026-09-18 13:52:30.840910008 +0000 UTC m=+461.340667542"
Sep 18 13:52:39.808273 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:39.808238    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:41.821251 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:41.821219    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:41.965329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:41.965289    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"]
Sep 18 13:52:41.967917 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:41.967893    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:41.984357 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:41.984325    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"]
Sep 18 13:52:41.994616 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:41.994590    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"]
Sep 18 13:52:41.994887 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:41.994868    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-svzgj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl" podUID="fc800e0d-7c5d-4e15-9d8c-907506d7c357"
Sep 18 13:52:42.015992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.015958    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"]
Sep 18 13:52:42.029397 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.029367    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"]
Sep 18 13:52:42.029609 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.029582    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8" podUID="06099622-c204-4ca9-823e-465e7600a7cf" containerName="manager" containerID="cri-o://089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612" gracePeriod=2
Sep 18 13:52:42.031458 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.031406    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svzgj\" (UniqueName: \"kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.031588 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.031509    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc800e0d-7c5d-4e15-9d8c-907506d7c357-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.052580 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.052547    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"]
Sep 18 13:52:42.058393 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.058356    2585 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"06099622-c204-4ca9-823e-465e7600a7cf\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\": pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.071791 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.071723    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"]
Sep 18 13:52:42.072094 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.072083    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06099622-c204-4ca9-823e-465e7600a7cf" containerName="manager"
Sep 18 13:52:42.072135 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.072096    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="06099622-c204-4ca9-823e-465e7600a7cf" containerName="manager"
Sep 18 13:52:42.072174 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.072165    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="06099622-c204-4ca9-823e-465e7600a7cf" containerName="manager"
Sep 18 13:52:42.074213 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.074193    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.078074 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.078049    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"]
Sep 18 13:52:42.078234 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.078214    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" containerName="manager" containerID="cri-o://7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b" gracePeriod=2
Sep 18 13:52:42.088147 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.088117    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"]
Sep 18 13:52:42.099452 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.099403    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"]
Sep 18 13:52:42.123750 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.123243    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.124223 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.124105    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"]
Sep 18 13:52:42.124722 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.124699    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" containerName="manager"
Sep 18 13:52:42.124722 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.124721    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" containerName="manager"
Sep 18 13:52:42.124924 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.124830    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" containerName="manager"
Sep 18 13:52:42.126402 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.126364    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5g885\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.127361 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.127339    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:42.129961 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.129937    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.131465 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.131440    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5g885\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.132778 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.132757    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc800e0d-7c5d-4e15-9d8c-907506d7c357-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.132865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.132831    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzgj\" (UniqueName: \"kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.133143 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.133117    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc800e0d-7c5d-4e15-9d8c-907506d7c357-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.133219 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.133193    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.136697 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.136677    2585 projected.go:196] Error preparing data for projected volume kube-api-access-svzgj for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-snbtl" not found
Sep 18 13:52:42.136803 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.136740    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj podName:fc800e0d-7c5d-4e15-9d8c-907506d7c357 nodeName:}" failed. No retries permitted until 2026-09-18 13:52:42.636723685 +0000 UTC m=+473.136481178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-svzgj" (UniqueName: "kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj") pod "kuadrant-operator-controller-manager-5769f99d9f-snbtl" (UID: "fc800e0d-7c5d-4e15-9d8c-907506d7c357") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-snbtl" not found
Sep 18 13:52:42.145258 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.145229    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"]
Sep 18 13:52:42.233630 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.233543    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5qb\" (UniqueName: \"kubernetes.io/projected/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-kube-api-access-lx5qb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqx9p\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.233630 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.233607    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnmk\" (UniqueName: \"kubernetes.io/projected/9cada3d3-d5b3-4873-9847-833f730f873b-kube-api-access-7vnmk\") pod \"limitador-operator-controller-manager-74495c69f8-snjlp\" (UID: \"9cada3d3-d5b3-4873-9847-833f730f873b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:42.233870 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.233643    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqx9p\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.324464 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.324377    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.326451 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.326402    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.327697 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.327681    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.328095 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.328071    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5g885\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.329666 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.329638    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5g885\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.331099 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.331079    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.334555 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.334535    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5qb\" (UniqueName: \"kubernetes.io/projected/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-kube-api-access-lx5qb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqx9p\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.334612 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.334583    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnmk\" (UniqueName: \"kubernetes.io/projected/9cada3d3-d5b3-4873-9847-833f730f873b-kube-api-access-7vnmk\") pod \"limitador-operator-controller-manager-74495c69f8-snjlp\" (UID: \"9cada3d3-d5b3-4873-9847-833f730f873b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:42.334651 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.334613    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqx9p\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.334972 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.334957    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqx9p\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.345448 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.345406    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5qb\" (UniqueName: \"kubernetes.io/projected/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-kube-api-access-lx5qb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqx9p\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.345536 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.345479    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnmk\" (UniqueName: \"kubernetes.io/projected/9cada3d3-d5b3-4873-9847-833f730f873b-kube-api-access-7vnmk\") pod \"limitador-operator-controller-manager-74495c69f8-snjlp\" (UID: \"9cada3d3-d5b3-4873-9847-833f730f873b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:42.435774 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.435733    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjbmq\" (UniqueName: \"kubernetes.io/projected/06099622-c204-4ca9-823e-465e7600a7cf-kube-api-access-xjbmq\") pod \"06099622-c204-4ca9-823e-465e7600a7cf\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") "
Sep 18 13:52:42.435774 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.435778    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06099622-c204-4ca9-823e-465e7600a7cf-extensions-socket-volume\") pod \"06099622-c204-4ca9-823e-465e7600a7cf\" (UID: \"06099622-c204-4ca9-823e-465e7600a7cf\") "
Sep 18 13:52:42.436078 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.435843    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwchj\" (UniqueName: \"kubernetes.io/projected/1a5cc259-9cea-40c7-bd77-f7f732df343e-kube-api-access-vwchj\") pod \"1a5cc259-9cea-40c7-bd77-f7f732df343e\" (UID: \"1a5cc259-9cea-40c7-bd77-f7f732df343e\") "
Sep 18 13:52:42.436406 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.436340    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06099622-c204-4ca9-823e-465e7600a7cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06099622-c204-4ca9-823e-465e7600a7cf" (UID: "06099622-c204-4ca9-823e-465e7600a7cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:52:42.438404 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.438375    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06099622-c204-4ca9-823e-465e7600a7cf-kube-api-access-xjbmq" (OuterVolumeSpecName: "kube-api-access-xjbmq") pod "06099622-c204-4ca9-823e-465e7600a7cf" (UID: "06099622-c204-4ca9-823e-465e7600a7cf"). InnerVolumeSpecName "kube-api-access-xjbmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:42.438619 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.438590    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a5cc259-9cea-40c7-bd77-f7f732df343e-kube-api-access-vwchj" (OuterVolumeSpecName: "kube-api-access-vwchj") pod "1a5cc259-9cea-40c7-bd77-f7f732df343e" (UID: "1a5cc259-9cea-40c7-bd77-f7f732df343e"). InnerVolumeSpecName "kube-api-access-vwchj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:42.469943 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.469911    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.475410 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.475382    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:42.537282 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.537243    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjbmq\" (UniqueName: \"kubernetes.io/projected/06099622-c204-4ca9-823e-465e7600a7cf-kube-api-access-xjbmq\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:42.537396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.537283    2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06099622-c204-4ca9-823e-465e7600a7cf-extensions-socket-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:42.537396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.537302    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwchj\" (UniqueName: \"kubernetes.io/projected/1a5cc259-9cea-40c7-bd77-f7f732df343e-kube-api-access-vwchj\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:42.638509 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.638394    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzgj\" (UniqueName: \"kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.642034 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.642011    2585 projected.go:196] Error preparing data for projected volume kube-api-access-svzgj for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-snbtl" not found
Sep 18 13:52:42.642168 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.642085    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj podName:fc800e0d-7c5d-4e15-9d8c-907506d7c357 nodeName:}" failed. No retries permitted until 2026-09-18 13:52:43.642065332 +0000 UTC m=+474.141822826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-svzgj" (UniqueName: "kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj") pod "kuadrant-operator-controller-manager-5769f99d9f-snbtl" (UID: "fc800e0d-7c5d-4e15-9d8c-907506d7c357") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-snbtl" not found
Sep 18 13:52:42.752341 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.752316    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"]
Sep 18 13:52:42.754690 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:52:42.754660    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2274b2ee_bf65_404a_9b2e_4efea78b3cb3.slice/crio-ac87556009a909e7e639f15e6513aeab7833fc709ccab371912e43b66934d9f3 WatchSource:0}: Error finding container ac87556009a909e7e639f15e6513aeab7833fc709ccab371912e43b66934d9f3: Status 404 returned error can't find the container with id ac87556009a909e7e639f15e6513aeab7833fc709ccab371912e43b66934d9f3
Sep 18 13:52:42.756604 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.756582    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"]
Sep 18 13:52:42.757934 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:52:42.757914    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cada3d3_d5b3_4873_9847_833f730f873b.slice/crio-9ad818de1aa160d22768482038718808956f0209ed3e1b7e52b5552a670d0d4d WatchSource:0}: Error finding container 9ad818de1aa160d22768482038718808956f0209ed3e1b7e52b5552a670d0d4d: Status 404 returned error can't find the container with id 9ad818de1aa160d22768482038718808956f0209ed3e1b7e52b5552a670d0d4d
Sep 18 13:52:42.880191 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.880156    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp" event={"ID":"9cada3d3-d5b3-4873-9847-833f730f873b","Type":"ContainerStarted","Data":"f72b45f0e3d949254f5b477e3ce4ba8f314d7658c8b52ba8a56c6c711e2992f8"}
Sep 18 13:52:42.880675 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.880205    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp" event={"ID":"9cada3d3-d5b3-4873-9847-833f730f873b","Type":"ContainerStarted","Data":"9ad818de1aa160d22768482038718808956f0209ed3e1b7e52b5552a670d0d4d"}
Sep 18 13:52:42.880675 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.880247    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:42.881686 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.881662    2585 generic.go:356] "Generic (PLEG): container finished" podID="1a5cc259-9cea-40c7-bd77-f7f732df343e" containerID="7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b" exitCode=0
Sep 18 13:52:42.881801 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.881698    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.881801 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.881716    2585 scope.go:117] "RemoveContainer" containerID="7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b"
Sep 18 13:52:42.882352 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.882320    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5g885\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.883537 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.883520    2585 generic.go:356] "Generic (PLEG): container finished" podID="06099622-c204-4ca9-823e-465e7600a7cf" containerID="089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612" exitCode=0
Sep 18 13:52:42.883628 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.883598    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.884227 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.884181    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.885596 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.885562    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p" event={"ID":"2274b2ee-bf65-404a-9b2e-4efea78b3cb3","Type":"ContainerStarted","Data":"013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41"}
Sep 18 13:52:42.885697 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.885607    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p" event={"ID":"2274b2ee-bf65-404a-9b2e-4efea78b3cb3","Type":"ContainerStarted","Data":"ac87556009a909e7e639f15e6513aeab7833fc709ccab371912e43b66934d9f3"}
Sep 18 13:52:42.885697 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.885642    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:42.885697 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.885669    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.891331 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.891319    2585 scope.go:117] "RemoveContainer" containerID="7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b"
Sep 18 13:52:42.891803 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.891763    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b\": container with ID starting with 7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b not found: ID does not exist" containerID="7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b"
Sep 18 13:52:42.891904 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.891801    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b"} err="failed to get container status \"7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b\": rpc error: code = NotFound desc = could not find container \"7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b\": container with ID starting with 7ed791acfe223c68a731833d9fef7269f2ea26f71b86eafa94d9e3d044f0476b not found: ID does not exist"
Sep 18 13:52:42.891904 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.891825    2585 scope.go:117] "RemoveContainer" containerID="089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612"
Sep 18 13:52:42.893279 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.893261    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.900495 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.900480    2585 scope.go:117] "RemoveContainer" containerID="089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612"
Sep 18 13:52:42.900867 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.900841    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612\": container with ID starting with 089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612 not found: ID does not exist" containerID="089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612"
Sep 18 13:52:42.900937 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.900871    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612"} err="failed to get container status \"089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612\": rpc error: code = NotFound desc = could not find container \"089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612\": container with ID starting with 089660404e9216256371249a6bb76517b3e2c45269a61ebdde805341b298c612 not found: ID does not exist"
Sep 18 13:52:42.902756 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.902731    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5g885\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5g885"
Sep 18 13:52:42.903453 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.903383    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp" podStartSLOduration=0.90337077 podStartE2EDuration="903.37077ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:42.901120605 +0000 UTC m=+473.400878121" watchObservedRunningTime="2026-09-18 13:52:42.90337077 +0000 UTC m=+473.403128286"
Sep 18 13:52:42.913255 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.913219    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="fc800e0d-7c5d-4e15-9d8c-907506d7c357" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:42.914955 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:42.914929    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c7sm8\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="06099622-c204-4ca9-823e-465e7600a7cf" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c7sm8"
Sep 18 13:52:42.948075 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:42.948014    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p" podStartSLOduration=0.947998784 podStartE2EDuration="947.998784ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:52:42.946104715 +0000 UTC m=+473.445862265" watchObservedRunningTime="2026-09-18 13:52:42.947998784 +0000 UTC m=+473.447756300"
Sep 18 13:52:43.042230 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.042200    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc800e0d-7c5d-4e15-9d8c-907506d7c357-extensions-socket-volume\") pod \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\" (UID: \"fc800e0d-7c5d-4e15-9d8c-907506d7c357\") "
Sep 18 13:52:43.042549 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.042522    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc800e0d-7c5d-4e15-9d8c-907506d7c357-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc800e0d-7c5d-4e15-9d8c-907506d7c357" (UID: "fc800e0d-7c5d-4e15-9d8c-907506d7c357"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:52:43.042665 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.042555    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svzgj\" (UniqueName: \"kubernetes.io/projected/fc800e0d-7c5d-4e15-9d8c-907506d7c357-kube-api-access-svzgj\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:43.143326 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.143246    2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc800e0d-7c5d-4e15-9d8c-907506d7c357-extensions-socket-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:43.646432 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.646390    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06099622-c204-4ca9-823e-465e7600a7cf" path="/var/lib/kubelet/pods/06099622-c204-4ca9-823e-465e7600a7cf/volumes"
Sep 18 13:52:43.646820 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.646789    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a5cc259-9cea-40c7-bd77-f7f732df343e" path="/var/lib/kubelet/pods/1a5cc259-9cea-40c7-bd77-f7f732df343e/volumes"
Sep 18 13:52:43.647149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.647129    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc800e0d-7c5d-4e15-9d8c-907506d7c357" path="/var/lib/kubelet/pods/fc800e0d-7c5d-4e15-9d8c-907506d7c357/volumes"
Sep 18 13:52:43.892992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:43.892963    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:43.899632 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:43.899560    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-snbtl\" is forbidden: User \"system:node:ip-10-0-132-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-83.ec2.internal' and this object" podUID="fc800e0d-7c5d-4e15-9d8c-907506d7c357" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snbtl"
Sep 18 13:52:53.895356 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:53.895324    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:53.895823 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:53.895394    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-snjlp"
Sep 18 13:52:57.517994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.517956    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"]
Sep 18 13:52:57.518976 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.518934    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p" podUID="2274b2ee-bf65-404a-9b2e-4efea78b3cb3" containerName="manager" containerID="cri-o://013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41" gracePeriod=10
Sep 18 13:52:57.762875 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.762847    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:57.783454 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.783315    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-extensions-socket-volume\") pod \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") "
Sep 18 13:52:57.783454 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.783354    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx5qb\" (UniqueName: \"kubernetes.io/projected/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-kube-api-access-lx5qb\") pod \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\" (UID: \"2274b2ee-bf65-404a-9b2e-4efea78b3cb3\") "
Sep 18 13:52:57.783804 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.783762    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2274b2ee-bf65-404a-9b2e-4efea78b3cb3" (UID: "2274b2ee-bf65-404a-9b2e-4efea78b3cb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:52:57.785865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.785835    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-kube-api-access-lx5qb" (OuterVolumeSpecName: "kube-api-access-lx5qb") pod "2274b2ee-bf65-404a-9b2e-4efea78b3cb3" (UID: "2274b2ee-bf65-404a-9b2e-4efea78b3cb3"). InnerVolumeSpecName "kube-api-access-lx5qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:57.884901 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.884862    2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-extensions-socket-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:57.884901 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.884895    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx5qb\" (UniqueName: \"kubernetes.io/projected/2274b2ee-bf65-404a-9b2e-4efea78b3cb3-kube-api-access-lx5qb\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:52:57.965340 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.965303    2585 generic.go:356] "Generic (PLEG): container finished" podID="2274b2ee-bf65-404a-9b2e-4efea78b3cb3" containerID="013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41" exitCode=0
Sep 18 13:52:57.965340 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.965343    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p" event={"ID":"2274b2ee-bf65-404a-9b2e-4efea78b3cb3","Type":"ContainerDied","Data":"013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41"}
Sep 18 13:52:57.965585 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.965347    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"
Sep 18 13:52:57.965585 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.965381    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p" event={"ID":"2274b2ee-bf65-404a-9b2e-4efea78b3cb3","Type":"ContainerDied","Data":"ac87556009a909e7e639f15e6513aeab7833fc709ccab371912e43b66934d9f3"}
Sep 18 13:52:57.965585 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.965402    2585 scope.go:117] "RemoveContainer" containerID="013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41"
Sep 18 13:52:57.974642 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.974625    2585 scope.go:117] "RemoveContainer" containerID="013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41"
Sep 18 13:52:57.974922 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:52:57.974902    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41\": container with ID starting with 013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41 not found: ID does not exist" containerID="013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41"
Sep 18 13:52:57.974971 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.974934    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41"} err="failed to get container status \"013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41\": rpc error: code = NotFound desc = could not find container \"013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41\": container with ID starting with 013db67dc4546d979d15281c35384b6f218a413e7c3ebf7b417392d60ded1c41 not found: ID does not exist"
Sep 18 13:52:57.987972 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.987941    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"]
Sep 18 13:52:57.992162 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:57.992136    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqx9p"]
Sep 18 13:52:59.639891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:52:59.639850    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2274b2ee-bf65-404a-9b2e-4efea78b3cb3" path="/var/lib/kubelet/pods/2274b2ee-bf65-404a-9b2e-4efea78b3cb3/volumes"
Sep 18 13:53:13.845029 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.844994    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"]
Sep 18 13:53:13.845526 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.845509    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2274b2ee-bf65-404a-9b2e-4efea78b3cb3" containerName="manager"
Sep 18 13:53:13.845526 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.845527    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2274b2ee-bf65-404a-9b2e-4efea78b3cb3" containerName="manager"
Sep 18 13:53:13.845616 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.845601    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2274b2ee-bf65-404a-9b2e-4efea78b3cb3" containerName="manager"
Sep 18 13:53:13.847874 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.847859    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.850396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.850364    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 13:53:13.850538 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.850410    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bdpkh\""
Sep 18 13:53:13.850538 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.850457    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 13:53:13.850538 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.850459    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 13:53:13.859843 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.859819    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"]
Sep 18 13:53:13.937575 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937541    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937751 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937587    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937751 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937751 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937657    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937751 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937751 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937736    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937913 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937913 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937795    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xfk7\" (UniqueName: \"kubernetes.io/projected/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-kube-api-access-7xfk7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:13.937913 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:13.937813    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038291 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038253    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038291 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038291    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038597 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038308    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038597 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038453    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038597 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038491    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038597 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038526    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038678    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xfk7\" (UniqueName: \"kubernetes.io/projected/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-kube-api-access-7xfk7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038715    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038790    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038836    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.038964 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.038787    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.039153 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.039114    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.039291 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.039212    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.039291 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.039265    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.041298 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.041275    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.041522 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.041498    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.045869 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.045850    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.046078 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.046062    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xfk7\" (UniqueName: \"kubernetes.io/projected/9fb05eff-a90e-45b4-af4a-9d3bdab2f57b-kube-api-access-7xfk7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-kvtb6\" (UID: \"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.158584 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.158503    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:14.434177 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:14.434135    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"]
Sep 18 13:53:14.436878 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:53:14.436845    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb05eff_a90e_45b4_af4a_9d3bdab2f57b.slice/crio-a4d7b61d110b7be298dae9915acd45412d5d852937c0c378514419dfeafd783c WatchSource:0}: Error finding container a4d7b61d110b7be298dae9915acd45412d5d852937c0c378514419dfeafd783c: Status 404 returned error can't find the container with id a4d7b61d110b7be298dae9915acd45412d5d852937c0c378514419dfeafd783c
Sep 18 13:53:15.048353 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:15.048311    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" event={"ID":"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b","Type":"ContainerStarted","Data":"a4d7b61d110b7be298dae9915acd45412d5d852937c0c378514419dfeafd783c"}
Sep 18 13:53:17.013530 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:17.013497    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:53:17.013783 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:17.013570    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:53:17.013783 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:17.013600    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:53:18.066926 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:18.066891    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" event={"ID":"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b","Type":"ContainerStarted","Data":"fdcf74460896afa5e19b89bf3648104f093c5953dd95b2820ea0ed934663a2ae"}
Sep 18 13:53:18.087829 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:18.087774    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" podStartSLOduration=2.513428303 podStartE2EDuration="5.087757727s" totalImagesPullingTime="2.574329424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:18.086318449 +0000 UTC m=+508.586075976" watchObservedRunningTime="2026-09-18 13:53:18.087757727 +0000 UTC m=+508.587515243"
Sep 18 13:53:18.159506 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:18.159464    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:18.163965 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:18.163939    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:19.072703 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.072676    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:19.073774 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.073754    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:53:19.155562 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.155531    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:19.158159 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.158139    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.160340 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.160318    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tqd2r\""
Sep 18 13:53:19.160470 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.160318    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 13:53:19.173259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.173228    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:19.244763 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.244730    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:19.297551 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.297517    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvcv\" (UniqueName: \"kubernetes.io/projected/2af4d748-b2fb-472b-aac8-50269df86313-kube-api-access-7rvcv\") pod \"limitador-limitador-8588749977-hdqpq\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") " pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.297752 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.297573    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2af4d748-b2fb-472b-aac8-50269df86313-config-file\") pod \"limitador-limitador-8588749977-hdqpq\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") " pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.398696 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.398607    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2af4d748-b2fb-472b-aac8-50269df86313-config-file\") pod \"limitador-limitador-8588749977-hdqpq\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") " pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.398837 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.398712    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvcv\" (UniqueName: \"kubernetes.io/projected/2af4d748-b2fb-472b-aac8-50269df86313-kube-api-access-7rvcv\") pod \"limitador-limitador-8588749977-hdqpq\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") " pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.399272 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.399254    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2af4d748-b2fb-472b-aac8-50269df86313-config-file\") pod \"limitador-limitador-8588749977-hdqpq\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") " pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.408509 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.408477    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvcv\" (UniqueName: \"kubernetes.io/projected/2af4d748-b2fb-472b-aac8-50269df86313-kube-api-access-7rvcv\") pod \"limitador-limitador-8588749977-hdqpq\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") " pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.468790 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.468749    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:19.498563 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.498533    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:53:19.501558 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.501538    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.512347 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.512310    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:53:19.551613 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.551528    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:53:19.612440 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.610917    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ssqv\" (UniqueName: \"kubernetes.io/projected/49810666-cb3c-4a79-a030-83e78aeb5b7c-kube-api-access-6ssqv\") pod \"limitador-limitador-84994f7ffc-bkfdg\" (UID: \"49810666-cb3c-4a79-a030-83e78aeb5b7c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.612440 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.610995    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49810666-cb3c-4a79-a030-83e78aeb5b7c-config-file\") pod \"limitador-limitador-84994f7ffc-bkfdg\" (UID: \"49810666-cb3c-4a79-a030-83e78aeb5b7c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.712450 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.712403    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ssqv\" (UniqueName: \"kubernetes.io/projected/49810666-cb3c-4a79-a030-83e78aeb5b7c-kube-api-access-6ssqv\") pod \"limitador-limitador-84994f7ffc-bkfdg\" (UID: \"49810666-cb3c-4a79-a030-83e78aeb5b7c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.712635 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.712466    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49810666-cb3c-4a79-a030-83e78aeb5b7c-config-file\") pod \"limitador-limitador-84994f7ffc-bkfdg\" (UID: \"49810666-cb3c-4a79-a030-83e78aeb5b7c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.713106 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.713085    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49810666-cb3c-4a79-a030-83e78aeb5b7c-config-file\") pod \"limitador-limitador-84994f7ffc-bkfdg\" (UID: \"49810666-cb3c-4a79-a030-83e78aeb5b7c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.721916 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.721883    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ssqv\" (UniqueName: \"kubernetes.io/projected/49810666-cb3c-4a79-a030-83e78aeb5b7c-kube-api-access-6ssqv\") pod \"limitador-limitador-84994f7ffc-bkfdg\" (UID: \"49810666-cb3c-4a79-a030-83e78aeb5b7c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:19.748347 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.748323    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:19.750259 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:53:19.750226    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af4d748_b2fb_472b_aac8_50269df86313.slice/crio-6829143dfd4253cc5f85b4bdb62c8912d884e92de54aa7fb2cb4e9030c136a4e WatchSource:0}: Error finding container 6829143dfd4253cc5f85b4bdb62c8912d884e92de54aa7fb2cb4e9030c136a4e: Status 404 returned error can't find the container with id 6829143dfd4253cc5f85b4bdb62c8912d884e92de54aa7fb2cb4e9030c136a4e
Sep 18 13:53:19.814308 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:19.814269    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:20.079311 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:20.079223    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq" event={"ID":"2af4d748-b2fb-472b-aac8-50269df86313","Type":"ContainerStarted","Data":"6829143dfd4253cc5f85b4bdb62c8912d884e92de54aa7fb2cb4e9030c136a4e"}
Sep 18 13:53:20.086492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:20.086473    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:53:20.088453 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:53:20.088427    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49810666_cb3c_4a79_a030_83e78aeb5b7c.slice/crio-85ee580b8dadc1379b960fdded6d15b3c9492057b0821a73207ff553f0190c8f WatchSource:0}: Error finding container 85ee580b8dadc1379b960fdded6d15b3c9492057b0821a73207ff553f0190c8f: Status 404 returned error can't find the container with id 85ee580b8dadc1379b960fdded6d15b3c9492057b0821a73207ff553f0190c8f
Sep 18 13:53:21.086283 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.086244    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq" event={"ID":"2af4d748-b2fb-472b-aac8-50269df86313","Type":"ContainerStarted","Data":"abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd"}
Sep 18 13:53:21.086848 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.086432    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:21.087906 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.087875    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg" event={"ID":"49810666-cb3c-4a79-a030-83e78aeb5b7c","Type":"ContainerStarted","Data":"8f8a17cbd2037d8ea11bdd7d4c94e8e554fa4ea147d166aba60f984d3a325cff"}
Sep 18 13:53:21.088025 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.087926    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg" event={"ID":"49810666-cb3c-4a79-a030-83e78aeb5b7c","Type":"ContainerStarted","Data":"85ee580b8dadc1379b960fdded6d15b3c9492057b0821a73207ff553f0190c8f"}
Sep 18 13:53:21.088103 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.088087    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:21.103630 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.103538    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq" podStartSLOduration=1.003299543 podStartE2EDuration="2.103520913s" totalImagesPullingTime="1.10022137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:21.101631358 +0000 UTC m=+511.601388875" watchObservedRunningTime="2026-09-18 13:53:21.103520913 +0000 UTC m=+511.603278430"
Sep 18 13:53:21.119146 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:21.119095    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg" podStartSLOduration=1.354751074 podStartE2EDuration="2.119067366s" totalImagesPullingTime="764.316292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:21.11834898 +0000 UTC m=+511.618106499" watchObservedRunningTime="2026-09-18 13:53:21.119067366 +0000 UTC m=+511.618824882"
Sep 18 13:53:32.093133 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.093063    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:32.093133 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.093127    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"
Sep 18 13:53:32.154048 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.154014    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:32.154253 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.154206    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq" podUID="2af4d748-b2fb-472b-aac8-50269df86313" containerName="limitador" containerID="cri-o://abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd" gracePeriod=30
Sep 18 13:53:32.704071 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.704042    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:32.728275 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.728184    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2af4d748-b2fb-472b-aac8-50269df86313-config-file\") pod \"2af4d748-b2fb-472b-aac8-50269df86313\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") "
Sep 18 13:53:32.728275 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.728228    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rvcv\" (UniqueName: \"kubernetes.io/projected/2af4d748-b2fb-472b-aac8-50269df86313-kube-api-access-7rvcv\") pod \"2af4d748-b2fb-472b-aac8-50269df86313\" (UID: \"2af4d748-b2fb-472b-aac8-50269df86313\") "
Sep 18 13:53:32.728553 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.728530    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af4d748-b2fb-472b-aac8-50269df86313-config-file" (OuterVolumeSpecName: "config-file") pod "2af4d748-b2fb-472b-aac8-50269df86313" (UID: "2af4d748-b2fb-472b-aac8-50269df86313"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:53:32.730690 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.730662    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af4d748-b2fb-472b-aac8-50269df86313-kube-api-access-7rvcv" (OuterVolumeSpecName: "kube-api-access-7rvcv") pod "2af4d748-b2fb-472b-aac8-50269df86313" (UID: "2af4d748-b2fb-472b-aac8-50269df86313"). InnerVolumeSpecName "kube-api-access-7rvcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:53:32.829236 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.829189    2585 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2af4d748-b2fb-472b-aac8-50269df86313-config-file\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:53:32.829236 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:32.829230    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rvcv\" (UniqueName: \"kubernetes.io/projected/2af4d748-b2fb-472b-aac8-50269df86313-kube-api-access-7rvcv\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:53:33.149624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.149532    2585 generic.go:356] "Generic (PLEG): container finished" podID="2af4d748-b2fb-472b-aac8-50269df86313" containerID="abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd" exitCode=0
Sep 18 13:53:33.149624 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.149593    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq"
Sep 18 13:53:33.150104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.149620    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq" event={"ID":"2af4d748-b2fb-472b-aac8-50269df86313","Type":"ContainerDied","Data":"abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd"}
Sep 18 13:53:33.150104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.149694    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hdqpq" event={"ID":"2af4d748-b2fb-472b-aac8-50269df86313","Type":"ContainerDied","Data":"6829143dfd4253cc5f85b4bdb62c8912d884e92de54aa7fb2cb4e9030c136a4e"}
Sep 18 13:53:33.150104 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.149716    2585 scope.go:117] "RemoveContainer" containerID="abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd"
Sep 18 13:53:33.158944 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.158788    2585 scope.go:117] "RemoveContainer" containerID="abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd"
Sep 18 13:53:33.159094 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:53:33.159078    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd\": container with ID starting with abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd not found: ID does not exist" containerID="abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd"
Sep 18 13:53:33.159132 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.159101    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd"} err="failed to get container status \"abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd\": rpc error: code = NotFound desc = could not find container \"abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd\": container with ID starting with abb68f9c4d543d5bd0da8e35bd5791ec2b64d7cadc3faa37877299fd2f04cedd not found: ID does not exist"
Sep 18 13:53:33.169409 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.169372    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:33.172927 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.172893    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hdqpq"]
Sep 18 13:53:33.640885 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:33.640841    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af4d748-b2fb-472b-aac8-50269df86313" path="/var/lib/kubelet/pods/2af4d748-b2fb-472b-aac8-50269df86313/volumes"
Sep 18 13:53:35.586374 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.586338    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"]
Sep 18 13:53:35.586932 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.586915    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af4d748-b2fb-472b-aac8-50269df86313" containerName="limitador"
Sep 18 13:53:35.586987 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.586934    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af4d748-b2fb-472b-aac8-50269df86313" containerName="limitador"
Sep 18 13:53:35.587023 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.587002    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af4d748-b2fb-472b-aac8-50269df86313" containerName="limitador"
Sep 18 13:53:35.589757 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.589737    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.593616 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.593594    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 13:53:35.594126 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.594107    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 13:53:35.594234 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.594146    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9n8tt\""
Sep 18 13:53:35.596767 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.596591    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 13:53:35.609433 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.609385    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"]
Sep 18 13:53:35.655993 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.655948    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92694f8a-54f9-4526-9806-54d4d804eac8-data\") pod \"postgres-69fb4594cf-g9mcx\" (UID: \"92694f8a-54f9-4526-9806-54d4d804eac8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.656182 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.656029    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2shpn\" (UniqueName: \"kubernetes.io/projected/92694f8a-54f9-4526-9806-54d4d804eac8-kube-api-access-2shpn\") pod \"postgres-69fb4594cf-g9mcx\" (UID: \"92694f8a-54f9-4526-9806-54d4d804eac8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.757336 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.757295    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92694f8a-54f9-4526-9806-54d4d804eac8-data\") pod \"postgres-69fb4594cf-g9mcx\" (UID: \"92694f8a-54f9-4526-9806-54d4d804eac8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.757560 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.757373    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2shpn\" (UniqueName: \"kubernetes.io/projected/92694f8a-54f9-4526-9806-54d4d804eac8-kube-api-access-2shpn\") pod \"postgres-69fb4594cf-g9mcx\" (UID: \"92694f8a-54f9-4526-9806-54d4d804eac8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.757802 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.757781    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92694f8a-54f9-4526-9806-54d4d804eac8-data\") pod \"postgres-69fb4594cf-g9mcx\" (UID: \"92694f8a-54f9-4526-9806-54d4d804eac8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.769475 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.769443    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2shpn\" (UniqueName: \"kubernetes.io/projected/92694f8a-54f9-4526-9806-54d4d804eac8-kube-api-access-2shpn\") pod \"postgres-69fb4594cf-g9mcx\" (UID: \"92694f8a-54f9-4526-9806-54d4d804eac8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:35.900677 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:35.900590    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:36.172127 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:36.172103    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"]
Sep 18 13:53:36.174243 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:53:36.174216    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92694f8a_54f9_4526_9806_54d4d804eac8.slice/crio-b312956cff0ee427d7802965a30d9aa809ed9a3430751f72b94bfbe493c4723f WatchSource:0}: Error finding container b312956cff0ee427d7802965a30d9aa809ed9a3430751f72b94bfbe493c4723f: Status 404 returned error can't find the container with id b312956cff0ee427d7802965a30d9aa809ed9a3430751f72b94bfbe493c4723f
Sep 18 13:53:37.177199 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:37.177161    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx" event={"ID":"92694f8a-54f9-4526-9806-54d4d804eac8","Type":"ContainerStarted","Data":"b312956cff0ee427d7802965a30d9aa809ed9a3430751f72b94bfbe493c4723f"}
Sep 18 13:53:41.203554 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:41.203506    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx" event={"ID":"92694f8a-54f9-4526-9806-54d4d804eac8","Type":"ContainerStarted","Data":"9aaa576114fe37a0ab2960af15369393ceaccc82b18fe585ce138fbde65d2b87"}
Sep 18 13:53:41.204000 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:41.203622    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:41.224887 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:41.224825    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx" podStartSLOduration=1.573214708 podStartE2EDuration="6.224808664s" totalImagesPullingTime="4.651593956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:41.223227437 +0000 UTC m=+531.722984952" watchObservedRunningTime="2026-09-18 13:53:41.224808664 +0000 UTC m=+531.724566179"
Sep 18 13:53:47.238578 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:47.238550    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g9mcx"
Sep 18 13:53:54.084456 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.084408    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6865b5c455-ctpx2"]
Sep 18 13:53:54.104485 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.104454    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6865b5c455-ctpx2"]
Sep 18 13:53:54.104675 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.104561    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.107359 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.107322    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 13:53:54.107359 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.107323    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 13:53:54.107591 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.107382    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 13:53:54.107591 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.107516    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhzv4\""
Sep 18 13:53:54.234999 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.234968    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.235206 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.235011    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-metrics-certs\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.235206 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.235104    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqj2\" (UniqueName: \"kubernetes.io/projected/99e52e07-ea18-4683-8d18-24138c1c52c7-kube-api-access-swqj2\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.335739 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.335648    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.335739 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.335694    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-metrics-certs\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.335984 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:53:54.335808    2585 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 18 13:53:54.335984 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.335823    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqj2\" (UniqueName: \"kubernetes.io/projected/99e52e07-ea18-4683-8d18-24138c1c52c7-kube-api-access-swqj2\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.335984 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:53:54.335897    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert podName:99e52e07-ea18-4683-8d18-24138c1c52c7 nodeName:}" failed. No retries permitted until 2026-09-18 13:53:54.83587526 +0000 UTC m=+545.335632770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert") pod "maas-controller-6865b5c455-ctpx2" (UID: "99e52e07-ea18-4683-8d18-24138c1c52c7") : secret "maas-controller-webhook-cert" not found
Sep 18 13:53:54.338315 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.338291    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-metrics-certs\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.355823 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.355794    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqj2\" (UniqueName: \"kubernetes.io/projected/99e52e07-ea18-4683-8d18-24138c1c52c7-kube-api-access-swqj2\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.841625 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.841592    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:54.844157 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:54.844126    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert\") pod \"maas-controller-6865b5c455-ctpx2\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") " pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:55.015326 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:55.015284    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:55.289273 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:55.289252    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6865b5c455-ctpx2"]
Sep 18 13:53:55.291502 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:53:55.291479    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e52e07_ea18_4683_8d18_24138c1c52c7.slice/crio-3a59e5426d61214f97c12c980362a63861e29d3ce98ad5614f42d7eff2ab3200 WatchSource:0}: Error finding container 3a59e5426d61214f97c12c980362a63861e29d3ce98ad5614f42d7eff2ab3200: Status 404 returned error can't find the container with id 3a59e5426d61214f97c12c980362a63861e29d3ce98ad5614f42d7eff2ab3200
Sep 18 13:53:56.282283 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:56.282215    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-ctpx2" event={"ID":"99e52e07-ea18-4683-8d18-24138c1c52c7","Type":"ContainerStarted","Data":"3a59e5426d61214f97c12c980362a63861e29d3ce98ad5614f42d7eff2ab3200"}
Sep 18 13:53:58.295403 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:58.295367    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-ctpx2" event={"ID":"99e52e07-ea18-4683-8d18-24138c1c52c7","Type":"ContainerStarted","Data":"cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404"}
Sep 18 13:53:58.295824 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:58.295502    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:53:58.319915 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:53:58.319855    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6865b5c455-ctpx2" podStartSLOduration=1.87720803 podStartE2EDuration="4.319833415s" totalImagesPullingTime="2.442625385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:58.317700997 +0000 UTC m=+548.817458514" watchObservedRunningTime="2026-09-18 13:53:58.319833415 +0000 UTC m=+548.819590932"
Sep 18 13:54:08.890914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:08.890877    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6865b5c455-ctpx2"]
Sep 18 13:54:08.891639 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:08.891167    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6865b5c455-ctpx2" podUID="99e52e07-ea18-4683-8d18-24138c1c52c7" containerName="manager" containerID="cri-o://cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404" gracePeriod=30
Sep 18 13:54:08.892881 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:08.892857    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:54:09.133356 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.133332    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:54:09.180648 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.180624    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-metrics-certs\") pod \"99e52e07-ea18-4683-8d18-24138c1c52c7\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") "
Sep 18 13:54:09.180935 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.180669    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swqj2\" (UniqueName: \"kubernetes.io/projected/99e52e07-ea18-4683-8d18-24138c1c52c7-kube-api-access-swqj2\") pod \"99e52e07-ea18-4683-8d18-24138c1c52c7\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") "
Sep 18 13:54:09.180935 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.180712    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert\") pod \"99e52e07-ea18-4683-8d18-24138c1c52c7\" (UID: \"99e52e07-ea18-4683-8d18-24138c1c52c7\") "
Sep 18 13:54:09.182992 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.182956    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "99e52e07-ea18-4683-8d18-24138c1c52c7" (UID: "99e52e07-ea18-4683-8d18-24138c1c52c7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:54:09.183120 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.183013    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "99e52e07-ea18-4683-8d18-24138c1c52c7" (UID: "99e52e07-ea18-4683-8d18-24138c1c52c7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:54:09.183120 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.183025    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e52e07-ea18-4683-8d18-24138c1c52c7-kube-api-access-swqj2" (OuterVolumeSpecName: "kube-api-access-swqj2") pod "99e52e07-ea18-4683-8d18-24138c1c52c7" (UID: "99e52e07-ea18-4683-8d18-24138c1c52c7"). InnerVolumeSpecName "kube-api-access-swqj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:54:09.281885 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.281851    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-metrics-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:54:09.281885 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.281878    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swqj2\" (UniqueName: \"kubernetes.io/projected/99e52e07-ea18-4683-8d18-24138c1c52c7-kube-api-access-swqj2\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:54:09.281885 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.281887    2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e52e07-ea18-4683-8d18-24138c1c52c7-webhook-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:54:09.352691 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.352661    2585 generic.go:356] "Generic (PLEG): container finished" podID="99e52e07-ea18-4683-8d18-24138c1c52c7" containerID="cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404" exitCode=0
Sep 18 13:54:09.352825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.352710    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-ctpx2"
Sep 18 13:54:09.352825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.352711    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-ctpx2" event={"ID":"99e52e07-ea18-4683-8d18-24138c1c52c7","Type":"ContainerDied","Data":"cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404"}
Sep 18 13:54:09.352825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.352812    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-ctpx2" event={"ID":"99e52e07-ea18-4683-8d18-24138c1c52c7","Type":"ContainerDied","Data":"3a59e5426d61214f97c12c980362a63861e29d3ce98ad5614f42d7eff2ab3200"}
Sep 18 13:54:09.352920 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.352833    2585 scope.go:117] "RemoveContainer" containerID="cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404"
Sep 18 13:54:09.361811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.361795    2585 scope.go:117] "RemoveContainer" containerID="cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404"
Sep 18 13:54:09.362095 ip-10-0-132-83 kubenswrapper[2585]: E0918 13:54:09.362075    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404\": container with ID starting with cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404 not found: ID does not exist" containerID="cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404"
Sep 18 13:54:09.362148 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.362103    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404"} err="failed to get container status \"cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404\": rpc error: code = NotFound desc = could not find container \"cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404\": container with ID starting with cdd203b7a33968e20e5515466066f6d76b7360658374765a9097f5faa6549404 not found: ID does not exist"
Sep 18 13:54:09.374207 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.374185    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6865b5c455-ctpx2"]
Sep 18 13:54:09.378500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.378480    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6865b5c455-ctpx2"]
Sep 18 13:54:09.640804 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:09.640716    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99e52e07-ea18-4683-8d18-24138c1c52c7" path="/var/lib/kubelet/pods/99e52e07-ea18-4683-8d18-24138c1c52c7/volumes"
Sep 18 13:54:30.577565 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.577530    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"]
Sep 18 13:54:30.578149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.578109    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e52e07-ea18-4683-8d18-24138c1c52c7" containerName="manager"
Sep 18 13:54:30.578149 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.578128    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e52e07-ea18-4683-8d18-24138c1c52c7" containerName="manager"
Sep 18 13:54:30.578269 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.578260    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="99e52e07-ea18-4683-8d18-24138c1c52c7" containerName="manager"
Sep 18 13:54:30.585706 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.585670    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-z44zd"]
Sep 18 13:54:30.585885 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.585802    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.588665 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.588642    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 13:54:30.588784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.588766    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nf8b9\""
Sep 18 13:54:30.589546 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.589528    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.604490 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.604466    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"]
Sep 18 13:54:30.607441 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.607397    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-z44zd"]
Sep 18 13:54:30.676543 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.676510    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:54:30.678253 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.678233    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2k2t\" (UniqueName: \"kubernetes.io/projected/1e2d11ab-7c5b-462b-a830-c9f669899f7b-kube-api-access-d2k2t\") pod \"payload-processing-5b54b7fbb7-z44zd\" (UID: \"1e2d11ab-7c5b-462b-a830-c9f669899f7b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.678313 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.678275    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2d11ab-7c5b-462b-a830-c9f669899f7b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-z44zd\" (UID: \"1e2d11ab-7c5b-462b-a830-c9f669899f7b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.678367 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.678348    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cf3aef-a227-4491-8f30-5c0cba76fe84-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7tzk2\" (UID: \"48cf3aef-a227-4491-8f30-5c0cba76fe84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.678427 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.678375    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5tp5\" (UniqueName: \"kubernetes.io/projected/48cf3aef-a227-4491-8f30-5c0cba76fe84-kube-api-access-g5tp5\") pod \"payload-pre-processing-59fbc47bf8-7tzk2\" (UID: \"48cf3aef-a227-4491-8f30-5c0cba76fe84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.779665 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.779624    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2k2t\" (UniqueName: \"kubernetes.io/projected/1e2d11ab-7c5b-462b-a830-c9f669899f7b-kube-api-access-d2k2t\") pod \"payload-processing-5b54b7fbb7-z44zd\" (UID: \"1e2d11ab-7c5b-462b-a830-c9f669899f7b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.779870 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.779747    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2d11ab-7c5b-462b-a830-c9f669899f7b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-z44zd\" (UID: \"1e2d11ab-7c5b-462b-a830-c9f669899f7b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.779870 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.779853    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cf3aef-a227-4491-8f30-5c0cba76fe84-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7tzk2\" (UID: \"48cf3aef-a227-4491-8f30-5c0cba76fe84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.779994 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.779873    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5tp5\" (UniqueName: \"kubernetes.io/projected/48cf3aef-a227-4491-8f30-5c0cba76fe84-kube-api-access-g5tp5\") pod \"payload-pre-processing-59fbc47bf8-7tzk2\" (UID: \"48cf3aef-a227-4491-8f30-5c0cba76fe84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.780745 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.780717    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2d11ab-7c5b-462b-a830-c9f669899f7b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-z44zd\" (UID: \"1e2d11ab-7c5b-462b-a830-c9f669899f7b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.780885 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.780863    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48cf3aef-a227-4491-8f30-5c0cba76fe84-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7tzk2\" (UID: \"48cf3aef-a227-4491-8f30-5c0cba76fe84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.789185 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.789159    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5tp5\" (UniqueName: \"kubernetes.io/projected/48cf3aef-a227-4491-8f30-5c0cba76fe84-kube-api-access-g5tp5\") pod \"payload-pre-processing-59fbc47bf8-7tzk2\" (UID: \"48cf3aef-a227-4491-8f30-5c0cba76fe84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.789331 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.789160    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2k2t\" (UniqueName: \"kubernetes.io/projected/1e2d11ab-7c5b-462b-a830-c9f669899f7b-kube-api-access-d2k2t\") pod \"payload-processing-5b54b7fbb7-z44zd\" (UID: \"1e2d11ab-7c5b-462b-a830-c9f669899f7b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:30.898622 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.898514    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:30.908690 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:30.908667    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:31.175795 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:31.175769    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"]
Sep 18 13:54:31.178742 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:54:31.178715    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cf3aef_a227_4491_8f30_5c0cba76fe84.slice/crio-2b156e083773e7c49f6ecd39a64099b3b92160170f046ffda15c3191a9890a40 WatchSource:0}: Error finding container 2b156e083773e7c49f6ecd39a64099b3b92160170f046ffda15c3191a9890a40: Status 404 returned error can't find the container with id 2b156e083773e7c49f6ecd39a64099b3b92160170f046ffda15c3191a9890a40
Sep 18 13:54:31.186795 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:31.186772    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-z44zd"]
Sep 18 13:54:31.189173 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:54:31.189147    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2d11ab_7c5b_462b_a830_c9f669899f7b.slice/crio-12b589389be5e50b86f0471c2e8d3e895810b925933ce790f5681bdcdbeb2036 WatchSource:0}: Error finding container 12b589389be5e50b86f0471c2e8d3e895810b925933ce790f5681bdcdbeb2036: Status 404 returned error can't find the container with id 12b589389be5e50b86f0471c2e8d3e895810b925933ce790f5681bdcdbeb2036
Sep 18 13:54:31.462483 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:31.462370    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2" event={"ID":"48cf3aef-a227-4491-8f30-5c0cba76fe84","Type":"ContainerStarted","Data":"2b156e083773e7c49f6ecd39a64099b3b92160170f046ffda15c3191a9890a40"}
Sep 18 13:54:31.463457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:31.463435    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd" event={"ID":"1e2d11ab-7c5b-462b-a830-c9f669899f7b","Type":"ContainerStarted","Data":"12b589389be5e50b86f0471c2e8d3e895810b925933ce790f5681bdcdbeb2036"}
Sep 18 13:54:33.475088 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:33.475056    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2" event={"ID":"48cf3aef-a227-4491-8f30-5c0cba76fe84","Type":"ContainerStarted","Data":"2cb39aa2da16bac37e5bf1e64c282a33463bfca52a1e2b9f5ed551e28e16f156"}
Sep 18 13:54:33.475544 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:33.475147    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:33.476811 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:33.476791    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd" event={"ID":"1e2d11ab-7c5b-462b-a830-c9f669899f7b","Type":"ContainerStarted","Data":"fc3562f364377db56c620016ea20cb7df76ae81192b274830604252b517dd5ea"}
Sep 18 13:54:33.476916 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:33.476831    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:33.491459 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:33.491394    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2" podStartSLOduration=2.041195532 podStartE2EDuration="3.491378572s" totalImagesPullingTime="1.45018304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:54:33.490069317 +0000 UTC m=+583.989826832" watchObservedRunningTime="2026-09-18 13:54:33.491378572 +0000 UTC m=+583.991136084"
Sep 18 13:54:33.506627 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:33.506560    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd" podStartSLOduration=2.069196822 podStartE2EDuration="3.506536333s" totalImagesPullingTime="1.437339511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:54:33.50494049 +0000 UTC m=+584.004698020" watchObservedRunningTime="2026-09-18 13:54:33.506536333 +0000 UTC m=+584.006293851"
Sep 18 13:54:40.515048 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:40.515017    2585 generic.go:356] "Generic (PLEG): container finished" podID="9fb05eff-a90e-45b4-af4a-9d3bdab2f57b" containerID="fdcf74460896afa5e19b89bf3648104f093c5953dd95b2820ea0ed934663a2ae" exitCode=0
Sep 18 13:54:40.515492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:40.515092    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" event={"ID":"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b","Type":"ContainerDied","Data":"fdcf74460896afa5e19b89bf3648104f093c5953dd95b2820ea0ed934663a2ae"}
Sep 18 13:54:40.515492 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:40.515474    2585 scope.go:117] "RemoveContainer" containerID="fdcf74460896afa5e19b89bf3648104f093c5953dd95b2820ea0ed934663a2ae"
Sep 18 13:54:40.516496 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:40.516469    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:54:40.516572 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:40.516536    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:54:40.516572 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:40.516568    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:54:41.527256 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:41.527206    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" event={"ID":"9fb05eff-a90e-45b4-af4a-9d3bdab2f57b","Type":"ContainerStarted","Data":"d3f6a149b9e826c1a0afc27b0d394a36bd4a053511376cbc4f394b15214c4c95"}
Sep 18 13:54:42.158965 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:42.158931    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:54:42.159133 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:42.159092    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-kvtb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 13:54:42.159178 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:42.159146    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" podUID="9fb05eff-a90e-45b4-af4a-9d3bdab2f57b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 13:54:43.159160 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:43.159123    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-kvtb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 13:54:43.159582 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:43.159183    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" podUID="9fb05eff-a90e-45b4-af4a-9d3bdab2f57b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 13:54:44.159742 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:44.159709    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-kvtb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 13:54:44.160097 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:44.159795    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" podUID="9fb05eff-a90e-45b4-af4a-9d3bdab2f57b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 13:54:44.271556 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:44.271520    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:54:44.483607 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:44.483576    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2"
Sep 18 13:54:44.483814 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:44.483796    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-z44zd"
Sep 18 13:54:45.159727 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:45.159684    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-kvtb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 13:54:45.159914 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:45.159745    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" podUID="9fb05eff-a90e-45b4-af4a-9d3bdab2f57b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 13:54:46.159997 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:46.159956    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-kvtb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 13:54:46.160518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:46.160022    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6" podUID="9fb05eff-a90e-45b4-af4a-9d3bdab2f57b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 13:54:47.163538 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:47.163502    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:54:47.163975 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:47.163799    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:54:47.164508 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:47.164491    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6"
Sep 18 13:54:51.536258 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.536234    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:54:51.536723 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.536275    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:54:51.864863 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.864770    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"]
Sep 18 13:54:51.868438 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.868399    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.871033 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.871007    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 13:54:51.871033 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.871007    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 13:54:51.871228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.871008    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 18 13:54:51.871228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.871016    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t99ts\""
Sep 18 13:54:51.877451 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.877379    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"]
Sep 18 13:54:51.892464 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.892434    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.892620 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.892482    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.892620 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.892575    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.892735 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.892648    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.892735 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.892683    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05131a8b-0819-4130-bed9-2eeda37f7219-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.892735 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.892711    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wppvs\" (UniqueName: \"kubernetes.io/projected/05131a8b-0819-4130-bed9-2eeda37f7219-kube-api-access-wppvs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.993801 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.993765    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.993801 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.993800    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05131a8b-0819-4130-bed9-2eeda37f7219-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994030 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.993822    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wppvs\" (UniqueName: \"kubernetes.io/projected/05131a8b-0819-4130-bed9-2eeda37f7219-kube-api-access-wppvs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994030 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.993879    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994030 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.993919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994030 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.993978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994270 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.994248    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994341 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.994252    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.994493 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.994464    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.996273 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.996251    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05131a8b-0819-4130-bed9-2eeda37f7219-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:51.996660 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:51.996643    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05131a8b-0819-4130-bed9-2eeda37f7219-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:52.002486 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:52.002462    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wppvs\" (UniqueName: \"kubernetes.io/projected/05131a8b-0819-4130-bed9-2eeda37f7219-kube-api-access-wppvs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6vt8\" (UID: \"05131a8b-0819-4130-bed9-2eeda37f7219\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:52.182210 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:52.182176    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:54:52.453365 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:52.453338    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"]
Sep 18 13:54:52.455408 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:54:52.455376    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05131a8b_0819_4130_bed9_2eeda37f7219.slice/crio-b02715b377e39a2c63929320d9c66f27200e3166b104bdd22b19a39586b81a38 WatchSource:0}: Error finding container b02715b377e39a2c63929320d9c66f27200e3166b104bdd22b19a39586b81a38: Status 404 returned error can't find the container with id b02715b377e39a2c63929320d9c66f27200e3166b104bdd22b19a39586b81a38
Sep 18 13:54:52.587263 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:52.587227    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8" event={"ID":"05131a8b-0819-4130-bed9-2eeda37f7219","Type":"ContainerStarted","Data":"b02715b377e39a2c63929320d9c66f27200e3166b104bdd22b19a39586b81a38"}
Sep 18 13:54:52.670072 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:52.670035    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:54:53.594429 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:53.594373    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8" event={"ID":"05131a8b-0819-4130-bed9-2eeda37f7219","Type":"ContainerStarted","Data":"efe9085b533a002ef375acb808e7c190b81e5ce9f1dc08cca700a5f1fe1e065f"}
Sep 18 13:54:53.615215 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:54:53.615159    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8" podStartSLOduration=1.6451447940000001 podStartE2EDuration="2.615141021s" totalImagesPullingTime="969.996227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:54:53.613055455 +0000 UTC m=+604.112813013" watchObservedRunningTime="2026-09-18 13:54:53.615141021 +0000 UTC m=+604.114898536"
Sep 18 13:55:02.182983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:02.182890    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:55:02.182983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:02.182962    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:55:02.196046 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:02.196021    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:55:02.652821 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:02.652735    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6vt8"
Sep 18 13:55:04.172924 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:04.172874    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:55:15.873110 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:15.873074    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:55:28.174429 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:28.174381    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:55:40.766600 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.766563    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"]
Sep 18 13:55:40.770640 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.770617    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.772979 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.772953    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 18 13:55:40.779750 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.779727    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"]
Sep 18 13:55:40.871865 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.871827    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.872056 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.871875    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.872056 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.871945    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5j9v\" (UniqueName: \"kubernetes.io/projected/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-kube-api-access-t5j9v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.872142 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.872066    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.872142 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.872098    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.872142 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.872120    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973067    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973109    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973315 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973136    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973315 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973220    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973315 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973249    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973315 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973272    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5j9v\" (UniqueName: \"kubernetes.io/projected/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-kube-api-access-t5j9v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973592 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973572    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973654 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973627    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.973729 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.973656    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.975722 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.975697    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.975839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.975815    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:40.981784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:40.981758    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5j9v\" (UniqueName: \"kubernetes.io/projected/3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf-kube-api-access-t5j9v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rcsrb\" (UID: \"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:41.083228 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:41.083142    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:41.355205 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:41.355182    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"]
Sep 18 13:55:41.357112 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:55:41.357084    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f93e9f0_1977_4bf3_aff3_baa5e3dbeedf.slice/crio-926d9063b9720305f33bdf4c63c2141adb2ac11272973707c26fee0a18d84947 WatchSource:0}: Error finding container 926d9063b9720305f33bdf4c63c2141adb2ac11272973707c26fee0a18d84947: Status 404 returned error can't find the container with id 926d9063b9720305f33bdf4c63c2141adb2ac11272973707c26fee0a18d84947
Sep 18 13:55:41.358517 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:41.358499    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:55:41.846156 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:41.846119    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb" event={"ID":"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf","Type":"ContainerStarted","Data":"e7c3b2d05e6dc3d93882b0255a050ed4554ad04f9d8c8f4d57499a2b3b0c6b95"}
Sep 18 13:55:41.846561 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:41.846179    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb" event={"ID":"3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf","Type":"ContainerStarted","Data":"926d9063b9720305f33bdf4c63c2141adb2ac11272973707c26fee0a18d84947"}
Sep 18 13:55:41.865172 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:41.865110    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb" podStartSLOduration=1.634781118 podStartE2EDuration="1.865091214s" totalImagesPullingTime="230.310096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:55:41.863398801 +0000 UTC m=+652.363156317" watchObservedRunningTime="2026-09-18 13:55:41.865091214 +0000 UTC m=+652.364848730"
Sep 18 13:55:42.377979 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:42.377942    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:55:51.083982 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:51.083948    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:51.084529 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:51.084042    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:51.096685 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:51.096654    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:55:51.777279 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:51.777241    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:55:51.908738 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:55:51.908707    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rcsrb"
Sep 18 13:58:20.555985 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.555911    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"]
Sep 18 13:58:20.559681 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.559659    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.561949 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.561929    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-40970f-openshift-default-dockercfg-zd9zc\""
Sep 18 13:58:20.572513 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.572483    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"]
Sep 18 13:58:20.647099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647037    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-token\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647297 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647149    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-podinfo\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647297 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647188    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-credential-socket\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647297 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647219    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqc6p\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-kube-api-access-xqc6p\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647297 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647286    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-certs\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647386    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-envoy\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647492    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-data\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647528 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647519    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istiod-ca-cert\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.647651 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.647539    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-socket\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.701164 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.701125    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"]
Sep 18 13:58:20.704969 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.704942    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.707185 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.707163    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-036fc2-openshift-default-dockercfg-t9jgc\""
Sep 18 13:58:20.715748 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.715723    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"]
Sep 18 13:58:20.748917 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.748882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-certs\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749127 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.748927    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-envoy\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749127 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.748980    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-data\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749127 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749025    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istiod-ca-cert\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749127 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749056    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-socket\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749127 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749084    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-token\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749404 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749165    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-podinfo\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749404 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749369    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-certs\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749558 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749397    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-data\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749558 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749457    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-credential-socket\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749558 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749501    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqc6p\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-kube-api-access-xqc6p\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749735 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749552    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-socket\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.749836 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.749817    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-credential-socket\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.750334 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.750311    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istiod-ca-cert\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.751555 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.751529    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-envoy\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.751781 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.751763    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-podinfo\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.769616 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.769585    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-token\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.770280 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.770259    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqc6p\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-kube-api-access-xqc6p\") pod \"e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") " pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.850957 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.850807    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-credential-socket\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.850957 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.850890    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-envoy\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851187 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.850959    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istiod-ca-cert\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851187 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.851064    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-certs\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851187 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.851144    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng42v\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-kube-api-access-ng42v\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851306 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.851241    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-data\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851306 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.851279    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-socket\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851436 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.851339    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-token\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.851507 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.851455    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-podinfo\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.870700 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.870667    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:20.952655 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952619    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-envoy\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.952839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952685    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istiod-ca-cert\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.952839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952706    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-certs\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.952839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng42v\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-kube-api-access-ng42v\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.952839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952803    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-data\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.952839 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952830    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-socket\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953119 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952872    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-token\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953119 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952903    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-podinfo\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953119 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.952933    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-credential-socket\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953285 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.953149    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-certs\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953285 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.953232    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-credential-socket\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953397 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.953320    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-socket\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953502 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.953475    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istiod-ca-cert\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.953777 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.953755    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-data\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.955856 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.955833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-envoy\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.956259 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.956232    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-podinfo\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.961980 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.961958    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-token\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:20.962180 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:20.962158    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng42v\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-kube-api-access-ng42v\") pod \"e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") " pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:21.017589 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.017545    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:21.152904 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.152880    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"]
Sep 18 13:58:21.155236 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:21.155212    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805f52e9_dbc3_4270_a673_d83a9b1a4e08.slice/crio-3263a0d16cbcf05b8084af824d45c6901f000050491212708526e8457871be39 WatchSource:0}: Error finding container 3263a0d16cbcf05b8084af824d45c6901f000050491212708526e8457871be39: Status 404 returned error can't find the container with id 3263a0d16cbcf05b8084af824d45c6901f000050491212708526e8457871be39
Sep 18 13:58:21.157371 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.157342    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.157471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.157403    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.157471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.157463    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.298769 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.298742    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"]
Sep 18 13:58:21.300612 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:21.300588    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae04f1ad_1e26_411e_bac9_fccaf28a2888.slice/crio-bdf021d0e491c3bbb9d3e88acc04f4177975dfd3987d5037555f332fca37f291 WatchSource:0}: Error finding container bdf021d0e491c3bbb9d3e88acc04f4177975dfd3987d5037555f332fca37f291: Status 404 returned error can't find the container with id bdf021d0e491c3bbb9d3e88acc04f4177975dfd3987d5037555f332fca37f291
Sep 18 13:58:21.303253 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.303219    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.303364 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.303299    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.303364 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.303344    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.664582 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.664544    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" event={"ID":"ae04f1ad-1e26-411e-bac9-fccaf28a2888","Type":"ContainerStarted","Data":"d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"}
Sep 18 13:58:21.665054 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.664603    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" event={"ID":"ae04f1ad-1e26-411e-bac9-fccaf28a2888","Type":"ContainerStarted","Data":"bdf021d0e491c3bbb9d3e88acc04f4177975dfd3987d5037555f332fca37f291"}
Sep 18 13:58:21.666325 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.666301    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" event={"ID":"805f52e9-dbc3-4270-a673-d83a9b1a4e08","Type":"ContainerStarted","Data":"049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"}
Sep 18 13:58:21.666453 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.666340    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" event={"ID":"805f52e9-dbc3-4270-a673-d83a9b1a4e08","Type":"ContainerStarted","Data":"3263a0d16cbcf05b8084af824d45c6901f000050491212708526e8457871be39"}
Sep 18 13:58:21.693494 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.693445    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podStartSLOduration=1.69342777 podStartE2EDuration="1.69342777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:21.69184625 +0000 UTC m=+812.191603771" watchObservedRunningTime="2026-09-18 13:58:21.69342777 +0000 UTC m=+812.193185278"
Sep 18 13:58:21.730574 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.730506    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podStartSLOduration=1.730485239 podStartE2EDuration="1.730485239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:21.729073664 +0000 UTC m=+812.228831179" watchObservedRunningTime="2026-09-18 13:58:21.730485239 +0000 UTC m=+812.230242773"
Sep 18 13:58:21.871241 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:21.871198    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:22.018511 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:22.018469    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:22.023320 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:22.023292    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:22.671780 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:22.671747    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:22.672901 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:22.672884    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:22.876003 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:22.875971    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:23.676211 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:23.676176    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:23.677307 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:23.677286    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:24.275488 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:24.275456    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:58:26.238776 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.238739    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"]
Sep 18 13:58:26.242638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.242622    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.244770 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.244750    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-a02b2c\""
Sep 18 13:58:26.244867 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.244780    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-a02b2c-dockercfg-fgdc9\""
Sep 18 13:58:26.253432 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.253390    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"]
Sep 18 13:58:26.409701 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.409671    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnsj\" (UniqueName: \"kubernetes.io/projected/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-kube-api-access-wqnsj\") pod \"payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.409927 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.409850    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.510976 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.510887    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.510976 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.510930    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnsj\" (UniqueName: \"kubernetes.io/projected/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-kube-api-access-wqnsj\") pod \"payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.511684 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.511663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.519173 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.519147    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnsj\" (UniqueName: \"kubernetes.io/projected/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-kube-api-access-wqnsj\") pod \"payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.555000 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.554964    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:26.837725 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:26.837691    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"]
Sep 18 13:58:26.839609 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:26.839574    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac3f19f_7563_48c1_90ce_2bf61b3662b9.slice/crio-0c47ddbfaaa8cda3172907f933e21bc512f5445e8cca1a60980eef42eab7067f WatchSource:0}: Error finding container 0c47ddbfaaa8cda3172907f933e21bc512f5445e8cca1a60980eef42eab7067f: Status 404 returned error can't find the container with id 0c47ddbfaaa8cda3172907f933e21bc512f5445e8cca1a60980eef42eab7067f
Sep 18 13:58:27.449562 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.449526    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"]
Sep 18 13:58:27.453169 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.453152    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.455376 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.455351    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-40970f\""
Sep 18 13:58:27.455497 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.455466    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-40970f-dockercfg-jfmgl\""
Sep 18 13:58:27.463238 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.463209    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"]
Sep 18 13:58:27.538225 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.538191    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"]
Sep 18 13:58:27.541862 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.541846    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.561980 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.561950    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"]
Sep 18 13:58:27.621214 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.621181    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwnj\" (UniqueName: \"kubernetes.io/projected/ee2a0919-8486-4640-b037-0ca6dc73bace-kube-api-access-rfwnj\") pod \"payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.621403 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.621260    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee2a0919-8486-4640-b037-0ca6dc73bace-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.700065 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.699970    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55" event={"ID":"8ac3f19f-7563-48c1-90ce-2bf61b3662b9","Type":"ContainerStarted","Data":"f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309"}
Sep 18 13:58:27.700065 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.700026    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:27.700065 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.700044    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55" event={"ID":"8ac3f19f-7563-48c1-90ce-2bf61b3662b9","Type":"ContainerStarted","Data":"0c47ddbfaaa8cda3172907f933e21bc512f5445e8cca1a60980eef42eab7067f"}
Sep 18 13:58:27.720099 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.720050    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55" podStartSLOduration=1.720034925 podStartE2EDuration="1.720034925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:27.717296209 +0000 UTC m=+818.217053726" watchObservedRunningTime="2026-09-18 13:58:27.720034925 +0000 UTC m=+818.219792440"
Sep 18 13:58:27.722151 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.722130    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.722226 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.722185    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-kube-api-access-r7khx\") pod \"payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.722301 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.722289    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwnj\" (UniqueName: \"kubernetes.io/projected/ee2a0919-8486-4640-b037-0ca6dc73bace-kube-api-access-rfwnj\") pod \"payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.722347 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.722312    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee2a0919-8486-4640-b037-0ca6dc73bace-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.722957 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.722938    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee2a0919-8486-4640-b037-0ca6dc73bace-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.730087 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.730059    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwnj\" (UniqueName: \"kubernetes.io/projected/ee2a0919-8486-4640-b037-0ca6dc73bace-kube-api-access-rfwnj\") pod \"payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.765182 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.765154    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:27.824404 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.823679    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.824404 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.823773    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-kube-api-access-r7khx\") pod \"payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.824931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.824861    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.840661 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.840620    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-kube-api-access-r7khx\") pod \"payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:27.855187 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:27.855158    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:28.042631 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.042603    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"]
Sep 18 13:58:28.042857 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:28.042834    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2a0919_8486_4640_b037_0ca6dc73bace.slice/crio-a305f17065a18e4aa5d243dcbbf9a5694c601cde83db207ff75247147d8b2595 WatchSource:0}: Error finding container a305f17065a18e4aa5d243dcbbf9a5694c601cde83db207ff75247147d8b2595: Status 404 returned error can't find the container with id a305f17065a18e4aa5d243dcbbf9a5694c601cde83db207ff75247147d8b2595
Sep 18 13:58:28.141941 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.141878    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"]
Sep 18 13:58:28.146366 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:28.146333    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d9aaaf_cf20_4860_b178_3bc32b18f1af.slice/crio-528009bf9e576198499f0a1deb073df4bb859ffd15f02ace3436303f61c71fc1 WatchSource:0}: Error finding container 528009bf9e576198499f0a1deb073df4bb859ffd15f02ace3436303f61c71fc1: Status 404 returned error can't find the container with id 528009bf9e576198499f0a1deb073df4bb859ffd15f02ace3436303f61c71fc1
Sep 18 13:58:28.700978 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.700946    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"]
Sep 18 13:58:28.704870 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.704850    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:28.708216 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.708094    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh" event={"ID":"e0d9aaaf-cf20-4860-b178-3bc32b18f1af","Type":"ContainerStarted","Data":"e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47"}
Sep 18 13:58:28.708503 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.708480    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:28.708616 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.708520    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh" event={"ID":"e0d9aaaf-cf20-4860-b178-3bc32b18f1af","Type":"ContainerStarted","Data":"528009bf9e576198499f0a1deb073df4bb859ffd15f02ace3436303f61c71fc1"}
Sep 18 13:58:28.709439 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.709372    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-036fc2\""
Sep 18 13:58:28.710784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.710104    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br" event={"ID":"ee2a0919-8486-4640-b037-0ca6dc73bace","Type":"ContainerStarted","Data":"ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2"}
Sep 18 13:58:28.710784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.710146    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br" event={"ID":"ee2a0919-8486-4640-b037-0ca6dc73bace","Type":"ContainerStarted","Data":"a305f17065a18e4aa5d243dcbbf9a5694c601cde83db207ff75247147d8b2595"}
Sep 18 13:58:28.710784 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.710199    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:28.729385 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.729347    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"]
Sep 18 13:58:28.757554 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.757495    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br" podStartSLOduration=1.757473564 podStartE2EDuration="1.757473564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:28.756883738 +0000 UTC m=+819.256641253" watchObservedRunningTime="2026-09-18 13:58:28.757473564 +0000 UTC m=+819.257231081"
Sep 18 13:58:28.780143 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.780095    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh" podStartSLOduration=1.7800746969999999 podStartE2EDuration="1.780074697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:28.778552008 +0000 UTC m=+819.278309537" watchObservedRunningTime="2026-09-18 13:58:28.780074697 +0000 UTC m=+819.279832213"
Sep 18 13:58:28.835610 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.835571    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8feb23ad-1908-49b6-95d2-2a62b3baef1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:28.835796 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.835686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkr2\" (UniqueName: \"kubernetes.io/projected/8feb23ad-1908-49b6-95d2-2a62b3baef1c-kube-api-access-2mkr2\") pod \"payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:28.937364 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.937330    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8feb23ad-1908-49b6-95d2-2a62b3baef1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:28.937581 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.937384    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkr2\" (UniqueName: \"kubernetes.io/projected/8feb23ad-1908-49b6-95d2-2a62b3baef1c-kube-api-access-2mkr2\") pod \"payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:28.938143 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.938124    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8feb23ad-1908-49b6-95d2-2a62b3baef1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:28.946165 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:28.946133    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkr2\" (UniqueName: \"kubernetes.io/projected/8feb23ad-1908-49b6-95d2-2a62b3baef1c-kube-api-access-2mkr2\") pod \"payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:29.027095 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:29.027041    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:29.319322 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:29.319291    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"]
Sep 18 13:58:29.323562 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:29.323529    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8feb23ad_1908_49b6_95d2_2a62b3baef1c.slice/crio-4c09bc4d8030258e1bc94a5aa4cc84fbe5c40b5cea8b1d0252593e0e738a3bab WatchSource:0}: Error finding container 4c09bc4d8030258e1bc94a5aa4cc84fbe5c40b5cea8b1d0252593e0e738a3bab: Status 404 returned error can't find the container with id 4c09bc4d8030258e1bc94a5aa4cc84fbe5c40b5cea8b1d0252593e0e738a3bab
Sep 18 13:58:29.720661 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:29.720600    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj" event={"ID":"8feb23ad-1908-49b6-95d2-2a62b3baef1c","Type":"ContainerStarted","Data":"c3779f5bc247452272fb3b2e583719a7d121ae25741ac11f39ab436049e83d38"}
Sep 18 13:58:29.721489 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:29.720682    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj" event={"ID":"8feb23ad-1908-49b6-95d2-2a62b3baef1c","Type":"ContainerStarted","Data":"4c09bc4d8030258e1bc94a5aa4cc84fbe5c40b5cea8b1d0252593e0e738a3bab"}
Sep 18 13:58:29.741871 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:29.741817    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj" podStartSLOduration=1.741801434 podStartE2EDuration="1.741801434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:29.740877537 +0000 UTC m=+820.240635057" watchObservedRunningTime="2026-09-18 13:58:29.741801434 +0000 UTC m=+820.241558949"
Sep 18 13:58:30.727711 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:30.727674    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:38.714693 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:38.713641    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 13:58:39.723540 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:39.723506    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 13:58:39.724026 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:39.723597    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 13:58:41.736232 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:41.736201    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 13:58:42.809815 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.809726    2585 generic.go:356] "Generic (PLEG): container finished" podID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerID="d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4" exitCode=0
Sep 18 13:58:42.809815 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.809801    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" event={"ID":"ae04f1ad-1e26-411e-bac9-fccaf28a2888","Type":"ContainerDied","Data":"d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"}
Sep 18 13:58:42.810338 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.810292    2585 scope.go:117] "RemoveContainer" containerID="d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"
Sep 18 13:58:42.811579 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.811550    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.811702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.811619    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.811702 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.811654    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.811825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.811807    2585 generic.go:356] "Generic (PLEG): container finished" podID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerID="049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4" exitCode=0
Sep 18 13:58:42.811893 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.811877    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" event={"ID":"805f52e9-dbc3-4270-a673-d83a9b1a4e08","Type":"ContainerDied","Data":"049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"}
Sep 18 13:58:42.812215 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.812202    2585 scope.go:117] "RemoveContainer" containerID="049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"
Sep 18 13:58:42.813375 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.813348    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.813469 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.813454    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.813521 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:42.813503    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:43.507562 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:43.506521    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:58:43.829499 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:43.828668    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" event={"ID":"ae04f1ad-1e26-411e-bac9-fccaf28a2888","Type":"ContainerStarted","Data":"5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb"}
Sep 18 13:58:43.833451 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:43.832782    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" event={"ID":"805f52e9-dbc3-4270-a673-d83a9b1a4e08","Type":"ContainerStarted","Data":"a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f"}
Sep 18 13:58:43.871114 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:43.871077    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:43.871517 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:43.871490    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 18 13:58:43.871648 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:43.871550    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 18 13:58:44.017983 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.017943    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:44.018281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.018251    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 18 13:58:44.018381 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.018316    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 18 13:58:44.361439 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.360300    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"]
Sep 18 13:58:44.370471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.370179    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.372571 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.372546    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-12afdd-openshift-default-dockercfg-pt855\""
Sep 18 13:58:44.384332 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.384308    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"]
Sep 18 13:58:44.463441 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463247    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-credential-socket\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463441 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463300    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-envoy\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463441 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463335    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-certs\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463441 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwpr\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-kube-api-access-fwwpr\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463441 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463407    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-podinfo\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463869 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463484    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-token\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463869 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463532    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea94fc1-4509-43d4-88df-986c0fef9a5f-istiod-ca-cert\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463869 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463581    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-data\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.463869 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.463640    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-socket\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564280 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564232    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-credential-socket\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564280 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564275    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-envoy\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564581 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564297    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-certs\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564581 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564314    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwpr\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-kube-api-access-fwwpr\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564581 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564349    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-podinfo\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564581 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564380    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-token\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564581 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564518    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea94fc1-4509-43d4-88df-986c0fef9a5f-istiod-ca-cert\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564586    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-data\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564653    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-socket\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564845 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564746    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-credential-socket\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.564952 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.564857    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-certs\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.565038 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.565015    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-socket\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.565079 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.565065    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-data\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.565332 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.565297    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea94fc1-4509-43d4-88df-986c0fef9a5f-istiod-ca-cert\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.566897 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.566874    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-envoy\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.566990 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.566958    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-podinfo\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.572628 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.572605    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-token\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.572805 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.572790    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwpr\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-kube-api-access-fwwpr\") pod \"e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") " pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.682265 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.682235    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:44.871573 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.871530    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 18 13:58:44.871942 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:44.871589    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 18 13:58:45.026806 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.013623    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"]
Sep 18 13:58:45.026806 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.018210    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 18 13:58:45.026806 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.018265    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 18 13:58:45.031894 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.031855    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:45.032092 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.032069    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:45.032453 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.032430    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:45.874097 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.874056    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 18 13:58:45.874632 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.874119    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 18 13:58:45.877285 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.877258    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" event={"ID":"eea94fc1-4509-43d4-88df-986c0fef9a5f","Type":"ContainerStarted","Data":"50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"}
Sep 18 13:58:45.877545 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.877508    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" event={"ID":"eea94fc1-4509-43d4-88df-986c0fef9a5f","Type":"ContainerStarted","Data":"5b36e8c4e6a2fa637d8a052c7216930391942151951b54a47f0df1ac6ee23c1e"}
Sep 18 13:58:45.899924 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:45.899877    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podStartSLOduration=1.8998613469999999 podStartE2EDuration="1.899861347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:45.897087549 +0000 UTC m=+836.396845065" watchObservedRunningTime="2026-09-18 13:58:45.899861347 +0000 UTC m=+836.399618863"
Sep 18 13:58:46.022379 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.022342    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 18 13:58:46.022701 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.022668    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 18 13:58:46.682987 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.682940    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:46.688584 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.688554    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:46.871872 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.871838    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 18 13:58:46.872060 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.871897    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 18 13:58:46.883181 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.883146    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:46.884075 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:46.884057    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:58:47.026500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:47.021147    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 18 13:58:47.026500 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:47.021213    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 18 13:58:47.871577 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:47.871533    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 18 13:58:47.871759 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:47.871614    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 18 13:58:48.021645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:48.021609    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 18 13:58:48.022674 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:48.022204    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 18 13:58:48.871478 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:48.871405    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 18 13:58:48.871665 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:48.871500    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 18 13:58:49.017990 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:49.017945    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 18 13:58:49.018203 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:49.018014    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 18 13:58:49.875486 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:49.875457    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:49.875884 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:49.875815    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:49.876518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:49.876501    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 13:58:50.022274 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.022250    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:50.022634 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.022611    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:50.023235 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.023215    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 13:58:50.192860 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.192829    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"]
Sep 18 13:58:50.195774 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.195749    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.199705 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.199684    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-12afdd\""
Sep 18 13:58:50.200156 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.200125    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-12afdd-dockercfg-l2rmp\""
Sep 18 13:58:50.211217 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.211192    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"]
Sep 18 13:58:50.352984 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.352951    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c951db-3a3e-48a4-84c1-45c0d9404eeb-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.353216 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.353192    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97xmd\" (UniqueName: \"kubernetes.io/projected/90c951db-3a3e-48a4-84c1-45c0d9404eeb-kube-api-access-97xmd\") pod \"payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.454891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.454796    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97xmd\" (UniqueName: \"kubernetes.io/projected/90c951db-3a3e-48a4-84c1-45c0d9404eeb-kube-api-access-97xmd\") pod \"payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.454891 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.454861    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c951db-3a3e-48a4-84c1-45c0d9404eeb-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.455597 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.455576    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c951db-3a3e-48a4-84c1-45c0d9404eeb-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.463922 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.463898    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97xmd\" (UniqueName: \"kubernetes.io/projected/90c951db-3a3e-48a4-84c1-45c0d9404eeb-kube-api-access-97xmd\") pod \"payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.514645 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.514609    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.788280 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.788249    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"]
Sep 18 13:58:50.790086 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:50.790036    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c951db_3a3e_48a4_84c1_45c0d9404eeb.slice/crio-e8d5af8a08170faf512e39378805387d1d61ddca9ff32e82970fa28cc04d36fa WatchSource:0}: Error finding container e8d5af8a08170faf512e39378805387d1d61ddca9ff32e82970fa28cc04d36fa: Status 404 returned error can't find the container with id e8d5af8a08170faf512e39378805387d1d61ddca9ff32e82970fa28cc04d36fa
Sep 18 13:58:50.909457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.909393    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d" event={"ID":"90c951db-3a3e-48a4-84c1-45c0d9404eeb","Type":"ContainerStarted","Data":"2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8"}
Sep 18 13:58:50.909931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.909726    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:58:50.909931 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.909771    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d" event={"ID":"90c951db-3a3e-48a4-84c1-45c0d9404eeb","Type":"ContainerStarted","Data":"e8d5af8a08170faf512e39378805387d1d61ddca9ff32e82970fa28cc04d36fa"}
Sep 18 13:58:50.928293 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:50.928234    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d" podStartSLOduration=0.928217217 podStartE2EDuration="928.217217ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:50.927015928 +0000 UTC m=+841.426773460" watchObservedRunningTime="2026-09-18 13:58:50.928217217 +0000 UTC m=+841.427974733"
Sep 18 13:58:54.316860 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.316825    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"]
Sep 18 13:58:54.320443 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.320405    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:58:54.322453 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.322431    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 13:58:54.329004 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.328977    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"]
Sep 18 13:58:54.387793 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.387758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/420bf3d3-d6a5-4175-81cd-b490e06ef2bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf\" (UID: \"420bf3d3-d6a5-4175-81cd-b490e06ef2bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:58:54.489329 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.489289    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/420bf3d3-d6a5-4175-81cd-b490e06ef2bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf\" (UID: \"420bf3d3-d6a5-4175-81cd-b490e06ef2bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:58:54.489978 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.489950    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/420bf3d3-d6a5-4175-81cd-b490e06ef2bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf\" (UID: \"420bf3d3-d6a5-4175-81cd-b490e06ef2bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:58:54.631722 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.631636    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:58:54.903764 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.903742    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"]
Sep 18 13:58:54.905493 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:58:54.905466    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420bf3d3_d6a5_4175_81cd_b490e06ef2bf.slice/crio-348fb742c05185ddcef5066326f3aac16c348513178e1373d63a812b00ec4ae8 WatchSource:0}: Error finding container 348fb742c05185ddcef5066326f3aac16c348513178e1373d63a812b00ec4ae8: Status 404 returned error can't find the container with id 348fb742c05185ddcef5066326f3aac16c348513178e1373d63a812b00ec4ae8
Sep 18 13:58:54.951919 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:54.951877    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf" event={"ID":"420bf3d3-d6a5-4175-81cd-b490e06ef2bf","Type":"ContainerStarted","Data":"348fb742c05185ddcef5066326f3aac16c348513178e1373d63a812b00ec4ae8"}
Sep 18 13:58:57.974240 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:57.974203    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf" event={"ID":"420bf3d3-d6a5-4175-81cd-b490e06ef2bf","Type":"ContainerStarted","Data":"9bde3fb4835bc7be422e8d1f7f46ac2eb404c8c9469cdaeed2eece31212942c1"}
Sep 18 13:58:57.994174 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:57.994120    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf" podStartSLOduration=1.463864354 podStartE2EDuration="3.994103686s" totalImagesPullingTime="2.530239332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:57.991546179 +0000 UTC m=+848.491303696" watchObservedRunningTime="2026-09-18 13:58:57.994103686 +0000 UTC m=+848.493861202"
Sep 18 13:58:58.981640 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:58.981608    2585 generic.go:356] "Generic (PLEG): container finished" podID="420bf3d3-d6a5-4175-81cd-b490e06ef2bf" containerID="9bde3fb4835bc7be422e8d1f7f46ac2eb404c8c9469cdaeed2eece31212942c1" exitCode=0
Sep 18 13:58:58.982047 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:58:58.981657    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf" event={"ID":"420bf3d3-d6a5-4175-81cd-b490e06ef2bf","Type":"ContainerDied","Data":"9bde3fb4835bc7be422e8d1f7f46ac2eb404c8c9469cdaeed2eece31212942c1"}
Sep 18 13:59:00.169923 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.169896    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:59:00.269599 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.269512    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/420bf3d3-d6a5-4175-81cd-b490e06ef2bf-maas-api-service-ca\") pod \"420bf3d3-d6a5-4175-81cd-b490e06ef2bf\" (UID: \"420bf3d3-d6a5-4175-81cd-b490e06ef2bf\") "
Sep 18 13:59:00.269920 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.269898    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420bf3d3-d6a5-4175-81cd-b490e06ef2bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "420bf3d3-d6a5-4175-81cd-b490e06ef2bf" (UID: "420bf3d3-d6a5-4175-81cd-b490e06ef2bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:59:00.371260 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.371224    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/420bf3d3-d6a5-4175-81cd-b490e06ef2bf-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:59:00.993678 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.993642    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf" event={"ID":"420bf3d3-d6a5-4175-81cd-b490e06ef2bf","Type":"ContainerDied","Data":"348fb742c05185ddcef5066326f3aac16c348513178e1373d63a812b00ec4ae8"}
Sep 18 13:59:00.993864 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.993692    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="348fb742c05185ddcef5066326f3aac16c348513178e1373d63a812b00ec4ae8"
Sep 18 13:59:00.993864 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:00.993651    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"
Sep 18 13:59:01.929353 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:01.929322    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 13:59:02.924639 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:02.924595    2585 patch_prober.go:28] interesting pod/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 13:59:02.924825 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:02.924678    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 13:59:04.001829 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:04.001797    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:59:05.020584 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.020555    2585 generic.go:356] "Generic (PLEG): container finished" podID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerID="50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a" exitCode=0
Sep 18 13:59:05.020981 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.020616    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" event={"ID":"eea94fc1-4509-43d4-88df-986c0fef9a5f","Type":"ContainerDied","Data":"50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"}
Sep 18 13:59:05.021078 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.021062    2585 scope.go:117] "RemoveContainer" containerID="50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"
Sep 18 13:59:05.022255 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.022227    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:05.022377 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.022312    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:05.022377 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.022359    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:05.214846 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.214807    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"]
Sep 18 13:59:05.220552 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.220522    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57fc5a8f-llhqf"]
Sep 18 13:59:05.642211 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:05.642122    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="420bf3d3-d6a5-4175-81cd-b490e06ef2bf" path="/var/lib/kubelet/pods/420bf3d3-d6a5-4175-81cd-b490e06ef2bf/volumes"
Sep 18 13:59:06.033294 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:06.033253    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" event={"ID":"eea94fc1-4509-43d4-88df-986c0fef9a5f","Type":"ContainerStarted","Data":"649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18"}
Sep 18 13:59:06.683395 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:06.683358    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:59:06.683683 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:06.683659    2585 patch_prober.go:28] interesting pod/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 18 13:59:06.683776 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:06.683717    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 18 13:59:07.683016 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:07.682985    2585 patch_prober.go:28] interesting pod/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 18 13:59:07.683457 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:07.683039    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 18 13:59:08.683508 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:08.683475    2585 patch_prober.go:28] interesting pod/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 18 13:59:08.683903 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:08.683529    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 18 13:59:09.683031 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:09.682986    2585 patch_prober.go:28] interesting pod/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 18 13:59:09.683219 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:09.683036    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 18 13:59:10.683074 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:10.683030    2585 patch_prober.go:28] interesting pod/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 18 13:59:10.683476 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:10.683108    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 18 13:59:11.687196 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:11.687160    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:59:11.687599 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:11.687477    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:59:11.688191 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:11.688177    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 13:59:26.582243 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:26.582205    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:59:34.200547 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.200455    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"]
Sep 18 13:59:34.201180 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.201159    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420bf3d3-d6a5-4175-81cd-b490e06ef2bf" containerName="revoke-keys"
Sep 18 13:59:34.201269 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.201183    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="420bf3d3-d6a5-4175-81cd-b490e06ef2bf" containerName="revoke-keys"
Sep 18 13:59:34.201359 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.201345    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="420bf3d3-d6a5-4175-81cd-b490e06ef2bf" containerName="revoke-keys"
Sep 18 13:59:34.208332 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.208308    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:34.210960 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.210931    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 13:59:34.212227 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.212202    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"]
Sep 18 13:59:34.234679 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.234647    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b124e5a5-feae-4715-a05d-3165a16b53d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk\" (UID: \"b124e5a5-feae-4715-a05d-3165a16b53d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:34.336210 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.336174    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b124e5a5-feae-4715-a05d-3165a16b53d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk\" (UID: \"b124e5a5-feae-4715-a05d-3165a16b53d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:34.336834 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.336813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b124e5a5-feae-4715-a05d-3165a16b53d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk\" (UID: \"b124e5a5-feae-4715-a05d-3165a16b53d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:34.538362 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.538260    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:34.812507 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:34.812402    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"]
Sep 18 13:59:34.815334 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:59:34.815303    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb124e5a5_feae_4715_a05d_3165a16b53d1.slice/crio-9bd1af4ee9ec32b448c3140158a46e118ad7121dc45c4013312ee161d18abe4e WatchSource:0}: Error finding container 9bd1af4ee9ec32b448c3140158a46e118ad7121dc45c4013312ee161d18abe4e: Status 404 returned error can't find the container with id 9bd1af4ee9ec32b448c3140158a46e118ad7121dc45c4013312ee161d18abe4e
Sep 18 13:59:35.215615 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:35.215584    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk" event={"ID":"b124e5a5-feae-4715-a05d-3165a16b53d1","Type":"ContainerStarted","Data":"a4810574a7c3401e6584e3893632740cce4d646d15dbf105e877c7a0ceedbaf7"}
Sep 18 13:59:35.215979 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:35.215637    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk" event={"ID":"b124e5a5-feae-4715-a05d-3165a16b53d1","Type":"ContainerStarted","Data":"9bd1af4ee9ec32b448c3140158a46e118ad7121dc45c4013312ee161d18abe4e"}
Sep 18 13:59:35.230587 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:35.230532    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk" podStartSLOduration=1.230511809 podStartE2EDuration="1.230511809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:35.229378014 +0000 UTC m=+885.729135529" watchObservedRunningTime="2026-09-18 13:59:35.230511809 +0000 UTC m=+885.730269335"
Sep 18 13:59:36.222566 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:36.222530    2585 generic.go:356] "Generic (PLEG): container finished" podID="b124e5a5-feae-4715-a05d-3165a16b53d1" containerID="a4810574a7c3401e6584e3893632740cce4d646d15dbf105e877c7a0ceedbaf7" exitCode=0
Sep 18 13:59:36.222965 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:36.222618    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk" event={"ID":"b124e5a5-feae-4715-a05d-3165a16b53d1","Type":"ContainerDied","Data":"a4810574a7c3401e6584e3893632740cce4d646d15dbf105e877c7a0ceedbaf7"}
Sep 18 13:59:37.371443 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:37.371399    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:37.467039 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:37.467000    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b124e5a5-feae-4715-a05d-3165a16b53d1-maas-api-service-ca\") pod \"b124e5a5-feae-4715-a05d-3165a16b53d1\" (UID: \"b124e5a5-feae-4715-a05d-3165a16b53d1\") "
Sep 18 13:59:37.467337 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:37.467315    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b124e5a5-feae-4715-a05d-3165a16b53d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b124e5a5-feae-4715-a05d-3165a16b53d1" (UID: "b124e5a5-feae-4715-a05d-3165a16b53d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:59:37.568626 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:37.568531    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b124e5a5-feae-4715-a05d-3165a16b53d1-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 13:59:38.235915 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:38.235888    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"
Sep 18 13:59:38.236093 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:38.235888    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk" event={"ID":"b124e5a5-feae-4715-a05d-3165a16b53d1","Type":"ContainerDied","Data":"9bd1af4ee9ec32b448c3140158a46e118ad7121dc45c4013312ee161d18abe4e"}
Sep 18 13:59:38.236093 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:38.236012    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bd1af4ee9ec32b448c3140158a46e118ad7121dc45c4013312ee161d18abe4e"
Sep 18 13:59:38.991257 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:38.991226    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 13:59:41.540867 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:41.540830    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"]
Sep 18 13:59:41.544384 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:41.544356    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-850ecce6-szgmk"]
Sep 18 13:59:41.644475 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:41.644400    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b124e5a5-feae-4715-a05d-3165a16b53d1" path="/var/lib/kubelet/pods/b124e5a5-feae-4715-a05d-3165a16b53d1/volumes"
Sep 18 13:59:42.402694 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.402665    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"]
Sep 18 13:59:42.403175 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.403159    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b124e5a5-feae-4715-a05d-3165a16b53d1" containerName="revoke-keys"
Sep 18 13:59:42.403175 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.403176    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b124e5a5-feae-4715-a05d-3165a16b53d1" containerName="revoke-keys"
Sep 18 13:59:42.403286 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.403264    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b124e5a5-feae-4715-a05d-3165a16b53d1" containerName="revoke-keys"
Sep 18 13:59:42.406962 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.406922    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.410156 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.410135    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8a84bc4e-openshift-default-dockercfg-2sxh9\""
Sep 18 13:59:42.422773 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.422747    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"]
Sep 18 13:59:42.517568 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517530    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-data\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.517781 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517628    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-token\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.517781 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517671    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-socket\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.517900 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517782    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-certs\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.517900 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517817    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-envoy\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.518011 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517899    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-podinfo\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.518011 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517930    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-credential-socket\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.518011 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.517960    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpgv\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-kube-api-access-nfpgv\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.518011 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.518004    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c118a16-2234-441e-8f9f-0dbace0a22c7-istiod-ca-cert\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.618744 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.618709    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-data\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.618784    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-token\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.618817    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-socket\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.618905    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-certs\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.618941    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-envoy\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619015    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-podinfo\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619039    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-credential-socket\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619063    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpgv\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-kube-api-access-nfpgv\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.619281 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619093    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c118a16-2234-441e-8f9f-0dbace0a22c7-istiod-ca-cert\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.620105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619328    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-socket\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.620105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619338    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-certs\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.620105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619765    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-data\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.620105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.619785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-credential-socket\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.620105 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.620056    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c118a16-2234-441e-8f9f-0dbace0a22c7-istiod-ca-cert\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.622131 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.622108    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-podinfo\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.622260 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.622131    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-envoy\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.627378 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.627354    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-token\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.627569 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.627548    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpgv\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-kube-api-access-nfpgv\") pod \"e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") " pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:42.718638 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:42.718597    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:43.003277 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.003243    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"]
Sep 18 13:59:43.004821 ip-10-0-132-83 kubenswrapper[2585]: W0918 13:59:43.004796    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c118a16_2234_441e_8f9f_0dbace0a22c7.slice/crio-c8a09e599b53a0b395544c18e902222f7156968249f7a472f218ef38f627ab0e WatchSource:0}: Error finding container c8a09e599b53a0b395544c18e902222f7156968249f7a472f218ef38f627ab0e: Status 404 returned error can't find the container with id c8a09e599b53a0b395544c18e902222f7156968249f7a472f218ef38f627ab0e
Sep 18 13:59:43.007282 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.007250    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:43.007396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.007330    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:43.007396 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.007377    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:43.276935 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.276836    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" event={"ID":"0c118a16-2234-441e-8f9f-0dbace0a22c7","Type":"ContainerStarted","Data":"38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"}
Sep 18 13:59:43.276935 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.276930    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" event={"ID":"0c118a16-2234-441e-8f9f-0dbace0a22c7","Type":"ContainerStarted","Data":"c8a09e599b53a0b395544c18e902222f7156968249f7a472f218ef38f627ab0e"}
Sep 18 13:59:43.302880 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.302831    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podStartSLOduration=1.302812237 podStartE2EDuration="1.302812237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:43.299819885 +0000 UTC m=+893.799577406" watchObservedRunningTime="2026-09-18 13:59:43.302812237 +0000 UTC m=+893.802569753"
Sep 18 13:59:43.719518 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:43.719481    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:44.724321 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:44.724291    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:45.288571 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:45.288536    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:45.289471 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:45.289449    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 13:59:51.576787 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:51.576759    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 13:59:51.577241 ip-10-0-132-83 kubenswrapper[2585]: I0918 13:59:51.576812    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:00:00.176051 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.176013    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"]
Sep 18 14:00:00.180985 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.180966    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"
Sep 18 14:00:00.187823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.187788    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:00:00.191335 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.191309    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"]
Sep 18 14:00:00.192788 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.192769    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"
Sep 18 14:00:00.195745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.195729    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"]
Sep 18 14:00:00.195862 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.195845    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"
Sep 18 14:00:00.202562 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.202539    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"
Sep 18 14:00:00.209070 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.208690    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"]
Sep 18 14:00:00.212404 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.212371    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"]
Sep 18 14:00:00.221023 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.220986    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"]
Sep 18 14:00:00.238273 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.238240    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"]
Sep 18 14:00:00.239233 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.238964    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"
Sep 18 14:00:00.242734 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.242707    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"
Sep 18 14:00:00.254284 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.254157    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"
Sep 18 14:00:00.263472 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.261271    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"]
Sep 18 14:00:00.306936 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.306750    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"
Sep 18 14:00:00.493591 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.493562    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"]
Sep 18 14:00:00.495075 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:00.495046    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b0ff3a_9964_48cf_8d20_6be38099cfb6.slice/crio-a8dfeb1072450f21d20210928b4b58e977c5fd6830df201763c525d7b65a3c69 WatchSource:0}: Error finding container a8dfeb1072450f21d20210928b4b58e977c5fd6830df201763c525d7b65a3c69: Status 404 returned error can't find the container with id a8dfeb1072450f21d20210928b4b58e977c5fd6830df201763c525d7b65a3c69
Sep 18 14:00:00.555387 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.555357    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"]
Sep 18 14:00:00.556227 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:00.556200    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c152d8_6a99_4ae2_971a_8b94ae4e3a5e.slice/crio-67d9ba9da36d3340ccde7343870a01878c89875ddf5af2643f15f6a148e061b5 WatchSource:0}: Error finding container 67d9ba9da36d3340ccde7343870a01878c89875ddf5af2643f15f6a148e061b5: Status 404 returned error can't find the container with id 67d9ba9da36d3340ccde7343870a01878c89875ddf5af2643f15f6a148e061b5
Sep 18 14:00:00.576190 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.576166    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"]
Sep 18 14:00:00.577868 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:00.577845    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb8f011_90b4_473e_84ad_12af78fa38f3.slice/crio-61dad80f5950a3c2633b468968254617fcc689ceaaac515609e1468012957d8d WatchSource:0}: Error finding container 61dad80f5950a3c2633b468968254617fcc689ceaaac515609e1468012957d8d: Status 404 returned error can't find the container with id 61dad80f5950a3c2633b468968254617fcc689ceaaac515609e1468012957d8d
Sep 18 14:00:00.611678 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:00.611651    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"]
Sep 18 14:00:00.613704 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:00.613676    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0de9b44_b58b_46d0_bc26_b16af7b9d0ee.slice/crio-6b501fb481fd6bd9837ef6e7937df9851f0353027cddef0fc63339e51e854ae9 WatchSource:0}: Error finding container 6b501fb481fd6bd9837ef6e7937df9851f0353027cddef0fc63339e51e854ae9: Status 404 returned error can't find the container with id 6b501fb481fd6bd9837ef6e7937df9851f0353027cddef0fc63339e51e854ae9
Sep 18 14:00:01.330661 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.330618    2585 patch_prober.go:28] interesting pod/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 14:00:01.331048 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.330690    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 14:00:01.384990 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.384954    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr" event={"ID":"a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e","Type":"ContainerStarted","Data":"b268d6cbb15a2f3dc4bb32ca5d17ff3c8f0fc6ff9d6a18d3563c0b31c42e6121"}
Sep 18 14:00:01.385192 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.385018    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr" event={"ID":"a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e","Type":"ContainerStarted","Data":"67d9ba9da36d3340ccde7343870a01878c89875ddf5af2643f15f6a148e061b5"}
Sep 18 14:00:01.386750 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.386721    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6" event={"ID":"53b0ff3a-9964-48cf-8d20-6be38099cfb6","Type":"ContainerStarted","Data":"e5b2529408d246ddd6bb5c496009e37beef6aec1100af43a60c5fe6c8fb042f2"}
Sep 18 14:00:01.386895 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.386766    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6" event={"ID":"53b0ff3a-9964-48cf-8d20-6be38099cfb6","Type":"ContainerStarted","Data":"a8dfeb1072450f21d20210928b4b58e977c5fd6830df201763c525d7b65a3c69"}
Sep 18 14:00:01.388565 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.388541    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7" event={"ID":"f0de9b44-b58b-46d0-bc26-b16af7b9d0ee","Type":"ContainerStarted","Data":"50990bbd55f64404e43343ecea667238fb5ab00a79d684c7d26923845cc9a9a5"}
Sep 18 14:00:01.388674 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.388586    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7" event={"ID":"f0de9b44-b58b-46d0-bc26-b16af7b9d0ee","Type":"ContainerStarted","Data":"6b501fb481fd6bd9837ef6e7937df9851f0353027cddef0fc63339e51e854ae9"}
Sep 18 14:00:01.390178 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.390147    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5" event={"ID":"1bb8f011-90b4-473e-84ad-12af78fa38f3","Type":"ContainerStarted","Data":"df74340a3a08328bf4e8db0ac4afb02159f93b0b961acab55e228dc7fc45fed5"}
Sep 18 14:00:01.390275 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.390190    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5" event={"ID":"1bb8f011-90b4-473e-84ad-12af78fa38f3","Type":"ContainerStarted","Data":"61dad80f5950a3c2633b468968254617fcc689ceaaac515609e1468012957d8d"}
Sep 18 14:00:01.400521 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.400477    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr" podStartSLOduration=1.4004625179999999 podStartE2EDuration="1.400462518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.399728787 +0000 UTC m=+911.899486301" watchObservedRunningTime="2026-09-18 14:00:01.400462518 +0000 UTC m=+911.900220027"
Sep 18 14:00:01.413923 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.413815    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5" podStartSLOduration=1.413795676 podStartE2EDuration="1.413795676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.413568884 +0000 UTC m=+911.913326392" watchObservedRunningTime="2026-09-18 14:00:01.413795676 +0000 UTC m=+911.913553193"
Sep 18 14:00:01.427518 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.427456    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7" podStartSLOduration=1.4274354200000001 podStartE2EDuration="1.42743542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.427149836 +0000 UTC m=+911.926907379" watchObservedRunningTime="2026-09-18 14:00:01.42743542 +0000 UTC m=+911.927192934"
Sep 18 14:00:01.444092 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:01.444040    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6" podStartSLOduration=1.444022361 podStartE2EDuration="1.444022361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:01.441574268 +0000 UTC m=+911.941331785" watchObservedRunningTime="2026-09-18 14:00:01.444022361 +0000 UTC m=+911.943779876"
Sep 18 14:00:02.397570 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.397536    2585 generic.go:356] "Generic (PLEG): container finished" podID="a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e" containerID="b268d6cbb15a2f3dc4bb32ca5d17ff3c8f0fc6ff9d6a18d3563c0b31c42e6121" exitCode=0
Sep 18 14:00:02.398018 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.397623    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr" event={"ID":"a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e","Type":"ContainerDied","Data":"b268d6cbb15a2f3dc4bb32ca5d17ff3c8f0fc6ff9d6a18d3563c0b31c42e6121"}
Sep 18 14:00:02.399178 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.399145    2585 generic.go:356] "Generic (PLEG): container finished" podID="53b0ff3a-9964-48cf-8d20-6be38099cfb6" containerID="e5b2529408d246ddd6bb5c496009e37beef6aec1100af43a60c5fe6c8fb042f2" exitCode=0
Sep 18 14:00:02.399312 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.399235    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6" event={"ID":"53b0ff3a-9964-48cf-8d20-6be38099cfb6","Type":"ContainerDied","Data":"e5b2529408d246ddd6bb5c496009e37beef6aec1100af43a60c5fe6c8fb042f2"}
Sep 18 14:00:02.400811 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.400789    2585 generic.go:356] "Generic (PLEG): container finished" podID="f0de9b44-b58b-46d0-bc26-b16af7b9d0ee" containerID="50990bbd55f64404e43343ecea667238fb5ab00a79d684c7d26923845cc9a9a5" exitCode=0
Sep 18 14:00:02.400916 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.400860    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7" event={"ID":"f0de9b44-b58b-46d0-bc26-b16af7b9d0ee","Type":"ContainerDied","Data":"50990bbd55f64404e43343ecea667238fb5ab00a79d684c7d26923845cc9a9a5"}
Sep 18 14:00:02.402562 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.402541    2585 generic.go:356] "Generic (PLEG): container finished" podID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerID="38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8" exitCode=0
Sep 18 14:00:02.402665 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.402619    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" event={"ID":"0c118a16-2234-441e-8f9f-0dbace0a22c7","Type":"ContainerDied","Data":"38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"}
Sep 18 14:00:02.403090 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.403072    2585 scope.go:117] "RemoveContainer" containerID="38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"
Sep 18 14:00:02.404236 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.404214    2585 generic.go:356] "Generic (PLEG): container finished" podID="1bb8f011-90b4-473e-84ad-12af78fa38f3" containerID="df74340a3a08328bf4e8db0ac4afb02159f93b0b961acab55e228dc7fc45fed5" exitCode=0
Sep 18 14:00:02.404320 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.404300    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5" event={"ID":"1bb8f011-90b4-473e-84ad-12af78fa38f3","Type":"ContainerDied","Data":"df74340a3a08328bf4e8db0ac4afb02159f93b0b961acab55e228dc7fc45fed5"}
Sep 18 14:00:02.404368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.404330    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:02.404434 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.404400    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:02.404487 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.404461    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:02.980705 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:02.980669    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:00:03.419215 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.419109    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" event={"ID":"0c118a16-2234-441e-8f9f-0dbace0a22c7","Type":"ContainerStarted","Data":"3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd"}
Sep 18 14:00:03.603965 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.603940    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"
Sep 18 14:00:03.679315 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.679291    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"
Sep 18 14:00:03.683838 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.683720    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"
Sep 18 14:00:03.738925 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.738191    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 14:00:03.738925 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.738350    2585 patch_prober.go:28] interesting pod/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 18 14:00:03.738925 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.738758    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 18 14:00:03.746222 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:03.746192    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"
Sep 18 14:00:04.431765 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.431725    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr" event={"ID":"a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e","Type":"ContainerDied","Data":"67d9ba9da36d3340ccde7343870a01878c89875ddf5af2643f15f6a148e061b5"}
Sep 18 14:00:04.432256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.431784    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67d9ba9da36d3340ccde7343870a01878c89875ddf5af2643f15f6a148e061b5"
Sep 18 14:00:04.432256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.431793    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"
Sep 18 14:00:04.433965 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.433946    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"
Sep 18 14:00:04.434123 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.433978    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6" event={"ID":"53b0ff3a-9964-48cf-8d20-6be38099cfb6","Type":"ContainerDied","Data":"a8dfeb1072450f21d20210928b4b58e977c5fd6830df201763c525d7b65a3c69"}
Sep 18 14:00:04.434123 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.434031    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8dfeb1072450f21d20210928b4b58e977c5fd6830df201763c525d7b65a3c69"
Sep 18 14:00:04.436020 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.435957    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"
Sep 18 14:00:04.436020 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.436001    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7" event={"ID":"f0de9b44-b58b-46d0-bc26-b16af7b9d0ee","Type":"ContainerDied","Data":"6b501fb481fd6bd9837ef6e7937df9851f0353027cddef0fc63339e51e854ae9"}
Sep 18 14:00:04.436237 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.436058    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b501fb481fd6bd9837ef6e7937df9851f0353027cddef0fc63339e51e854ae9"
Sep 18 14:00:04.438183 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.438161    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5"
Sep 18 14:00:04.438316 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.438208    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829000-l64z5" event={"ID":"1bb8f011-90b4-473e-84ad-12af78fa38f3","Type":"ContainerDied","Data":"61dad80f5950a3c2633b468968254617fcc689ceaaac515609e1468012957d8d"}
Sep 18 14:00:04.438316 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.438254    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61dad80f5950a3c2633b468968254617fcc689ceaaac515609e1468012957d8d"
Sep 18 14:00:04.719766 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.719660    2585 patch_prober.go:28] interesting pod/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 18 14:00:04.720057 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:04.720011    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 18 14:00:05.719572 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:05.719528    2585 patch_prober.go:28] interesting pod/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 18 14:00:05.720102 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:05.719626    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 18 14:00:06.719939 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:06.719892    2585 patch_prober.go:28] interesting pod/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 18 14:00:06.720502 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:06.719988    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 18 14:00:07.719925 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:07.719885    2585 patch_prober.go:28] interesting pod/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 18 14:00:07.720239 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:07.720209    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 18 14:00:08.722378 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:08.722342    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 14:00:08.722790 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:08.722664    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 14:00:08.723233 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:08.723215    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 14:00:15.524762 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.524725    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"]
Sep 18 14:00:15.525213 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525198    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e" containerName="cleanup"
Sep 18 14:00:15.525213 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525209    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e" containerName="cleanup"
Sep 18 14:00:15.525290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525227    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0de9b44-b58b-46d0-bc26-b16af7b9d0ee" containerName="cleanup"
Sep 18 14:00:15.525290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525233    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0de9b44-b58b-46d0-bc26-b16af7b9d0ee" containerName="cleanup"
Sep 18 14:00:15.525290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525245    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b0ff3a-9964-48cf-8d20-6be38099cfb6" containerName="cleanup"
Sep 18 14:00:15.525290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525250    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b0ff3a-9964-48cf-8d20-6be38099cfb6" containerName="cleanup"
Sep 18 14:00:15.525290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525259    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb8f011-90b4-473e-84ad-12af78fa38f3" containerName="cleanup"
Sep 18 14:00:15.525290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525265    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb8f011-90b4-473e-84ad-12af78fa38f3" containerName="cleanup"
Sep 18 14:00:15.525516 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525330    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e" containerName="cleanup"
Sep 18 14:00:15.525516 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525339    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b0ff3a-9964-48cf-8d20-6be38099cfb6" containerName="cleanup"
Sep 18 14:00:15.525516 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525348    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb8f011-90b4-473e-84ad-12af78fa38f3" containerName="cleanup"
Sep 18 14:00:15.525516 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.525354    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0de9b44-b58b-46d0-bc26-b16af7b9d0ee" containerName="cleanup"
Sep 18 14:00:15.527786 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.527772    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:15.529700 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.529682    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:00:15.535660 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.535632    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"]
Sep 18 14:00:15.594707 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.594671    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e73f80-7f05-466b-be5d-391a03d4d93a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j\" (UID: \"d1e73f80-7f05-466b-be5d-391a03d4d93a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:15.696050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.696009    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e73f80-7f05-466b-be5d-391a03d4d93a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j\" (UID: \"d1e73f80-7f05-466b-be5d-391a03d4d93a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:15.696826 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.696804    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e73f80-7f05-466b-be5d-391a03d4d93a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j\" (UID: \"d1e73f80-7f05-466b-be5d-391a03d4d93a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:15.839970 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:15.839888    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:16.110705 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:16.110679    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"]
Sep 18 14:00:16.112178 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:16.112139    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e73f80_7f05_466b_be5d_391a03d4d93a.slice/crio-27dec325090bb1cea76080b32d8a14c61cdec9e99022d322f3c740df085a3c30 WatchSource:0}: Error finding container 27dec325090bb1cea76080b32d8a14c61cdec9e99022d322f3c740df085a3c30: Status 404 returned error can't find the container with id 27dec325090bb1cea76080b32d8a14c61cdec9e99022d322f3c740df085a3c30
Sep 18 14:00:16.512728 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:16.512692    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j" event={"ID":"d1e73f80-7f05-466b-be5d-391a03d4d93a","Type":"ContainerStarted","Data":"9fc7b671524bec5f21e04defc78a3af696e7a42b077d36ddd11fe4f2ea3c3ef8"}
Sep 18 14:00:16.512929 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:16.512750    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j" event={"ID":"d1e73f80-7f05-466b-be5d-391a03d4d93a","Type":"ContainerStarted","Data":"27dec325090bb1cea76080b32d8a14c61cdec9e99022d322f3c740df085a3c30"}
Sep 18 14:00:16.528618 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:16.528554    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j" podStartSLOduration=1.528534402 podStartE2EDuration="1.528534402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:16.527878271 +0000 UTC m=+927.027635787" watchObservedRunningTime="2026-09-18 14:00:16.528534402 +0000 UTC m=+927.028291921"
Sep 18 14:00:17.520973 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:17.520936    2585 generic.go:356] "Generic (PLEG): container finished" podID="d1e73f80-7f05-466b-be5d-391a03d4d93a" containerID="9fc7b671524bec5f21e04defc78a3af696e7a42b077d36ddd11fe4f2ea3c3ef8" exitCode=0
Sep 18 14:00:17.521156 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:17.521020    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j" event={"ID":"d1e73f80-7f05-466b-be5d-391a03d4d93a","Type":"ContainerDied","Data":"9fc7b671524bec5f21e04defc78a3af696e7a42b077d36ddd11fe4f2ea3c3ef8"}
Sep 18 14:00:18.675773 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:18.675707    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:18.826360 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:18.826282    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e73f80-7f05-466b-be5d-391a03d4d93a-maas-api-service-ca\") pod \"d1e73f80-7f05-466b-be5d-391a03d4d93a\" (UID: \"d1e73f80-7f05-466b-be5d-391a03d4d93a\") "
Sep 18 14:00:18.826653 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:18.826630    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e73f80-7f05-466b-be5d-391a03d4d93a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1e73f80-7f05-466b-be5d-391a03d4d93a" (UID: "d1e73f80-7f05-466b-be5d-391a03d4d93a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:00:18.928065 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:18.928028    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e73f80-7f05-466b-be5d-391a03d4d93a-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:19.535131 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:19.535105    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"
Sep 18 14:00:19.535326 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:19.535144    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j" event={"ID":"d1e73f80-7f05-466b-be5d-391a03d4d93a","Type":"ContainerDied","Data":"27dec325090bb1cea76080b32d8a14c61cdec9e99022d322f3c740df085a3c30"}
Sep 18 14:00:19.535326 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:19.535232    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27dec325090bb1cea76080b32d8a14c61cdec9e99022d322f3c740df085a3c30"
Sep 18 14:00:23.184462 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:23.184425    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:00:26.524888 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:26.524851    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"]
Sep 18 14:00:26.541186 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:26.541147    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8a84bc4e-29829000-bndn7"]
Sep 18 14:00:26.776069 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:26.775932    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"]
Sep 18 14:00:26.779065 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:26.779037    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a84bc4e-v459j"]
Sep 18 14:00:27.641040 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:27.641009    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e73f80-7f05-466b-be5d-391a03d4d93a" path="/var/lib/kubelet/pods/d1e73f80-7f05-466b-be5d-391a03d4d93a/volumes"
Sep 18 14:00:27.641430 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:27.641297    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0de9b44-b58b-46d0-bc26-b16af7b9d0ee" path="/var/lib/kubelet/pods/f0de9b44-b58b-46d0-bc26-b16af7b9d0ee/volumes"
Sep 18 14:00:27.854591 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:27.854559    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"]
Sep 18 14:00:27.854821 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:27.854796    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy" containerID="cri-o://3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd" gracePeriod=30
Sep 18 14:00:33.117778 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.117713    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 14:00:33.179492 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179448    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-podinfo\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179657 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179531    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-envoy\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179657 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179571    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-data\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179657 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179618    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-socket\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179865 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179658    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfpgv\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-kube-api-access-nfpgv\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179865 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179685    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c118a16-2234-441e-8f9f-0dbace0a22c7-istiod-ca-cert\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179865 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179716    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-certs\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179865 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179790    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-credential-socket\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.179865 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179863    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-token\") pod \"0c118a16-2234-441e-8f9f-0dbace0a22c7\" (UID: \"0c118a16-2234-441e-8f9f-0dbace0a22c7\") "
Sep 18 14:00:33.180136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.179883    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:00:33.180136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.180039    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:00:33.180286 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.180266    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.180344 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.180291    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.180344 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.180305    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c118a16-2234-441e-8f9f-0dbace0a22c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:00:33.180597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.180359    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:00:33.180597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.180518    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:00:33.182271 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.182223    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-kube-api-access-nfpgv" (OuterVolumeSpecName: "kube-api-access-nfpgv") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "kube-api-access-nfpgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:00:33.182404 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.182339    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:00:33.182404 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.182362    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:00:33.182541 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.182430    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c118a16-2234-441e-8f9f-0dbace0a22c7" (UID: "0c118a16-2234-441e-8f9f-0dbace0a22c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:00:33.281205 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281158    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.281205 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281197    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.281205 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281210    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfpgv\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-kube-api-access-nfpgv\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.281511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281224    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c118a16-2234-441e-8f9f-0dbace0a22c7-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.281511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281236    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c118a16-2234-441e-8f9f-0dbace0a22c7-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.281511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281246    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.281511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.281256    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c118a16-2234-441e-8f9f-0dbace0a22c7-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:00:33.631375 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.631338    2585 generic.go:356] "Generic (PLEG): container finished" podID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerID="3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd" exitCode=0
Sep 18 14:00:33.631606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.631386    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"
Sep 18 14:00:33.631606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.631461    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" event={"ID":"0c118a16-2234-441e-8f9f-0dbace0a22c7","Type":"ContainerDied","Data":"3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd"}
Sep 18 14:00:33.631606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.631522    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs" event={"ID":"0c118a16-2234-441e-8f9f-0dbace0a22c7","Type":"ContainerDied","Data":"c8a09e599b53a0b395544c18e902222f7156968249f7a472f218ef38f627ab0e"}
Sep 18 14:00:33.631606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.631555    2585 scope.go:117] "RemoveContainer" containerID="3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd"
Sep 18 14:00:33.643119 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.643098    2585 scope.go:117] "RemoveContainer" containerID="38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"
Sep 18 14:00:33.652341 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.652315    2585 scope.go:117] "RemoveContainer" containerID="3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd"
Sep 18 14:00:33.652790 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:00:33.652751    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd\": container with ID starting with 3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd not found: ID does not exist" containerID="3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd"
Sep 18 14:00:33.652890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.652792    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd"} err="failed to get container status \"3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd\": rpc error: code = NotFound desc = could not find container \"3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd\": container with ID starting with 3f2e3fee982d9326368830ac12545ac85f202aaca79afcdc1faf0f9070eaafdd not found: ID does not exist"
Sep 18 14:00:33.652890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.652820    2585 scope.go:117] "RemoveContainer" containerID="38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"
Sep 18 14:00:33.653173 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:00:33.653144    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8\": container with ID starting with 38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8 not found: ID does not exist" containerID="38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"
Sep 18 14:00:33.653268 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.653169    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8"} err="failed to get container status \"38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8\": rpc error: code = NotFound desc = could not find container \"38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8\": container with ID starting with 38033c854d86158d87247d4d082899ca8cc75401829f81b09a979caf1b43ffe8 not found: ID does not exist"
Sep 18 14:00:33.656397 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.656374    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"]
Sep 18 14:00:33.663035 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:33.663010    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs"]
Sep 18 14:00:35.641098 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:35.641054    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" path="/var/lib/kubelet/pods/0c118a16-2234-441e-8f9f-0dbace0a22c7/volumes"
Sep 18 14:00:36.797753 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.797717    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"]
Sep 18 14:00:36.798212 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798199    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy"
Sep 18 14:00:36.798212 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798213    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy"
Sep 18 14:00:36.798300 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798224    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e73f80-7f05-466b-be5d-391a03d4d93a" containerName="revoke-keys"
Sep 18 14:00:36.798300 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798230    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e73f80-7f05-466b-be5d-391a03d4d93a" containerName="revoke-keys"
Sep 18 14:00:36.798300 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798238    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy"
Sep 18 14:00:36.798300 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798244    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy"
Sep 18 14:00:36.798487 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798314    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy"
Sep 18 14:00:36.798487 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.798324    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e73f80-7f05-466b-be5d-391a03d4d93a" containerName="revoke-keys"
Sep 18 14:00:36.800993 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.800977    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:36.803162 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.803131    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-21049c60\""
Sep 18 14:00:36.803162 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.803135    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-21049c60-dockercfg-jwgjs\""
Sep 18 14:00:36.810734 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.810709    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"]
Sep 18 14:00:36.817997 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.817962    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tsdx\" (UniqueName: \"kubernetes.io/projected/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-kube-api-access-5tsdx\") pod \"payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:36.818140 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.818093    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:36.919670 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.919625    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tsdx\" (UniqueName: \"kubernetes.io/projected/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-kube-api-access-5tsdx\") pod \"payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:36.919869 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.919742    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:36.920628 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.920603    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:36.931284 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:36.931205    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tsdx\" (UniqueName: \"kubernetes.io/projected/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-kube-api-access-5tsdx\") pod \"payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:37.113894 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:37.113801    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:37.386490 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:37.386463    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"]
Sep 18 14:00:37.388820 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:37.388793    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61522f53_e95f_44f4_bd7e_aa4c687c8dd0.slice/crio-6b33a80dec857bbe7e783e3b2ffcaaffed6e305f2d8c3269ca72e0f0f7d415b6 WatchSource:0}: Error finding container 6b33a80dec857bbe7e783e3b2ffcaaffed6e305f2d8c3269ca72e0f0f7d415b6: Status 404 returned error can't find the container with id 6b33a80dec857bbe7e783e3b2ffcaaffed6e305f2d8c3269ca72e0f0f7d415b6
Sep 18 14:00:37.658702 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:37.658615    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh" event={"ID":"61522f53-e95f-44f4-bd7e-aa4c687c8dd0","Type":"ContainerStarted","Data":"ba39f56c3adc9663d372a63bddf3d8773e994ff43ddf73eca1253ec4f682aa92"}
Sep 18 14:00:37.658702 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:37.658664    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh" event={"ID":"61522f53-e95f-44f4-bd7e-aa4c687c8dd0","Type":"ContainerStarted","Data":"6b33a80dec857bbe7e783e3b2ffcaaffed6e305f2d8c3269ca72e0f0f7d415b6"}
Sep 18 14:00:37.658910 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:37.658709    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:37.675870 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:37.675822    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh" podStartSLOduration=1.6758044330000001 podStartE2EDuration="1.675804433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:37.674904533 +0000 UTC m=+948.174662047" watchObservedRunningTime="2026-09-18 14:00:37.675804433 +0000 UTC m=+948.175561950"
Sep 18 14:00:47.382317 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:47.382275    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:00:48.667376 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:48.667347    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:00:56.631899 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.631857    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"]
Sep 18 14:00:56.632451 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.632437    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c118a16-2234-441e-8f9f-0dbace0a22c7" containerName="istio-proxy"
Sep 18 14:00:56.635355 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.635339    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:00:56.637446 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.637407    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:00:56.643644 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.643072    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"]
Sep 18 14:00:56.736445 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.736374    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfba995-c338-48aa-95b0-4239abdc8c3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-13658e-5cxhj\" (UID: \"fbfba995-c338-48aa-95b0-4239abdc8c3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:00:56.838132 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.838094    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfba995-c338-48aa-95b0-4239abdc8c3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-13658e-5cxhj\" (UID: \"fbfba995-c338-48aa-95b0-4239abdc8c3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:00:56.838818 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.838792    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfba995-c338-48aa-95b0-4239abdc8c3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-13658e-5cxhj\" (UID: \"fbfba995-c338-48aa-95b0-4239abdc8c3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:00:56.949327 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:56.949294    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:00:57.226725 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.226691    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"]
Sep 18 14:00:57.228679 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:57.228657    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfba995_c338_48aa_95b0_4239abdc8c3c.slice/crio-59116407eaabc76da073416585f35c770851b3db4cb27e1d3fb9df50d35fd976 WatchSource:0}: Error finding container 59116407eaabc76da073416585f35c770851b3db4cb27e1d3fb9df50d35fd976: Status 404 returned error can't find the container with id 59116407eaabc76da073416585f35c770851b3db4cb27e1d3fb9df50d35fd976
Sep 18 14:00:57.294287 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.294259    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"]
Sep 18 14:00:57.298146 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.298126    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.300678 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.300654    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-036fc2\"/\"kube-root-ca.crt\""
Sep 18 14:00:57.300801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.300726    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-036fc2\"/\"test-model-036fc2-kserve-self-signed-certs\""
Sep 18 14:00:57.300801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.300742    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-036fc2\"/\"default-dockercfg-5cvlf\""
Sep 18 14:00:57.300801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.300783    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-036fc2\"/\"openshift-service-ca.crt\""
Sep 18 14:00:57.308691 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.308665    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"]
Sep 18 14:00:57.444023 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.443973    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-dshm\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.444244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.444062    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-model-cache\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.444244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.444185    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vr28\" (UniqueName: \"kubernetes.io/projected/d18863d6-5066-44f2-9443-5f80f0f2a3b8-kube-api-access-7vr28\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.444244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.444218    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tls-certs\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.444517 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.444251    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tmp-dir\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.444517 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.444331    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-home\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545330 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545291    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-model-cache\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545346    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vr28\" (UniqueName: \"kubernetes.io/projected/d18863d6-5066-44f2-9443-5f80f0f2a3b8-kube-api-access-7vr28\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545376    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tls-certs\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545435    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tmp-dir\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545512    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-home\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545783 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545617    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-dshm\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545783 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545763    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-model-cache\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545883 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tmp-dir\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.545983 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.545953    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-home\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.547923 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.547902    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-dshm\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.548095 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.548079    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tls-certs\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.559085 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.559059    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vr28\" (UniqueName: \"kubernetes.io/projected/d18863d6-5066-44f2-9443-5f80f0f2a3b8-kube-api-access-7vr28\") pod \"test-model-036fc2-kserve-65c97c4dbf-7mq5g\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") " pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.609986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.609951    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:00:57.782659 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.782392    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj" event={"ID":"fbfba995-c338-48aa-95b0-4239abdc8c3c","Type":"ContainerStarted","Data":"24483544a55dd46876aa6c28cd52efb2ad9298e6bae5c0d762e56491b88fe08f"}
Sep 18 14:00:57.782659 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.782497    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj" event={"ID":"fbfba995-c338-48aa-95b0-4239abdc8c3c","Type":"ContainerStarted","Data":"59116407eaabc76da073416585f35c770851b3db4cb27e1d3fb9df50d35fd976"}
Sep 18 14:00:57.808020 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.807964    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj" podStartSLOduration=1.807947049 podStartE2EDuration="1.807947049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:57.804832998 +0000 UTC m=+968.304590533" watchObservedRunningTime="2026-09-18 14:00:57.807947049 +0000 UTC m=+968.307704615"
Sep 18 14:00:57.904811 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:00:57.904776    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18863d6_5066_44f2_9443_5f80f0f2a3b8.slice/crio-f5b71e933b882278f2db745146cf3bac621129b42c30ae1c6bfe84678c92075e WatchSource:0}: Error finding container f5b71e933b882278f2db745146cf3bac621129b42c30ae1c6bfe84678c92075e: Status 404 returned error can't find the container with id f5b71e933b882278f2db745146cf3bac621129b42c30ae1c6bfe84678c92075e
Sep 18 14:00:57.905726 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:57.905702    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"]
Sep 18 14:00:58.790293 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:58.790261    2585 generic.go:356] "Generic (PLEG): container finished" podID="fbfba995-c338-48aa-95b0-4239abdc8c3c" containerID="24483544a55dd46876aa6c28cd52efb2ad9298e6bae5c0d762e56491b88fe08f" exitCode=0
Sep 18 14:00:58.790760 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:58.790358    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj" event={"ID":"fbfba995-c338-48aa-95b0-4239abdc8c3c","Type":"ContainerDied","Data":"24483544a55dd46876aa6c28cd52efb2ad9298e6bae5c0d762e56491b88fe08f"}
Sep 18 14:00:58.792353 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:58.792318    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g" event={"ID":"d18863d6-5066-44f2-9443-5f80f0f2a3b8","Type":"ContainerStarted","Data":"aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c"}
Sep 18 14:00:58.792503 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:58.792355    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g" event={"ID":"d18863d6-5066-44f2-9443-5f80f0f2a3b8","Type":"ContainerStarted","Data":"f5b71e933b882278f2db745146cf3bac621129b42c30ae1c6bfe84678c92075e"}
Sep 18 14:00:58.826088 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:58.826039    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g" podStartSLOduration=1.826015592 podStartE2EDuration="1.826015592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:58.8254565 +0000 UTC m=+969.325214013" watchObservedRunningTime="2026-09-18 14:00:58.826015592 +0000 UTC m=+969.325773126"
Sep 18 14:00:59.938467 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:00:59.938440    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:01:00.077772 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:00.077687    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfba995-c338-48aa-95b0-4239abdc8c3c-maas-api-service-ca\") pod \"fbfba995-c338-48aa-95b0-4239abdc8c3c\" (UID: \"fbfba995-c338-48aa-95b0-4239abdc8c3c\") "
Sep 18 14:01:00.078077 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:00.078056    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbfba995-c338-48aa-95b0-4239abdc8c3c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fbfba995-c338-48aa-95b0-4239abdc8c3c" (UID: "fbfba995-c338-48aa-95b0-4239abdc8c3c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:00.179214 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:00.179178    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfba995-c338-48aa-95b0-4239abdc8c3c-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:01:00.805510 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:00.805481    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"
Sep 18 14:01:00.805700 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:00.805535    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj" event={"ID":"fbfba995-c338-48aa-95b0-4239abdc8c3c","Type":"ContainerDied","Data":"59116407eaabc76da073416585f35c770851b3db4cb27e1d3fb9df50d35fd976"}
Sep 18 14:01:00.805700 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:00.805579    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59116407eaabc76da073416585f35c770851b3db4cb27e1d3fb9df50d35fd976"
Sep 18 14:01:03.387442 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:03.387332    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:01:06.710937 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.710896    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"]
Sep 18 14:01:06.711646 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.711626    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbfba995-c338-48aa-95b0-4239abdc8c3c" containerName="revoke-keys"
Sep 18 14:01:06.711646 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.711647    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbfba995-c338-48aa-95b0-4239abdc8c3c" containerName="revoke-keys"
Sep 18 14:01:06.711818 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.711768    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbfba995-c338-48aa-95b0-4239abdc8c3c" containerName="revoke-keys"
Sep 18 14:01:06.714003 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.713982    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:06.716167 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.716147    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:01:06.723488 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.723461    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"]
Sep 18 14:01:06.747090 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.746939    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b399c6-fae2-4ad5-8840-8b933630ceb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-21049c60-c6xch\" (UID: \"18b399c6-fae2-4ad5-8840-8b933630ceb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:06.848013 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.847965    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b399c6-fae2-4ad5-8840-8b933630ceb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-21049c60-c6xch\" (UID: \"18b399c6-fae2-4ad5-8840-8b933630ceb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:06.848605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:06.848587    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b399c6-fae2-4ad5-8840-8b933630ceb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-21049c60-c6xch\" (UID: \"18b399c6-fae2-4ad5-8840-8b933630ceb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:07.026365 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.026275    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:07.300460 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.300403    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"]
Sep 18 14:01:07.301960 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:01:07.301932    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b399c6_fae2_4ad5_8840_8b933630ceb2.slice/crio-e4594cef0da464e2990e361138d0b074be9146e8cf8d828f63b71be63ba1997c WatchSource:0}: Error finding container e4594cef0da464e2990e361138d0b074be9146e8cf8d828f63b71be63ba1997c: Status 404 returned error can't find the container with id e4594cef0da464e2990e361138d0b074be9146e8cf8d828f63b71be63ba1997c
Sep 18 14:01:07.610475 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.610449    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:01:07.610643 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.610497    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:01:07.623571 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.623547    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:01:07.853982 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.853940    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch" event={"ID":"18b399c6-fae2-4ad5-8840-8b933630ceb2","Type":"ContainerStarted","Data":"ab370dd9af01f5e834bf824ed64ae88c29a426481ad2bfe43bcf37bcf62d4490"}
Sep 18 14:01:07.854462 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.854007    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch" event={"ID":"18b399c6-fae2-4ad5-8840-8b933630ceb2","Type":"ContainerStarted","Data":"e4594cef0da464e2990e361138d0b074be9146e8cf8d828f63b71be63ba1997c"}
Sep 18 14:01:07.865616 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.865537    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:01:07.870928 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:07.870886    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch" podStartSLOduration=1.870871144 podStartE2EDuration="1.870871144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:01:07.869453795 +0000 UTC m=+978.369211307" watchObservedRunningTime="2026-09-18 14:01:07.870871144 +0000 UTC m=+978.370628660"
Sep 18 14:01:08.864620 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:08.864590    2585 generic.go:356] "Generic (PLEG): container finished" podID="18b399c6-fae2-4ad5-8840-8b933630ceb2" containerID="ab370dd9af01f5e834bf824ed64ae88c29a426481ad2bfe43bcf37bcf62d4490" exitCode=0
Sep 18 14:01:08.865016 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:08.864676    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch" event={"ID":"18b399c6-fae2-4ad5-8840-8b933630ceb2","Type":"ContainerDied","Data":"ab370dd9af01f5e834bf824ed64ae88c29a426481ad2bfe43bcf37bcf62d4490"}
Sep 18 14:01:09.053788 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:09.053735    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"]
Sep 18 14:01:09.056109 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:09.056086    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-13658e-5cxhj"]
Sep 18 14:01:09.641555 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:09.641519    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbfba995-c338-48aa-95b0-4239abdc8c3c" path="/var/lib/kubelet/pods/fbfba995-c338-48aa-95b0-4239abdc8c3c/volumes"
Sep 18 14:01:10.022289 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.022261    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:10.086751 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.086712    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b399c6-fae2-4ad5-8840-8b933630ceb2-maas-api-service-ca\") pod \"18b399c6-fae2-4ad5-8840-8b933630ceb2\" (UID: \"18b399c6-fae2-4ad5-8840-8b933630ceb2\") "
Sep 18 14:01:10.087077 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.087052    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18b399c6-fae2-4ad5-8840-8b933630ceb2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "18b399c6-fae2-4ad5-8840-8b933630ceb2" (UID: "18b399c6-fae2-4ad5-8840-8b933630ceb2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:10.188371 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.188267    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b399c6-fae2-4ad5-8840-8b933630ceb2-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:01:10.879173 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.879138    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"
Sep 18 14:01:10.879370 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.879144    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch" event={"ID":"18b399c6-fae2-4ad5-8840-8b933630ceb2","Type":"ContainerDied","Data":"e4594cef0da464e2990e361138d0b074be9146e8cf8d828f63b71be63ba1997c"}
Sep 18 14:01:10.879370 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:10.879293    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4594cef0da464e2990e361138d0b074be9146e8cf8d828f63b71be63ba1997c"
Sep 18 14:01:17.702298 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.702252    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"]
Sep 18 14:01:17.702769 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.702682    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh" podUID="61522f53-e95f-44f4-bd7e-aa4c687c8dd0" containerName="payload-pre-processing" containerID="cri-o://ba39f56c3adc9663d372a63bddf3d8773e994ff43ddf73eca1253ec4f682aa92" gracePeriod=30
Sep 18 14:01:17.907858 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.907814    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"]
Sep 18 14:01:17.914662 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.914629    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21049c60-c6xch"]
Sep 18 14:01:17.927555 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.927510    2585 generic.go:356] "Generic (PLEG): container finished" podID="61522f53-e95f-44f4-bd7e-aa4c687c8dd0" containerID="ba39f56c3adc9663d372a63bddf3d8773e994ff43ddf73eca1253ec4f682aa92" exitCode=0
Sep 18 14:01:17.927703 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.927582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh" event={"ID":"61522f53-e95f-44f4-bd7e-aa4c687c8dd0","Type":"ContainerDied","Data":"ba39f56c3adc9663d372a63bddf3d8773e994ff43ddf73eca1253ec4f682aa92"}
Sep 18 14:01:17.963630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:17.963570    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:01:18.070261 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.070226    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tsdx\" (UniqueName: \"kubernetes.io/projected/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-kube-api-access-5tsdx\") pod \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") "
Sep 18 14:01:18.070493 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.070329    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-plugins-config-volume\") pod \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\" (UID: \"61522f53-e95f-44f4-bd7e-aa4c687c8dd0\") "
Sep 18 14:01:18.070717 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.070694    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61522f53-e95f-44f4-bd7e-aa4c687c8dd0" (UID: "61522f53-e95f-44f4-bd7e-aa4c687c8dd0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:18.072479 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.072455    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-kube-api-access-5tsdx" (OuterVolumeSpecName: "kube-api-access-5tsdx") pod "61522f53-e95f-44f4-bd7e-aa4c687c8dd0" (UID: "61522f53-e95f-44f4-bd7e-aa4c687c8dd0"). InnerVolumeSpecName "kube-api-access-5tsdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:18.171350 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.171312    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tsdx\" (UniqueName: \"kubernetes.io/projected/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-kube-api-access-5tsdx\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:01:18.171350 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.171347    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61522f53-e95f-44f4-bd7e-aa4c687c8dd0-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:01:18.935244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.935216    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"
Sep 18 14:01:18.935244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.935238    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh" event={"ID":"61522f53-e95f-44f4-bd7e-aa4c687c8dd0","Type":"ContainerDied","Data":"6b33a80dec857bbe7e783e3b2ffcaaffed6e305f2d8c3269ca72e0f0f7d415b6"}
Sep 18 14:01:18.935757 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.935300    2585 scope.go:117] "RemoveContainer" containerID="ba39f56c3adc9663d372a63bddf3d8773e994ff43ddf73eca1253ec4f682aa92"
Sep 18 14:01:18.981433 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.981386    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"]
Sep 18 14:01:18.992171 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:18.992132    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh"]
Sep 18 14:01:19.641561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:19.641532    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b399c6-fae2-4ad5-8840-8b933630ceb2" path="/var/lib/kubelet/pods/18b399c6-fae2-4ad5-8840-8b933630ceb2/volumes"
Sep 18 14:01:19.641946 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:19.641924    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61522f53-e95f-44f4-bd7e-aa4c687c8dd0" path="/var/lib/kubelet/pods/61522f53-e95f-44f4-bd7e-aa4c687c8dd0/volumes"
Sep 18 14:01:25.784657 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:25.784619    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:01:52.077471 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:01:52.077429    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:02:18.582483 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:18.582441    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:02:38.772332 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:38.772242    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:02:56.226249 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226218    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"]
Sep 18 14:02:56.226796 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226780    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b399c6-fae2-4ad5-8840-8b933630ceb2" containerName="revoke-keys"
Sep 18 14:02:56.226843 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226798    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b399c6-fae2-4ad5-8840-8b933630ceb2" containerName="revoke-keys"
Sep 18 14:02:56.226843 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226811    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61522f53-e95f-44f4-bd7e-aa4c687c8dd0" containerName="payload-pre-processing"
Sep 18 14:02:56.226843 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226817    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="61522f53-e95f-44f4-bd7e-aa4c687c8dd0" containerName="payload-pre-processing"
Sep 18 14:02:56.226940 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226906    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="61522f53-e95f-44f4-bd7e-aa4c687c8dd0" containerName="payload-pre-processing"
Sep 18 14:02:56.226940 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.226915    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b399c6-fae2-4ad5-8840-8b933630ceb2" containerName="revoke-keys"
Sep 18 14:02:56.230293 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.230272    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.232517 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.232498    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f17132d8-openshift-default-dockercfg-4f2qq\""
Sep 18 14:02:56.245165 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.245136    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"]
Sep 18 14:02:56.302955 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.302915    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-data\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.302955 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.302953    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-socket\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303167 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303047    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-certs\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303167 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303076    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-envoy\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303167 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303151    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-token\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303269 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303178    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n46wf\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-kube-api-access-n46wf\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303269 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303195    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-podinfo\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303269 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303214    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c82d8e-8a00-4428-8449-f8d687bf1f87-istiod-ca-cert\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.303269 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.303257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-credential-socket\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404111 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404071    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-token\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404121    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n46wf\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-kube-api-access-n46wf\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404139    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-podinfo\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404162    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c82d8e-8a00-4428-8449-f8d687bf1f87-istiod-ca-cert\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404217    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-credential-socket\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-data\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404288    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-socket\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404741 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404407    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-certs\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404741 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404507    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-envoy\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.404946 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.404904    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-credential-socket\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.405201 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.405176    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c82d8e-8a00-4428-8449-f8d687bf1f87-istiod-ca-cert\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.405367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.405238    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-data\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.405534 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.405290    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-certs\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.406106 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.406082    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-socket\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.407321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.407301    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-envoy\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.407403 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.407301    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-podinfo\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.417176 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.417150    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-token\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.417289 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.417157    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n46wf\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-kube-api-access-n46wf\") pod \"e2e-mt-f17132d8-openshift-default-7954847856-fm6vk\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") " pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.540387 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.540287    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:56.877312 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.877213    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"]
Sep 18 14:02:56.880529 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:02:56.880501    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c82d8e_8a00_4428_8449_f8d687bf1f87.slice/crio-1fdae9628c52f9a30728408a46779078614194ff3de989006bbb007e4463cd35 WatchSource:0}: Error finding container 1fdae9628c52f9a30728408a46779078614194ff3de989006bbb007e4463cd35: Status 404 returned error can't find the container with id 1fdae9628c52f9a30728408a46779078614194ff3de989006bbb007e4463cd35
Sep 18 14:02:56.882948 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.882904    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:02:56.883041 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.882996    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:02:56.883081 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:56.883043    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:02:57.563344 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:57.563303    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" event={"ID":"52c82d8e-8a00-4428-8449-f8d687bf1f87","Type":"ContainerStarted","Data":"a42b6bd3b6e60b07bb18b33eb2e4bf97f57c581471ba2ca33b8f38e641cbbf8c"}
Sep 18 14:02:57.563821 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:57.563355    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" event={"ID":"52c82d8e-8a00-4428-8449-f8d687bf1f87","Type":"ContainerStarted","Data":"1fdae9628c52f9a30728408a46779078614194ff3de989006bbb007e4463cd35"}
Sep 18 14:02:57.586543 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:57.586492    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podStartSLOduration=1.586474694 podStartE2EDuration="1.586474694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:57.585317345 +0000 UTC m=+1088.085074872" watchObservedRunningTime="2026-09-18 14:02:57.586474694 +0000 UTC m=+1088.086232209"
Sep 18 14:02:58.540998 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:58.540952    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:58.546611 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:58.546585    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:58.569580 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:58.569544    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:02:58.570825 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:02:58.570802    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:03:11.782235 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:11.782197    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:03:22.696936 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.696899    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"]
Sep 18 14:03:22.701040 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.701017    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.704039 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.704015    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-ec85d5\"/\"explicit-model-ec85d5-kserve-self-signed-certs\""
Sep 18 14:03:22.704171 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.704044    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-ec85d5\"/\"default-dockercfg-zccx8\""
Sep 18 14:03:22.704171 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.704060    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-ec85d5\"/\"openshift-service-ca.crt\""
Sep 18 14:03:22.704171 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.704080    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-ec85d5\"/\"kube-root-ca.crt\""
Sep 18 14:03:22.709807 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.709784    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"]
Sep 18 14:03:22.890373 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.890331    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-dshm\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.890592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.890391    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-home\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.890592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.890529    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tls-certs\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.890592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.890560    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-model-cache\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.890701 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.890662    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tmp-dir\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.890737 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.890700    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4m85\" (UniqueName: \"kubernetes.io/projected/1606cbf0-a560-4d1c-86a8-3116ade5ee04-kube-api-access-f4m85\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992254 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992154    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tmp-dir\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992254 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992193    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4m85\" (UniqueName: \"kubernetes.io/projected/1606cbf0-a560-4d1c-86a8-3116ade5ee04-kube-api-access-f4m85\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992254 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992248    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-dshm\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992570 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992283    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-home\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992570 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992356    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tls-certs\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992570 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992389    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-model-cache\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992733 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992636    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tmp-dir\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992794 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992732    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-home\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.992794 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.992787    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-model-cache\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.994833 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.994801    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-dshm\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:22.995057 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:22.995039    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tls-certs\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:23.001968 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:23.001934    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4m85\" (UniqueName: \"kubernetes.io/projected/1606cbf0-a560-4d1c-86a8-3116ade5ee04-kube-api-access-f4m85\") pod \"explicit-model-ec85d5-kserve-58f6f49677-lb9br\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") " pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:23.011796 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:23.011766    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:23.283681 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:23.283653    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"]
Sep 18 14:03:23.284843 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:03:23.284817    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1606cbf0_a560_4d1c_86a8_3116ade5ee04.slice/crio-ba0e31c0612e77a9fe8ad54780dc1041c2efa094696d467a5cd5a7ce71259284 WatchSource:0}: Error finding container ba0e31c0612e77a9fe8ad54780dc1041c2efa094696d467a5cd5a7ce71259284: Status 404 returned error can't find the container with id ba0e31c0612e77a9fe8ad54780dc1041c2efa094696d467a5cd5a7ce71259284
Sep 18 14:03:23.731050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:23.731008    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br" event={"ID":"1606cbf0-a560-4d1c-86a8-3116ade5ee04","Type":"ContainerStarted","Data":"7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f"}
Sep 18 14:03:23.731454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:23.731061    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br" event={"ID":"1606cbf0-a560-4d1c-86a8-3116ade5ee04","Type":"ContainerStarted","Data":"ba0e31c0612e77a9fe8ad54780dc1041c2efa094696d467a5cd5a7ce71259284"}
Sep 18 14:03:23.748312 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:23.748234    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br" podStartSLOduration=1.748218831 podStartE2EDuration="1.748218831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:03:23.746501856 +0000 UTC m=+1114.246259373" watchObservedRunningTime="2026-09-18 14:03:23.748218831 +0000 UTC m=+1114.247976346"
Sep 18 14:03:33.012916 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:33.012865    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:33.016100 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:33.016062    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:33.040916 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:33.040878    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:33.840763 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:33.840732    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:03:39.849212 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:39.849171    2585 generic.go:356] "Generic (PLEG): container finished" podID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerID="a42b6bd3b6e60b07bb18b33eb2e4bf97f57c581471ba2ca33b8f38e641cbbf8c" exitCode=0
Sep 18 14:03:39.849212 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:39.849205    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" event={"ID":"52c82d8e-8a00-4428-8449-f8d687bf1f87","Type":"ContainerDied","Data":"a42b6bd3b6e60b07bb18b33eb2e4bf97f57c581471ba2ca33b8f38e641cbbf8c"}
Sep 18 14:03:39.849745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:39.849698    2585 scope.go:117] "RemoveContainer" containerID="a42b6bd3b6e60b07bb18b33eb2e4bf97f57c581471ba2ca33b8f38e641cbbf8c"
Sep 18 14:03:39.850984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:39.850953    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:03:39.851110 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:39.851040    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:03:39.851110 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:39.851088    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:03:40.166933 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.166846    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"]
Sep 18 14:03:40.169692 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.169674    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:40.171776 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.171750    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:03:40.178252 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.178097    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"]
Sep 18 14:03:40.287763 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.287722    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f150ff6-212c-4a60-b8ef-e8287fa11a5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f17132d8-85rh4\" (UID: \"4f150ff6-212c-4a60-b8ef-e8287fa11a5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:40.388957 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.388919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f150ff6-212c-4a60-b8ef-e8287fa11a5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f17132d8-85rh4\" (UID: \"4f150ff6-212c-4a60-b8ef-e8287fa11a5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:40.389671 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.389644    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f150ff6-212c-4a60-b8ef-e8287fa11a5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f17132d8-85rh4\" (UID: \"4f150ff6-212c-4a60-b8ef-e8287fa11a5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:40.481987 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.481946    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:40.781385 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.781351    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"]
Sep 18 14:03:40.783294 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:03:40.783258    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f150ff6_212c_4a60_b8ef_e8287fa11a5f.slice/crio-7b70c48cce7b69f6a593d0faf77ca7b5a0ef1b2351e1074d8107ce6cf9d19f9c WatchSource:0}: Error finding container 7b70c48cce7b69f6a593d0faf77ca7b5a0ef1b2351e1074d8107ce6cf9d19f9c: Status 404 returned error can't find the container with id 7b70c48cce7b69f6a593d0faf77ca7b5a0ef1b2351e1074d8107ce6cf9d19f9c
Sep 18 14:03:40.857058 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.857024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4" event={"ID":"4f150ff6-212c-4a60-b8ef-e8287fa11a5f","Type":"ContainerStarted","Data":"7b70c48cce7b69f6a593d0faf77ca7b5a0ef1b2351e1074d8107ce6cf9d19f9c"}
Sep 18 14:03:40.859088 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:40.859062    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" event={"ID":"52c82d8e-8a00-4428-8449-f8d687bf1f87","Type":"ContainerStarted","Data":"183afc6680b1e28b91476d4d859bf6662329e1832be919d6ca4c93e556283b66"}
Sep 18 14:03:41.540893 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:41.540788    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:03:41.542195 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:41.542168    2585 patch_prober.go:28] interesting pod/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 18 14:03:41.542333 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:41.542218    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 18 14:03:41.867244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:41.867212    2585 generic.go:356] "Generic (PLEG): container finished" podID="4f150ff6-212c-4a60-b8ef-e8287fa11a5f" containerID="72aa87774a1d026672f89d2bbcfed8ec32c4c0e9a7c7da2fde7f3d1640979156" exitCode=0
Sep 18 14:03:41.867664 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:41.867288    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4" event={"ID":"4f150ff6-212c-4a60-b8ef-e8287fa11a5f","Type":"ContainerDied","Data":"72aa87774a1d026672f89d2bbcfed8ec32c4c0e9a7c7da2fde7f3d1640979156"}
Sep 18 14:03:42.541800 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:42.541756    2585 patch_prober.go:28] interesting pod/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 18 14:03:42.542002 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:42.541830    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 18 14:03:43.062215 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.062182    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:43.236993 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.236951    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f150ff6-212c-4a60-b8ef-e8287fa11a5f-maas-api-service-ca\") pod \"4f150ff6-212c-4a60-b8ef-e8287fa11a5f\" (UID: \"4f150ff6-212c-4a60-b8ef-e8287fa11a5f\") "
Sep 18 14:03:43.237359 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.237334    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f150ff6-212c-4a60-b8ef-e8287fa11a5f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f150ff6-212c-4a60-b8ef-e8287fa11a5f" (UID: "4f150ff6-212c-4a60-b8ef-e8287fa11a5f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:03:43.237486 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.237472    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f150ff6-212c-4a60-b8ef-e8287fa11a5f-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:03:43.541745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.541638    2585 patch_prober.go:28] interesting pod/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 18 14:03:43.541745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.541718    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 18 14:03:43.570038 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.569995    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:03:43.880926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.880847    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"
Sep 18 14:03:43.881093 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.880841    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4" event={"ID":"4f150ff6-212c-4a60-b8ef-e8287fa11a5f","Type":"ContainerDied","Data":"7b70c48cce7b69f6a593d0faf77ca7b5a0ef1b2351e1074d8107ce6cf9d19f9c"}
Sep 18 14:03:43.881093 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:43.880967    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b70c48cce7b69f6a593d0faf77ca7b5a0ef1b2351e1074d8107ce6cf9d19f9c"
Sep 18 14:03:44.396542 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:44.396509    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:03:44.541586 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:44.541553    2585 patch_prober.go:28] interesting pod/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 18 14:03:44.541757 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:44.541610    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 18 14:03:45.541255 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:45.541206    2585 patch_prober.go:28] interesting pod/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 18 14:03:45.541683 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:45.541272    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 18 14:03:46.545715 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:46.545686    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:03:46.546783 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:46.546759    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:03:51.334110 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:51.334071    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"]
Sep 18 14:03:51.353533 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:51.353497    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f17132d8-85rh4"]
Sep 18 14:03:51.651893 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:51.651814    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f150ff6-212c-4a60-b8ef-e8287fa11a5f" path="/var/lib/kubelet/pods/4f150ff6-212c-4a60-b8ef-e8287fa11a5f/volumes"
Sep 18 14:03:57.864601 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:57.864562    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"]
Sep 18 14:03:57.865046 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:57.864935    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" containerID="cri-o://183afc6680b1e28b91476d4d859bf6662329e1832be919d6ca4c93e556283b66" gracePeriod=30
Sep 18 14:03:58.228511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.228435    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"]
Sep 18 14:03:58.229034 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.229012    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f150ff6-212c-4a60-b8ef-e8287fa11a5f" containerName="revoke-keys"
Sep 18 14:03:58.229134 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.229036    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f150ff6-212c-4a60-b8ef-e8287fa11a5f" containerName="revoke-keys"
Sep 18 14:03:58.229192 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.229167    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f150ff6-212c-4a60-b8ef-e8287fa11a5f" containerName="revoke-keys"
Sep 18 14:03:58.231851 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.231829    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:03:58.234163 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.234139    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:03:58.244036 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.244009    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"]
Sep 18 14:03:58.326335 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.326300    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2acc16fd-53ca-4c55-bced-b18ce77f8c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb\" (UID: \"2acc16fd-53ca-4c55-bced-b18ce77f8c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:03:58.428113 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.428071    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2acc16fd-53ca-4c55-bced-b18ce77f8c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb\" (UID: \"2acc16fd-53ca-4c55-bced-b18ce77f8c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:03:58.428944 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.428919    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2acc16fd-53ca-4c55-bced-b18ce77f8c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb\" (UID: \"2acc16fd-53ca-4c55-bced-b18ce77f8c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:03:58.543799 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.543708    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:03:58.820840 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.820816    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"]
Sep 18 14:03:58.822475 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:03:58.822450    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acc16fd_53ca_4c55_bced_b18ce77f8c94.slice/crio-e42594c814db27d6de9387ec52f97391fad0e92fb5886cd7bb322c122e241974 WatchSource:0}: Error finding container e42594c814db27d6de9387ec52f97391fad0e92fb5886cd7bb322c122e241974: Status 404 returned error can't find the container with id e42594c814db27d6de9387ec52f97391fad0e92fb5886cd7bb322c122e241974
Sep 18 14:03:58.977252 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:58.977214    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb" event={"ID":"2acc16fd-53ca-4c55-bced-b18ce77f8c94","Type":"ContainerStarted","Data":"e42594c814db27d6de9387ec52f97391fad0e92fb5886cd7bb322c122e241974"}
Sep 18 14:03:59.985110 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:59.985075    2585 generic.go:356] "Generic (PLEG): container finished" podID="2acc16fd-53ca-4c55-bced-b18ce77f8c94" containerID="1280757557db3ce46bd1519716cc9d00a4efdb7aba62df5c4f5030f307eb8520" exitCode=0
Sep 18 14:03:59.985622 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:03:59.985165    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb" event={"ID":"2acc16fd-53ca-4c55-bced-b18ce77f8c94","Type":"ContainerDied","Data":"1280757557db3ce46bd1519716cc9d00a4efdb7aba62df5c4f5030f307eb8520"}
Sep 18 14:04:01.134628 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:01.134599    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:04:01.261209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:01.261120    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2acc16fd-53ca-4c55-bced-b18ce77f8c94-maas-api-service-ca\") pod \"2acc16fd-53ca-4c55-bced-b18ce77f8c94\" (UID: \"2acc16fd-53ca-4c55-bced-b18ce77f8c94\") "
Sep 18 14:04:01.261480 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:01.261458    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2acc16fd-53ca-4c55-bced-b18ce77f8c94-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2acc16fd-53ca-4c55-bced-b18ce77f8c94" (UID: "2acc16fd-53ca-4c55-bced-b18ce77f8c94"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:04:01.363243 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:01.363200    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2acc16fd-53ca-4c55-bced-b18ce77f8c94-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:01.548895 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:01.548811    2585 patch_prober.go:28] interesting pod/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:04:01.548895 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:01.548876    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:04:02.007736 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:02.007695    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"
Sep 18 14:04:02.007931 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:02.007692    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb" event={"ID":"2acc16fd-53ca-4c55-bced-b18ce77f8c94","Type":"ContainerDied","Data":"e42594c814db27d6de9387ec52f97391fad0e92fb5886cd7bb322c122e241974"}
Sep 18 14:04:02.007931 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:02.007909    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e42594c814db27d6de9387ec52f97391fad0e92fb5886cd7bb322c122e241974"
Sep 18 14:04:02.398223 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:02.398126    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"]
Sep 18 14:04:03.016861 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.016825    2585 generic.go:356] "Generic (PLEG): container finished" podID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerID="183afc6680b1e28b91476d4d859bf6662329e1832be919d6ca4c93e556283b66" exitCode=0
Sep 18 14:04:03.017065 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.016893    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" event={"ID":"52c82d8e-8a00-4428-8449-f8d687bf1f87","Type":"ContainerDied","Data":"183afc6680b1e28b91476d4d859bf6662329e1832be919d6ca4c93e556283b66"}
Sep 18 14:04:03.017065 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.016959    2585 scope.go:117] "RemoveContainer" containerID="a42b6bd3b6e60b07bb18b33eb2e4bf97f57c581471ba2ca33b8f38e641cbbf8c"
Sep 18 14:04:03.131037 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.130973    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:04:03.283350 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283309    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-socket\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283369    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-envoy\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283448    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n46wf\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-kube-api-access-n46wf\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283498    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-podinfo\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283548    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-token\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283637    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-certs\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283662    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-data\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283692    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-credential-socket\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.283941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283693    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:03.283941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283906    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c82d8e-8a00-4428-8449-f8d687bf1f87-istiod-ca-cert\") pod \"52c82d8e-8a00-4428-8449-f8d687bf1f87\" (UID: \"52c82d8e-8a00-4428-8449-f8d687bf1f87\") "
Sep 18 14:04:03.284209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.283990    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:03.284209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284052    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-data" (OuterVolumeSpecName: "istio-data") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:03.284316 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284268    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:03.284445 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284397    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c82d8e-8a00-4428-8449-f8d687bf1f87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:04:03.284518 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284411    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.284518 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284464    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.284518 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284478    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.284518 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.284494    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.286002 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.285969    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:04:03.286615 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.286580    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:03.286615 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.286596    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-kube-api-access-n46wf" (OuterVolumeSpecName: "kube-api-access-n46wf") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "kube-api-access-n46wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:04:03.286736 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.286596    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-token" (OuterVolumeSpecName: "istio-token") pod "52c82d8e-8a00-4428-8449-f8d687bf1f87" (UID: "52c82d8e-8a00-4428-8449-f8d687bf1f87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:04:03.385596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.385511    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c82d8e-8a00-4428-8449-f8d687bf1f87-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.385596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.385543    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.385596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.385552    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n46wf\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-kube-api-access-n46wf\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.385596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.385564    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:03.385596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:03.385572    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c82d8e-8a00-4428-8449-f8d687bf1f87-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:04.024966 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:04.024933    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"
Sep 18 14:04:04.025368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:04.024972    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk" event={"ID":"52c82d8e-8a00-4428-8449-f8d687bf1f87","Type":"ContainerDied","Data":"1fdae9628c52f9a30728408a46779078614194ff3de989006bbb007e4463cd35"}
Sep 18 14:04:04.025368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:04.025032    2585 scope.go:117] "RemoveContainer" containerID="183afc6680b1e28b91476d4d859bf6662329e1832be919d6ca4c93e556283b66"
Sep 18 14:04:04.042970 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:04.042945    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"]
Sep 18 14:04:04.046785 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:04.046764    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk"]
Sep 18 14:04:05.641393 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:05.641358    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" path="/var/lib/kubelet/pods/52c82d8e-8a00-4428-8449-f8d687bf1f87/volumes"
Sep 18 14:04:08.968086 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:08.968047    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"]
Sep 18 14:04:08.971966 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:08.971939    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ec85d5-j2dtb"]
Sep 18 14:04:09.642049 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:09.642012    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2acc16fd-53ca-4c55-bced-b18ce77f8c94" path="/var/lib/kubelet/pods/2acc16fd-53ca-4c55-bced-b18ce77f8c94/volumes"
Sep 18 14:04:13.289765 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.289728    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"]
Sep 18 14:04:13.290500 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290476    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy"
Sep 18 14:04:13.290640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290533    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy"
Sep 18 14:04:13.290640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290557    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy"
Sep 18 14:04:13.290640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290565    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy"
Sep 18 14:04:13.290640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290600    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2acc16fd-53ca-4c55-bced-b18ce77f8c94" containerName="revoke-keys"
Sep 18 14:04:13.290640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290609    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2acc16fd-53ca-4c55-bced-b18ce77f8c94" containerName="revoke-keys"
Sep 18 14:04:13.290885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290797    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2acc16fd-53ca-4c55-bced-b18ce77f8c94" containerName="revoke-keys"
Sep 18 14:04:13.290885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290813    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy"
Sep 18 14:04:13.290885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.290829    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c82d8e-8a00-4428-8449-f8d687bf1f87" containerName="istio-proxy"
Sep 18 14:04:13.293227 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.293206    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.296654 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.296631    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d4e72b-openshift-default-dockercfg-zkc58\""
Sep 18 14:04:13.306983 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.306959    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"]
Sep 18 14:04:13.396497 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396452    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-envoy\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396515    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-certs\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396554    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istiod-ca-cert\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396644    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z7cv\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-kube-api-access-9z7cv\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396692    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-token\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396933 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396764    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-credential-socket\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396933 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396801    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-socket\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.396933 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396850    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-podinfo\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.397095 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.396978    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-data\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.497968 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.497928    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-socket\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.497968 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.497972    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-podinfo\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-data\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498082    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-envoy\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498110    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-certs\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498143    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istiod-ca-cert\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498384 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498198    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z7cv\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-kube-api-access-9z7cv\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498384 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498234    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-token\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498384 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498294    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-credential-socket\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498382    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-socket\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498480    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-data\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.498846 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498758    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-credential-socket\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.499129 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498789    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-certs\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.499217 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.498952    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istiod-ca-cert\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.500576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.500557    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-envoy\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.500703 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.500687    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-podinfo\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.506513 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.506491    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z7cv\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-kube-api-access-9z7cv\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.506730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.506710    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-token\") pod \"e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") " pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.605981 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.605882    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:13.886079 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.886048    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"]
Sep 18 14:04:13.891325 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:04:13.891291    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a57be34_b7f6_475d_9a40_0b81fc919fb5.slice/crio-646354e9ac57f137710c74001ec0f39bed41d4fa05d948f90ec9966b1cd618a0 WatchSource:0}: Error finding container 646354e9ac57f137710c74001ec0f39bed41d4fa05d948f90ec9966b1cd618a0: Status 404 returned error can't find the container with id 646354e9ac57f137710c74001ec0f39bed41d4fa05d948f90ec9966b1cd618a0
Sep 18 14:04:13.893820 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.893780    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:13.893966 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.893870    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:13.893966 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:13.893906    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:14.100666 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:14.100621    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" event={"ID":"6a57be34-b7f6-475d-9a40-0b81fc919fb5","Type":"ContainerStarted","Data":"c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"}
Sep 18 14:04:14.100851 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:14.100682    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" event={"ID":"6a57be34-b7f6-475d-9a40-0b81fc919fb5","Type":"ContainerStarted","Data":"646354e9ac57f137710c74001ec0f39bed41d4fa05d948f90ec9966b1cd618a0"}
Sep 18 14:04:14.121601 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:14.120996    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podStartSLOduration=1.120973996 podStartE2EDuration="1.120973996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:04:14.120833338 +0000 UTC m=+1164.620590854" watchObservedRunningTime="2026-09-18 14:04:14.120973996 +0000 UTC m=+1164.620731529"
Sep 18 14:04:14.606368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:14.606210    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:14.612348 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:14.612321    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:15.106808 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:15.106776    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:15.107963 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:15.107932    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:15.680810 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:15.680770    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:04:17.418591 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.418544    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br" podUID="1606cbf0-a560-4d1c-86a8-3116ade5ee04" containerName="main" containerID="cri-o://7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f" gracePeriod=45
Sep 18 14:04:17.680350 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.680321    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:04:17.749330 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749299    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tls-certs\") pod \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") "
Sep 18 14:04:17.749330 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749335    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4m85\" (UniqueName: \"kubernetes.io/projected/1606cbf0-a560-4d1c-86a8-3116ade5ee04-kube-api-access-f4m85\") pod \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") "
Sep 18 14:04:17.749630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749394    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-home\") pod \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") "
Sep 18 14:04:17.749630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749471    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tmp-dir\") pod \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") "
Sep 18 14:04:17.749630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749503    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-model-cache\") pod \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") "
Sep 18 14:04:17.749630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749539    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-dshm\") pod \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\" (UID: \"1606cbf0-a560-4d1c-86a8-3116ade5ee04\") "
Sep 18 14:04:17.749850 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749731    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-home" (OuterVolumeSpecName: "home") pod "1606cbf0-a560-4d1c-86a8-3116ade5ee04" (UID: "1606cbf0-a560-4d1c-86a8-3116ade5ee04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:17.749850 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749768    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1606cbf0-a560-4d1c-86a8-3116ade5ee04" (UID: "1606cbf0-a560-4d1c-86a8-3116ade5ee04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:17.749966 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.749847    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-model-cache" (OuterVolumeSpecName: "model-cache") pod "1606cbf0-a560-4d1c-86a8-3116ade5ee04" (UID: "1606cbf0-a560-4d1c-86a8-3116ade5ee04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:17.750098 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.750070    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:17.750265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.750102    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:17.750265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.750195    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:17.751941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.751907    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1606cbf0-a560-4d1c-86a8-3116ade5ee04" (UID: "1606cbf0-a560-4d1c-86a8-3116ade5ee04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:04:17.751941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.751928    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-dshm" (OuterVolumeSpecName: "dshm") pod "1606cbf0-a560-4d1c-86a8-3116ade5ee04" (UID: "1606cbf0-a560-4d1c-86a8-3116ade5ee04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:17.752093 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.752014    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1606cbf0-a560-4d1c-86a8-3116ade5ee04-kube-api-access-f4m85" (OuterVolumeSpecName: "kube-api-access-f4m85") pod "1606cbf0-a560-4d1c-86a8-3116ade5ee04" (UID: "1606cbf0-a560-4d1c-86a8-3116ade5ee04"). InnerVolumeSpecName "kube-api-access-f4m85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:04:17.851493 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.851451    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1606cbf0-a560-4d1c-86a8-3116ade5ee04-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:17.851493 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.851486    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4m85\" (UniqueName: \"kubernetes.io/projected/1606cbf0-a560-4d1c-86a8-3116ade5ee04-kube-api-access-f4m85\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:17.851493 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:17.851499    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1606cbf0-a560-4d1c-86a8-3116ade5ee04-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:04:18.125619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.125531    2585 generic.go:356] "Generic (PLEG): container finished" podID="1606cbf0-a560-4d1c-86a8-3116ade5ee04" containerID="7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f" exitCode=0
Sep 18 14:04:18.125619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.125575    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"
Sep 18 14:04:18.125619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.125609    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br" event={"ID":"1606cbf0-a560-4d1c-86a8-3116ade5ee04","Type":"ContainerDied","Data":"7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f"}
Sep 18 14:04:18.125858 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.125655    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br" event={"ID":"1606cbf0-a560-4d1c-86a8-3116ade5ee04","Type":"ContainerDied","Data":"ba0e31c0612e77a9fe8ad54780dc1041c2efa094696d467a5cd5a7ce71259284"}
Sep 18 14:04:18.125858 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.125675    2585 scope.go:117] "RemoveContainer" containerID="7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f"
Sep 18 14:04:18.136245 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.136228    2585 scope.go:117] "RemoveContainer" containerID="7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f"
Sep 18 14:04:18.136545 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:04:18.136524    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f\": container with ID starting with 7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f not found: ID does not exist" containerID="7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f"
Sep 18 14:04:18.136614 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.136555    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f"} err="failed to get container status \"7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f\": rpc error: code = NotFound desc = could not find container \"7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f\": container with ID starting with 7b1c83267f4947eb6f54ff6dd617bb7316d8258f50076e207009a7c0879dc24f not found: ID does not exist"
Sep 18 14:04:18.179964 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.179934    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"]
Sep 18 14:04:18.189028 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:18.188997    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-ec85d5/explicit-model-ec85d5-kserve-58f6f49677-lb9br"]
Sep 18 14:04:19.641011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:19.640978    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1606cbf0-a560-4d1c-86a8-3116ade5ee04" path="/var/lib/kubelet/pods/1606cbf0-a560-4d1c-86a8-3116ade5ee04/volumes"
Sep 18 14:04:44.291119 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:44.291087    2585 generic.go:356] "Generic (PLEG): container finished" podID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerID="c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0" exitCode=0
Sep 18 14:04:44.291547 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:44.291129    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" event={"ID":"6a57be34-b7f6-475d-9a40-0b81fc919fb5","Type":"ContainerDied","Data":"c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"}
Sep 18 14:04:44.291622 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:44.291580    2585 scope.go:117] "RemoveContainer" containerID="c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"
Sep 18 14:04:44.292719 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:44.292689    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:44.292805 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:44.292757    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:44.292805 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:44.292790    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:45.106684 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:45.106645    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:45.301097 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:45.301059    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" event={"ID":"6a57be34-b7f6-475d-9a40-0b81fc919fb5","Type":"ContainerStarted","Data":"5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42"}
Sep 18 14:04:45.606255 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:45.606178    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:45.608153 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:45.608115    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 14:04:45.608298 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:45.608194    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 14:04:46.608405 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:46.608364    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 14:04:46.608902 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:46.608454    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 14:04:47.606940 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:47.606901    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 14:04:47.607263 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:47.607226    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 14:04:48.607397 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:48.607359    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 14:04:48.608044 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:48.608007    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 14:04:49.606403 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:49.606353    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 14:04:49.606664 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:49.606470    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 14:04:50.606626 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:50.606583    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 14:04:50.607028 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:50.606655    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 14:04:51.611837 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:51.611809    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:51.612292 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:51.612123    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:51.613126 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:51.613104    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:04:51.632351 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:51.632329    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:04:51.634636 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:51.634617    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:04:52.589687 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:52.589648    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:04:55.019946 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.019913    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"]
Sep 18 14:04:55.020887 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.020862    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1606cbf0-a560-4d1c-86a8-3116ade5ee04" containerName="main"
Sep 18 14:04:55.021055 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.021032    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1606cbf0-a560-4d1c-86a8-3116ade5ee04" containerName="main"
Sep 18 14:04:55.021208 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.021192    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1606cbf0-a560-4d1c-86a8-3116ade5ee04" containerName="main"
Sep 18 14:04:55.024275 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.024259    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.026359 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.026339    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-75dcf1\""
Sep 18 14:04:55.026468 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.026400    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-75dcf1-dockercfg-47jmd\""
Sep 18 14:04:55.035792 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.035766    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"]
Sep 18 14:04:55.045385 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.045344    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8qk\" (UniqueName: \"kubernetes.io/projected/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-kube-api-access-bf8qk\") pod \"payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.045551 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.045510    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.147505 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.147468    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8qk\" (UniqueName: \"kubernetes.io/projected/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-kube-api-access-bf8qk\") pod \"payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.147853 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.147831    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.149001 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.148973    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.160387 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.160346    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8qk\" (UniqueName: \"kubernetes.io/projected/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-kube-api-access-bf8qk\") pod \"payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.336183 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.336076    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:55.610598 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:55.610575    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"]
Sep 18 14:04:55.612251 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:04:55.612219    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bae8268_d1a3_4625_80f8_c3a4fbcfd19b.slice/crio-08869299c3b46337087d34ccd07cff894c3f76a3f0f1e2db638ac5f6cff11cec WatchSource:0}: Error finding container 08869299c3b46337087d34ccd07cff894c3f76a3f0f1e2db638ac5f6cff11cec: Status 404 returned error can't find the container with id 08869299c3b46337087d34ccd07cff894c3f76a3f0f1e2db638ac5f6cff11cec
Sep 18 14:04:56.385618 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:56.385582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5" event={"ID":"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b","Type":"ContainerStarted","Data":"84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4"}
Sep 18 14:04:56.386025 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:56.385646    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5" event={"ID":"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b","Type":"ContainerStarted","Data":"08869299c3b46337087d34ccd07cff894c3f76a3f0f1e2db638ac5f6cff11cec"}
Sep 18 14:04:56.386025 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:56.385672    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:04:56.402919 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:04:56.402868    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5" podStartSLOduration=1.402851863 podStartE2EDuration="1.402851863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:04:56.400744945 +0000 UTC m=+1206.900502460" watchObservedRunningTime="2026-09-18 14:04:56.402851863 +0000 UTC m=+1206.902609734"
Sep 18 14:05:05.362592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.362544    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"]
Sep 18 14:05:05.367636 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.367605    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.369869 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.369850    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3b3206\"/\"openshift-service-ca.crt\""
Sep 18 14:05:05.370043 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.369846    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3b3206\"/\"default-dockercfg-bf656\""
Sep 18 14:05:05.370223 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.370201    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3b3206\"/\"noten-model-3b3206-kserve-self-signed-certs\""
Sep 18 14:05:05.370337 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.370209    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3b3206\"/\"kube-root-ca.crt\""
Sep 18 14:05:05.372506 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.372478    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"]
Sep 18 14:05:05.460852 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.460818    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-model-cache\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.461073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.460890    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tmp-dir\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.461073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.460993    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-home\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.461073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.461021    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs72b\" (UniqueName: \"kubernetes.io/projected/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-kube-api-access-gs72b\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.461073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.461068    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-dshm\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.461260 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.461161    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tls-certs\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.562686 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.562640    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-dshm\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.562867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.562738    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tls-certs\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.562867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.562773    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-model-cache\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.562867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.562826    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tmp-dir\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.563044 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.562909    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-home\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.563044 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.562935    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs72b\" (UniqueName: \"kubernetes.io/projected/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-kube-api-access-gs72b\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.563226 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.563202    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-model-cache\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.563299 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.563240    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tmp-dir\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.563299 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.563257    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-home\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.565243 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.565219    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-dshm\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.565544 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.565524    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tls-certs\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.571809 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.571783    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs72b\" (UniqueName: \"kubernetes.io/projected/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-kube-api-access-gs72b\") pod \"noten-model-3b3206-kserve-5d6d59c875-t22wh\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") " pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.678288 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.678254    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:05.961574 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:05.961548    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"]
Sep 18 14:05:05.964074 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:05:05.964043    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61b0429e_38a2_473c_a4df_9a7ef8c7f3f7.slice/crio-2d1bcb1fecbaeb35a95235f14015558e2307d53404223edc99c082a0c698bfc0 WatchSource:0}: Error finding container 2d1bcb1fecbaeb35a95235f14015558e2307d53404223edc99c082a0c698bfc0: Status 404 returned error can't find the container with id 2d1bcb1fecbaeb35a95235f14015558e2307d53404223edc99c082a0c698bfc0
Sep 18 14:05:06.448587 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:06.448555    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh" event={"ID":"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7","Type":"ContainerStarted","Data":"50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216"}
Sep 18 14:05:06.448987 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:06.448595    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh" event={"ID":"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7","Type":"ContainerStarted","Data":"2d1bcb1fecbaeb35a95235f14015558e2307d53404223edc99c082a0c698bfc0"}
Sep 18 14:05:06.466175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:06.466112    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh" podStartSLOduration=1.4660946209999999 podStartE2EDuration="1.466094621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:06.463395117 +0000 UTC m=+1216.963152633" watchObservedRunningTime="2026-09-18 14:05:06.466094621 +0000 UTC m=+1216.965852199"
Sep 18 14:05:07.394271 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:07.394235    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:05:15.678884 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:15.678847    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:15.679360 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:15.678902    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:15.691713 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:15.691687    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:16.524539 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:16.524511    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:22.879564 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:22.879531    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:05:38.831351 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.831274    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"]
Sep 18 14:05:38.836149 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.836129    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:38.838447 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.838398    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-31cca2d1-dockercfg-w7r6m\""
Sep 18 14:05:38.838592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.838552    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-31cca2d1\""
Sep 18 14:05:38.845201 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.845172    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"]
Sep 18 14:05:38.853198 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.853170    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"]
Sep 18 14:05:38.856892 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.856869    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:38.868152 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.868119    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"]
Sep 18 14:05:38.925400 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.925362    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f9c413-10a9-40cf-89d3-8cff0ef76511-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:38.925400 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.925402    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836af829-1932-4456-a03d-d3c01bc9b220-plugins-config-volume\") pod \"payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") " pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:38.925749 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.925451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnc72\" (UniqueName: \"kubernetes.io/projected/a6f9c413-10a9-40cf-89d3-8cff0ef76511-kube-api-access-cnc72\") pod \"payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:38.925749 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:38.925552    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lkmq\" (UniqueName: \"kubernetes.io/projected/836af829-1932-4456-a03d-d3c01bc9b220-kube-api-access-7lkmq\") pod \"payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") " pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.027079 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.027033    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f9c413-10a9-40cf-89d3-8cff0ef76511-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:39.027079 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.027083    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836af829-1932-4456-a03d-d3c01bc9b220-plugins-config-volume\") pod \"payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") " pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.027308 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.027120    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnc72\" (UniqueName: \"kubernetes.io/projected/a6f9c413-10a9-40cf-89d3-8cff0ef76511-kube-api-access-cnc72\") pod \"payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:39.027308 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.027206    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lkmq\" (UniqueName: \"kubernetes.io/projected/836af829-1932-4456-a03d-d3c01bc9b220-kube-api-access-7lkmq\") pod \"payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") " pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.027908 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.027890    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836af829-1932-4456-a03d-d3c01bc9b220-plugins-config-volume\") pod \"payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") " pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.027951 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.027890    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f9c413-10a9-40cf-89d3-8cff0ef76511-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:39.035296 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.035266    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnc72\" (UniqueName: \"kubernetes.io/projected/a6f9c413-10a9-40cf-89d3-8cff0ef76511-kube-api-access-cnc72\") pod \"payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:39.035467 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.035268    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lkmq\" (UniqueName: \"kubernetes.io/projected/836af829-1932-4456-a03d-d3c01bc9b220-kube-api-access-7lkmq\") pod \"payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") " pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.149699 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.149599    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:39.170954 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.170920    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.429030 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.428999    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"]
Sep 18 14:05:39.430136 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:05:39.430100    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f9c413_10a9_40cf_89d3_8cff0ef76511.slice/crio-e651a0277ac7b0fdbfe5a140188fd5cc7ecc8422fd184036b1dd65bece45509f WatchSource:0}: Error finding container e651a0277ac7b0fdbfe5a140188fd5cc7ecc8422fd184036b1dd65bece45509f: Status 404 returned error can't find the container with id e651a0277ac7b0fdbfe5a140188fd5cc7ecc8422fd184036b1dd65bece45509f
Sep 18 14:05:39.461316 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.461288    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"]
Sep 18 14:05:39.471969 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:05:39.471937    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836af829_1932_4456_a03d_d3c01bc9b220.slice/crio-923fe1c7b210bbbb42671fc90bd9cbd113fe607031595c5228e4ce40d867e2cd WatchSource:0}: Error finding container 923fe1c7b210bbbb42671fc90bd9cbd113fe607031595c5228e4ce40d867e2cd: Status 404 returned error can't find the container with id 923fe1c7b210bbbb42671fc90bd9cbd113fe607031595c5228e4ce40d867e2cd
Sep 18 14:05:39.657665 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.657631    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m" event={"ID":"a6f9c413-10a9-40cf-89d3-8cff0ef76511","Type":"ContainerStarted","Data":"01cf3a7841d92ffb395fca82433d801a530e3070f6bb64b282cfc4718576e4e9"}
Sep 18 14:05:39.657880 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.657709    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:39.657880 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.657738    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m" event={"ID":"a6f9c413-10a9-40cf-89d3-8cff0ef76511","Type":"ContainerStarted","Data":"e651a0277ac7b0fdbfe5a140188fd5cc7ecc8422fd184036b1dd65bece45509f"}
Sep 18 14:05:39.659472 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.659436    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d" event={"ID":"836af829-1932-4456-a03d-d3c01bc9b220","Type":"ContainerStarted","Data":"52ccd8f36936057452719a4aabe65b279dba38e60f97aeeefe07e4b3e567f98c"}
Sep 18 14:05:39.659611 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.659499    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:39.659611 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.659521    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d" event={"ID":"836af829-1932-4456-a03d-d3c01bc9b220","Type":"ContainerStarted","Data":"923fe1c7b210bbbb42671fc90bd9cbd113fe607031595c5228e4ce40d867e2cd"}
Sep 18 14:05:39.676776 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.676667    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m" podStartSLOduration=1.676649549 podStartE2EDuration="1.676649549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:39.674824454 +0000 UTC m=+1250.174581969" watchObservedRunningTime="2026-09-18 14:05:39.676649549 +0000 UTC m=+1250.176407065"
Sep 18 14:05:39.698075 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:39.698015    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d" podStartSLOduration=1.697991474 podStartE2EDuration="1.697991474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:39.69503679 +0000 UTC m=+1250.194794306" watchObservedRunningTime="2026-09-18 14:05:39.697991474 +0000 UTC m=+1250.197748993"
Sep 18 14:05:42.092000 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:42.091954    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"]
Sep 18 14:05:50.669182 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:50.669152    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:05:50.669782 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:50.669439    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:05:51.744656 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:51.744618    2585 scope.go:117] "RemoveContainer" containerID="a4810574a7c3401e6584e3893632740cce4d646d15dbf105e877c7a0ceedbaf7"
Sep 18 14:05:51.755174 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:51.755146    2585 scope.go:117] "RemoveContainer" containerID="9bde3fb4835bc7be422e8d1f7f46ac2eb404c8c9469cdaeed2eece31212942c1"
Sep 18 14:05:52.791576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.791546    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"]
Sep 18 14:05:52.797587 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.797566    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:52.800010 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.799975    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:05:52.803613 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.803587    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"]
Sep 18 14:05:52.885729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.885695    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755d248e-746c-4904-828c-e0a663e19b93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf\" (UID: \"755d248e-746c-4904-828c-e0a663e19b93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:52.986881 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.986849    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755d248e-746c-4904-828c-e0a663e19b93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf\" (UID: \"755d248e-746c-4904-828c-e0a663e19b93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:52.987497 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:52.987480    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755d248e-746c-4904-828c-e0a663e19b93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf\" (UID: \"755d248e-746c-4904-828c-e0a663e19b93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:53.110861 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:53.110778    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:53.380264 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:53.380235    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"]
Sep 18 14:05:53.381910 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:05:53.381867    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755d248e_746c_4904_828c_e0a663e19b93.slice/crio-4bb66cfeeb799db537d82559d300101868c8954d53bad423be91fbc52b64a9f2 WatchSource:0}: Error finding container 4bb66cfeeb799db537d82559d300101868c8954d53bad423be91fbc52b64a9f2: Status 404 returned error can't find the container with id 4bb66cfeeb799db537d82559d300101868c8954d53bad423be91fbc52b64a9f2
Sep 18 14:05:53.754375 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:53.754335    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf" event={"ID":"755d248e-746c-4904-828c-e0a663e19b93","Type":"ContainerStarted","Data":"49e0be2cc20482f2de07e446f1ea56b9547b306e84b1816ff275ae9359dca6aa"}
Sep 18 14:05:53.754545 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:53.754399    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf" event={"ID":"755d248e-746c-4904-828c-e0a663e19b93","Type":"ContainerStarted","Data":"4bb66cfeeb799db537d82559d300101868c8954d53bad423be91fbc52b64a9f2"}
Sep 18 14:05:53.770077 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:53.770030    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf" podStartSLOduration=1.77001346 podStartE2EDuration="1.77001346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:53.768834285 +0000 UTC m=+1264.268591800" watchObservedRunningTime="2026-09-18 14:05:53.77001346 +0000 UTC m=+1264.269770976"
Sep 18 14:05:54.762929 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:54.762892    2585 generic.go:356] "Generic (PLEG): container finished" podID="755d248e-746c-4904-828c-e0a663e19b93" containerID="49e0be2cc20482f2de07e446f1ea56b9547b306e84b1816ff275ae9359dca6aa" exitCode=0
Sep 18 14:05:54.763305 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:54.762946    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf" event={"ID":"755d248e-746c-4904-828c-e0a663e19b93","Type":"ContainerDied","Data":"49e0be2cc20482f2de07e446f1ea56b9547b306e84b1816ff275ae9359dca6aa"}
Sep 18 14:05:55.912863 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:55.912841    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:55.980117 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:55.980086    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:05:56.022213 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:56.022135    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755d248e-746c-4904-828c-e0a663e19b93-maas-api-service-ca\") pod \"755d248e-746c-4904-828c-e0a663e19b93\" (UID: \"755d248e-746c-4904-828c-e0a663e19b93\") "
Sep 18 14:05:56.022578 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:56.022552    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755d248e-746c-4904-828c-e0a663e19b93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "755d248e-746c-4904-828c-e0a663e19b93" (UID: "755d248e-746c-4904-828c-e0a663e19b93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:05:56.124500 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:56.124469    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755d248e-746c-4904-828c-e0a663e19b93-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:56.777765 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:56.777733    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf" event={"ID":"755d248e-746c-4904-828c-e0a663e19b93","Type":"ContainerDied","Data":"4bb66cfeeb799db537d82559d300101868c8954d53bad423be91fbc52b64a9f2"}
Sep 18 14:05:56.777765 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:56.777774    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"
Sep 18 14:05:56.777987 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:56.777787    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bb66cfeeb799db537d82559d300101868c8954d53bad423be91fbc52b64a9f2"
Sep 18 14:05:57.113010 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.112924    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh" podUID="61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" containerName="main" containerID="cri-o://50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216" gracePeriod=45
Sep 18 14:05:57.380807 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.380783    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:57.437959 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.437922    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tmp-dir\") pod \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") "
Sep 18 14:05:57.438131 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.437989    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-model-cache\") pod \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") "
Sep 18 14:05:57.438131 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438093    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tls-certs\") pod \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") "
Sep 18 14:05:57.438271 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438150    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-home\") pod \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") "
Sep 18 14:05:57.438271 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438186    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs72b\" (UniqueName: \"kubernetes.io/projected/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-kube-api-access-gs72b\") pod \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") "
Sep 18 14:05:57.438271 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438220    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" (UID: "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:57.438528 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438269    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" (UID: "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:57.438528 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438304    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-dshm\") pod \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\" (UID: \"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7\") "
Sep 18 14:05:57.438528 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438510    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-home" (OuterVolumeSpecName: "home") pod "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" (UID: "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:57.438869 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438844    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:57.438975 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438873    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:57.438975 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.438890    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:57.440805 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.440779    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" (UID: "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:05:57.441018 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.440985    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-dshm" (OuterVolumeSpecName: "dshm") pod "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" (UID: "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:57.441102 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.441040    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-kube-api-access-gs72b" (OuterVolumeSpecName: "kube-api-access-gs72b") pod "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" (UID: "61b0429e-38a2-473c-a4df-9a7ef8c7f3f7"). InnerVolumeSpecName "kube-api-access-gs72b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:57.540489 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.540408    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:57.540489 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.540484    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs72b\" (UniqueName: \"kubernetes.io/projected/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-kube-api-access-gs72b\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:57.540489 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.540496    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:05:57.785361 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.785326    2585 generic.go:356] "Generic (PLEG): container finished" podID="61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" containerID="50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216" exitCode=0
Sep 18 14:05:57.785596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.785372    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh" event={"ID":"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7","Type":"ContainerDied","Data":"50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216"}
Sep 18 14:05:57.785596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.785379    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"
Sep 18 14:05:57.785596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.785443    2585 scope.go:117] "RemoveContainer" containerID="50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216"
Sep 18 14:05:57.785596 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.785430    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh" event={"ID":"61b0429e-38a2-473c-a4df-9a7ef8c7f3f7","Type":"ContainerDied","Data":"2d1bcb1fecbaeb35a95235f14015558e2307d53404223edc99c082a0c698bfc0"}
Sep 18 14:05:57.795328 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.795306    2585 scope.go:117] "RemoveContainer" containerID="50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216"
Sep 18 14:05:57.795651 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:05:57.795629    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216\": container with ID starting with 50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216 not found: ID does not exist" containerID="50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216"
Sep 18 14:05:57.795738 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.795662    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216"} err="failed to get container status \"50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216\": rpc error: code = NotFound desc = could not find container \"50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216\": container with ID starting with 50169c67fb52957f472dd6753192ee676bf83398532e469c3da26b3c7fe4b216 not found: ID does not exist"
Sep 18 14:05:57.803605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.803565    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"]
Sep 18 14:05:57.806024 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:57.806003    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-3b3206/noten-model-3b3206-kserve-5d6d59c875-t22wh"]
Sep 18 14:05:59.641266 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:05:59.641234    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" path="/var/lib/kubelet/pods/61b0429e-38a2-473c-a4df-9a7ef8c7f3f7/volumes"
Sep 18 14:06:04.650046 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.650006    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"]
Sep 18 14:06:04.654803 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.654774    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-036fc2-29829000-drvpr"]
Sep 18 14:06:04.687576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.687540    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"]
Sep 18 14:06:04.687914 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.687882    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj" podUID="8feb23ad-1908-49b6-95d2-2a62b3baef1c" containerName="payload-pre-processing" containerID="cri-o://c3779f5bc247452272fb3b2e583719a7d121ae25741ac11f39ab436049e83d38" gracePeriod=30
Sep 18 14:06:04.838401 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.838365    2585 generic.go:356] "Generic (PLEG): container finished" podID="8feb23ad-1908-49b6-95d2-2a62b3baef1c" containerID="c3779f5bc247452272fb3b2e583719a7d121ae25741ac11f39ab436049e83d38" exitCode=0
Sep 18 14:06:04.838593 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.838451    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj" event={"ID":"8feb23ad-1908-49b6-95d2-2a62b3baef1c","Type":"ContainerDied","Data":"c3779f5bc247452272fb3b2e583719a7d121ae25741ac11f39ab436049e83d38"}
Sep 18 14:06:04.867451 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.867402    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"]
Sep 18 14:06:04.871698 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.871672    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-036fc2-nznqf"]
Sep 18 14:06:04.964635 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:04.964608    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 14:06:05.122810 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.122778    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mkr2\" (UniqueName: \"kubernetes.io/projected/8feb23ad-1908-49b6-95d2-2a62b3baef1c-kube-api-access-2mkr2\") pod \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") "
Sep 18 14:06:05.123010 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.122902    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8feb23ad-1908-49b6-95d2-2a62b3baef1c-plugins-config-volume\") pod \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\" (UID: \"8feb23ad-1908-49b6-95d2-2a62b3baef1c\") "
Sep 18 14:06:05.123233 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.123208    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8feb23ad-1908-49b6-95d2-2a62b3baef1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8feb23ad-1908-49b6-95d2-2a62b3baef1c" (UID: "8feb23ad-1908-49b6-95d2-2a62b3baef1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:05.125354 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.125315    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8feb23ad-1908-49b6-95d2-2a62b3baef1c-kube-api-access-2mkr2" (OuterVolumeSpecName: "kube-api-access-2mkr2") pod "8feb23ad-1908-49b6-95d2-2a62b3baef1c" (UID: "8feb23ad-1908-49b6-95d2-2a62b3baef1c"). InnerVolumeSpecName "kube-api-access-2mkr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:05.224690 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.224592    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mkr2\" (UniqueName: \"kubernetes.io/projected/8feb23ad-1908-49b6-95d2-2a62b3baef1c-kube-api-access-2mkr2\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:05.224690 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.224634    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8feb23ad-1908-49b6-95d2-2a62b3baef1c-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:05.642240 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.642155    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755d248e-746c-4904-828c-e0a663e19b93" path="/var/lib/kubelet/pods/755d248e-746c-4904-828c-e0a663e19b93/volumes"
Sep 18 14:06:05.642505 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.642491    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e" path="/var/lib/kubelet/pods/a7c152d8-6a99-4ae2-971a-8b94ae4e3a5e/volumes"
Sep 18 14:06:05.846095 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.846067    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"
Sep 18 14:06:05.846526 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.846097    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj" event={"ID":"8feb23ad-1908-49b6-95d2-2a62b3baef1c","Type":"ContainerDied","Data":"4c09bc4d8030258e1bc94a5aa4cc84fbe5c40b5cea8b1d0252593e0e738a3bab"}
Sep 18 14:06:05.846526 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.846158    2585 scope.go:117] "RemoveContainer" containerID="c3779f5bc247452272fb3b2e583719a7d121ae25741ac11f39ab436049e83d38"
Sep 18 14:06:05.864198 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.864172    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"]
Sep 18 14:06:05.868678 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:05.868655    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj"]
Sep 18 14:06:07.642659 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:07.642626    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8feb23ad-1908-49b6-95d2-2a62b3baef1c" path="/var/lib/kubelet/pods/8feb23ad-1908-49b6-95d2-2a62b3baef1c/volumes"
Sep 18 14:06:10.189710 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:10.189676    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"]
Sep 18 14:06:22.483349 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:22.483314    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:06:25.211042 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.210966    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g" podUID="d18863d6-5066-44f2-9443-5f80f0f2a3b8" containerName="main" containerID="cri-o://aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c" gracePeriod=45
Sep 18 14:06:25.489528 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.489499    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:06:25.544770 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.544725    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-model-cache\") pod \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") "
Sep 18 14:06:25.544957 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.544820    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-dshm\") pod \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") "
Sep 18 14:06:25.544957 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.544857    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tmp-dir\") pod \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") "
Sep 18 14:06:25.544957 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.544898    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tls-certs\") pod \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") "
Sep 18 14:06:25.545105 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.544977    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vr28\" (UniqueName: \"kubernetes.io/projected/d18863d6-5066-44f2-9443-5f80f0f2a3b8-kube-api-access-7vr28\") pod \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") "
Sep 18 14:06:25.545105 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545048    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-home\") pod \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\" (UID: \"d18863d6-5066-44f2-9443-5f80f0f2a3b8\") "
Sep 18 14:06:25.545193 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545119    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-model-cache" (OuterVolumeSpecName: "model-cache") pod "d18863d6-5066-44f2-9443-5f80f0f2a3b8" (UID: "d18863d6-5066-44f2-9443-5f80f0f2a3b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:25.545193 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545134    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d18863d6-5066-44f2-9443-5f80f0f2a3b8" (UID: "d18863d6-5066-44f2-9443-5f80f0f2a3b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:25.545439 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545363    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-home" (OuterVolumeSpecName: "home") pod "d18863d6-5066-44f2-9443-5f80f0f2a3b8" (UID: "d18863d6-5066-44f2-9443-5f80f0f2a3b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:25.545552 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545529    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:25.545552 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545548    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:25.545660 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.545561    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:25.547465 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.547429    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-dshm" (OuterVolumeSpecName: "dshm") pod "d18863d6-5066-44f2-9443-5f80f0f2a3b8" (UID: "d18863d6-5066-44f2-9443-5f80f0f2a3b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:25.547568 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.547545    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18863d6-5066-44f2-9443-5f80f0f2a3b8-kube-api-access-7vr28" (OuterVolumeSpecName: "kube-api-access-7vr28") pod "d18863d6-5066-44f2-9443-5f80f0f2a3b8" (UID: "d18863d6-5066-44f2-9443-5f80f0f2a3b8"). InnerVolumeSpecName "kube-api-access-7vr28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:25.547711 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.547690    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d18863d6-5066-44f2-9443-5f80f0f2a3b8" (UID: "d18863d6-5066-44f2-9443-5f80f0f2a3b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:06:25.646341 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.646312    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18863d6-5066-44f2-9443-5f80f0f2a3b8-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:25.646341 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.646337    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18863d6-5066-44f2-9443-5f80f0f2a3b8-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:25.646341 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.646347    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vr28\" (UniqueName: \"kubernetes.io/projected/d18863d6-5066-44f2-9443-5f80f0f2a3b8-kube-api-access-7vr28\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:25.982874 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.982841    2585 generic.go:356] "Generic (PLEG): container finished" podID="d18863d6-5066-44f2-9443-5f80f0f2a3b8" containerID="aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c" exitCode=0
Sep 18 14:06:25.983082 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.982883    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"
Sep 18 14:06:25.983082 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.982932    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g" event={"ID":"d18863d6-5066-44f2-9443-5f80f0f2a3b8","Type":"ContainerDied","Data":"aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c"}
Sep 18 14:06:25.983082 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.982972    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g" event={"ID":"d18863d6-5066-44f2-9443-5f80f0f2a3b8","Type":"ContainerDied","Data":"f5b71e933b882278f2db745146cf3bac621129b42c30ae1c6bfe84678c92075e"}
Sep 18 14:06:25.983082 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.982992    2585 scope.go:117] "RemoveContainer" containerID="aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c"
Sep 18 14:06:25.992851 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.992833    2585 scope.go:117] "RemoveContainer" containerID="aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c"
Sep 18 14:06:25.993180 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:06:25.993156    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c\": container with ID starting with aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c not found: ID does not exist" containerID="aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c"
Sep 18 14:06:25.993284 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.993188    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c"} err="failed to get container status \"aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c\": rpc error: code = NotFound desc = could not find container \"aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c\": container with ID starting with aef8bb0b669233af15bd6394a4b6d8c47d400bb533953870b54e609c2616818c not found: ID does not exist"
Sep 18 14:06:25.999839 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:25.999815    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"]
Sep 18 14:06:26.003402 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:26.003373    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-036fc2/test-model-036fc2-kserve-65c97c4dbf-7mq5g"]
Sep 18 14:06:27.641876 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:27.641841    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18863d6-5066-44f2-9443-5f80f0f2a3b8" path="/var/lib/kubelet/pods/d18863d6-5066-44f2-9443-5f80f0f2a3b8/volumes"
Sep 18 14:06:34.378234 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378190    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"]
Sep 18 14:06:34.378743 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378690    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d18863d6-5066-44f2-9443-5f80f0f2a3b8" containerName="main"
Sep 18 14:06:34.378743 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378704    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18863d6-5066-44f2-9443-5f80f0f2a3b8" containerName="main"
Sep 18 14:06:34.378743 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378717    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8feb23ad-1908-49b6-95d2-2a62b3baef1c" containerName="payload-pre-processing"
Sep 18 14:06:34.378743 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378722    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8feb23ad-1908-49b6-95d2-2a62b3baef1c" containerName="payload-pre-processing"
Sep 18 14:06:34.378743 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378737    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755d248e-746c-4904-828c-e0a663e19b93" containerName="revoke-keys"
Sep 18 14:06:34.378743 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378743    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="755d248e-746c-4904-828c-e0a663e19b93" containerName="revoke-keys"
Sep 18 14:06:34.379068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378773    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" containerName="main"
Sep 18 14:06:34.379068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378781    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" containerName="main"
Sep 18 14:06:34.379068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378884    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8feb23ad-1908-49b6-95d2-2a62b3baef1c" containerName="payload-pre-processing"
Sep 18 14:06:34.379068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378898    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d18863d6-5066-44f2-9443-5f80f0f2a3b8" containerName="main"
Sep 18 14:06:34.379068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378912    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b0429e-38a2-473c-a4df-9a7ef8c7f3f7" containerName="main"
Sep 18 14:06:34.379068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.378922    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="755d248e-746c-4904-828c-e0a663e19b93" containerName="revoke-keys"
Sep 18 14:06:34.383735 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.383714    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.385988 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.385958    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-31cca2d1\"/\"kube-root-ca.crt\""
Sep 18 14:06:34.386665 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.386639    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-31cca2d1\"/\"default-dockercfg-7s7xz\""
Sep 18 14:06:34.386797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.386780    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-31cca2d1\"/\"e2e-lifecycle-model-31cca2d1-kserve-self-signed-certs\""
Sep 18 14:06:34.387037 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.386880    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-31cca2d1\"/\"openshift-service-ca.crt\""
Sep 18 14:06:34.390622 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.390598    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"]
Sep 18 14:06:34.542340 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.542308    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-dshm\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.542558 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.542355    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adca6ac-a3d6-4896-85e7-960564b70944-tls-certs\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.542558 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.542401    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-home\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.542558 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.542518    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-tmp-dir\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.542671 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.542588    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wn7\" (UniqueName: \"kubernetes.io/projected/7adca6ac-a3d6-4896-85e7-960564b70944-kube-api-access-j4wn7\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.542671 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.542620    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-model-cache\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.643630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.643538    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-dshm\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.643630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.643589    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adca6ac-a3d6-4896-85e7-960564b70944-tls-certs\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.643630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.643624    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-home\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.643976 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.643676    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-tmp-dir\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.643976 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.643826    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wn7\" (UniqueName: \"kubernetes.io/projected/7adca6ac-a3d6-4896-85e7-960564b70944-kube-api-access-j4wn7\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.643976 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.643873    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-model-cache\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.644150 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.644021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-tmp-dir\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.644150 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.644084    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-home\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.644274 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.644245    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-model-cache\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.646094 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.646067    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-dshm\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.646285 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.646265    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adca6ac-a3d6-4896-85e7-960564b70944-tls-certs\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.652441 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.652400    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wn7\" (UniqueName: \"kubernetes.io/projected/7adca6ac-a3d6-4896-85e7-960564b70944-kube-api-access-j4wn7\") pod \"e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") " pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.696138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.696104    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:34.982681 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:34.982652    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"]
Sep 18 14:06:34.983994 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:06:34.983961    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7adca6ac_a3d6_4896_85e7_960564b70944.slice/crio-98bcb8204833047c6a6543f38f2cc3699dbc3278197364e04f79ff470d5c4d75 WatchSource:0}: Error finding container 98bcb8204833047c6a6543f38f2cc3699dbc3278197364e04f79ff470d5c4d75: Status 404 returned error can't find the container with id 98bcb8204833047c6a6543f38f2cc3699dbc3278197364e04f79ff470d5c4d75
Sep 18 14:06:35.045962 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:35.045929    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg" event={"ID":"7adca6ac-a3d6-4896-85e7-960564b70944","Type":"ContainerStarted","Data":"98bcb8204833047c6a6543f38f2cc3699dbc3278197364e04f79ff470d5c4d75"}
Sep 18 14:06:36.054147 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:36.054096    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg" event={"ID":"7adca6ac-a3d6-4896-85e7-960564b70944","Type":"ContainerStarted","Data":"461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0"}
Sep 18 14:06:36.072701 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:36.072650    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg" podStartSLOduration=2.072634052 podStartE2EDuration="2.072634052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:06:36.070482262 +0000 UTC m=+1306.570239779" watchObservedRunningTime="2026-09-18 14:06:36.072634052 +0000 UTC m=+1306.572391613"
Sep 18 14:06:44.696885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:44.696850    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:44.697247 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:44.696905    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:44.709545 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:44.709521    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:45.121841 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:45.121754    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:06:47.805687 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:47.805649    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"]
Sep 18 14:06:47.806188 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:47.805929    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" containerID="cri-o://5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb" gracePeriod=30
Sep 18 14:06:48.178300 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.178263    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"]
Sep 18 14:06:48.182055 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.182036    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:48.184181 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.184157    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:06:48.190019 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.189984    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"]
Sep 18 14:06:48.287833 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.287785    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12afdd-27444\" (UID: \"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:48.389112 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.389080    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12afdd-27444\" (UID: \"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:48.389791 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.389770    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12afdd-27444\" (UID: \"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:48.496565 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.496471    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:48.777497 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:48.777455    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"]
Sep 18 14:06:48.779457 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:06:48.779428    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2bf467_fb2e_468f_847a_10dd1e1dfbf5.slice/crio-789bd7edab424ea7e2ff2c24e9e74b132aa3a52d723bc53acdc98962cc6ff847 WatchSource:0}: Error finding container 789bd7edab424ea7e2ff2c24e9e74b132aa3a52d723bc53acdc98962cc6ff847: Status 404 returned error can't find the container with id 789bd7edab424ea7e2ff2c24e9e74b132aa3a52d723bc53acdc98962cc6ff847
Sep 18 14:06:49.138585 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:49.138548    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444" event={"ID":"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5","Type":"ContainerStarted","Data":"464ecb7120aa6d5c511af7f94b49dfd34dddc07379a246789db25b9e0ffbe457"}
Sep 18 14:06:49.139029 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:49.138616    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444" event={"ID":"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5","Type":"ContainerStarted","Data":"789bd7edab424ea7e2ff2c24e9e74b132aa3a52d723bc53acdc98962cc6ff847"}
Sep 18 14:06:49.160382 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:49.160325    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444" podStartSLOduration=1.160307365 podStartE2EDuration="1.160307365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:06:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:06:49.157964614 +0000 UTC m=+1319.657722129" watchObservedRunningTime="2026-09-18 14:06:49.160307365 +0000 UTC m=+1319.660064944"
Sep 18 14:06:50.025857 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:50.025821    2585 patch_prober.go:28] interesting pod/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:06:50.026052 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:50.025881    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:06:50.146119 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:50.146080    2585 generic.go:356] "Generic (PLEG): container finished" podID="ea2bf467-fb2e-468f-847a-10dd1e1dfbf5" containerID="464ecb7120aa6d5c511af7f94b49dfd34dddc07379a246789db25b9e0ffbe457" exitCode=0
Sep 18 14:06:50.146513 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:50.146172    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444" event={"ID":"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5","Type":"ContainerDied","Data":"464ecb7120aa6d5c511af7f94b49dfd34dddc07379a246789db25b9e0ffbe457"}
Sep 18 14:06:51.310824 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.310788    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:51.423427 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.423390    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5-maas-api-service-ca\") pod \"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5\" (UID: \"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5\") "
Sep 18 14:06:51.423732 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.423708    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea2bf467-fb2e-468f-847a-10dd1e1dfbf5" (UID: "ea2bf467-fb2e-468f-847a-10dd1e1dfbf5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:51.423838 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.423825    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:51.788118 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.788023    2585 scope.go:117] "RemoveContainer" containerID="50990bbd55f64404e43343ecea667238fb5ab00a79d684c7d26923845cc9a9a5"
Sep 18 14:06:51.798229 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.798205    2585 scope.go:117] "RemoveContainer" containerID="b268d6cbb15a2f3dc4bb32ca5d17ff3c8f0fc6ff9d6a18d3563c0b31c42e6121"
Sep 18 14:06:51.808594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:51.808570    2585 scope.go:117] "RemoveContainer" containerID="9fc7b671524bec5f21e04defc78a3af696e7a42b077d36ddd11fe4f2ea3c3ef8"
Sep 18 14:06:52.167016 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:52.166920    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444" event={"ID":"ea2bf467-fb2e-468f-847a-10dd1e1dfbf5","Type":"ContainerDied","Data":"789bd7edab424ea7e2ff2c24e9e74b132aa3a52d723bc53acdc98962cc6ff847"}
Sep 18 14:06:52.167016 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:52.166998    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="789bd7edab424ea7e2ff2c24e9e74b132aa3a52d723bc53acdc98962cc6ff847"
Sep 18 14:06:52.167016 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:52.166942    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"
Sep 18 14:06:53.063958 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.063932    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 14:06:53.141789 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.141699    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-socket\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.141789 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.141747    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istiod-ca-cert\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.141789 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.141783    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-certs\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.141807    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-credential-socket\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.141847    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-envoy\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.141912    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-token\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142070    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng42v\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-kube-api-access-ng42v\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142110    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-podinfo\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142136    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-data\") pod \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\" (UID: \"ae04f1ad-1e26-411e-bac9-fccaf28a2888\") "
Sep 18 14:06:53.142209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142168    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:53.142209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142184    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:53.142482 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142236    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:53.142482 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142088    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:53.142595 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142514    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:53.142664 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142645    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.142729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142669    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.142729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142681    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.142729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142693    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.142729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.142705    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.144535 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.144509    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:53.144667 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.144552    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:53.144667 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.144565    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-kube-api-access-ng42v" (OuterVolumeSpecName: "kube-api-access-ng42v") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "kube-api-access-ng42v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:53.144667 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.144634    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae04f1ad-1e26-411e-bac9-fccaf28a2888" (UID: "ae04f1ad-1e26-411e-bac9-fccaf28a2888"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:06:53.175189 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.175155    2585 generic.go:356] "Generic (PLEG): container finished" podID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerID="5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb" exitCode=0
Sep 18 14:06:53.175339 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.175210    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"
Sep 18 14:06:53.175339 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.175238    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" event={"ID":"ae04f1ad-1e26-411e-bac9-fccaf28a2888","Type":"ContainerDied","Data":"5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb"}
Sep 18 14:06:53.175339 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.175296    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w" event={"ID":"ae04f1ad-1e26-411e-bac9-fccaf28a2888","Type":"ContainerDied","Data":"bdf021d0e491c3bbb9d3e88acc04f4177975dfd3987d5037555f332fca37f291"}
Sep 18 14:06:53.175339 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.175320    2585 scope.go:117] "RemoveContainer" containerID="5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb"
Sep 18 14:06:53.185314 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.185292    2585 scope.go:117] "RemoveContainer" containerID="d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"
Sep 18 14:06:53.195024 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.195003    2585 scope.go:117] "RemoveContainer" containerID="5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb"
Sep 18 14:06:53.195325 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:06:53.195307    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb\": container with ID starting with 5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb not found: ID does not exist" containerID="5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb"
Sep 18 14:06:53.195375 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.195335    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb"} err="failed to get container status \"5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb\": rpc error: code = NotFound desc = could not find container \"5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb\": container with ID starting with 5d6fac050bfb3ba9b7cdb04e6b4e3b0b676d574f723c4c2f92708ee2416fc2cb not found: ID does not exist"
Sep 18 14:06:53.195375 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.195356    2585 scope.go:117] "RemoveContainer" containerID="d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"
Sep 18 14:06:53.195660 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:06:53.195641    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4\": container with ID starting with d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4 not found: ID does not exist" containerID="d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"
Sep 18 14:06:53.195699 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.195667    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4"} err="failed to get container status \"d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4\": rpc error: code = NotFound desc = could not find container \"d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4\": container with ID starting with d58287bf09f8dd1dcd2d1d48174b273081ef5596f19643a068650b2e2de1d3b4 not found: ID does not exist"
Sep 18 14:06:53.196816 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.196795    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"]
Sep 18 14:06:53.200791 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.200769    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w"]
Sep 18 14:06:53.243921 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.243888    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng42v\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-kube-api-access-ng42v\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.243921 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.243916    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.243921 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.243926    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.244108 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.243934    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae04f1ad-1e26-411e-bac9-fccaf28a2888-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:53.642096 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:53.642056    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" path="/var/lib/kubelet/pods/ae04f1ad-1e26-411e-bac9-fccaf28a2888/volumes"
Sep 18 14:06:58.756913 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:58.756874    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"]
Sep 18 14:06:58.757358 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:58.757092    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d" podUID="90c951db-3a3e-48a4-84c1-45c0d9404eeb" containerName="payload-processing" containerID="cri-o://2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8" gracePeriod=30
Sep 18 14:06:58.979228 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:58.979192    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"]
Sep 18 14:06:58.981490 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:58.981464    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12afdd-27444"]
Sep 18 14:06:59.034577 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.034547    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 14:06:59.109068 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.109038    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97xmd\" (UniqueName: \"kubernetes.io/projected/90c951db-3a3e-48a4-84c1-45c0d9404eeb-kube-api-access-97xmd\") pod \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") "
Sep 18 14:06:59.109255 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.109106    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c951db-3a3e-48a4-84c1-45c0d9404eeb-plugins-config-volume\") pod \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\" (UID: \"90c951db-3a3e-48a4-84c1-45c0d9404eeb\") "
Sep 18 14:06:59.109527 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.109494    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c951db-3a3e-48a4-84c1-45c0d9404eeb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90c951db-3a3e-48a4-84c1-45c0d9404eeb" (UID: "90c951db-3a3e-48a4-84c1-45c0d9404eeb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:59.111340 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.111315    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c951db-3a3e-48a4-84c1-45c0d9404eeb-kube-api-access-97xmd" (OuterVolumeSpecName: "kube-api-access-97xmd") pod "90c951db-3a3e-48a4-84c1-45c0d9404eeb" (UID: "90c951db-3a3e-48a4-84c1-45c0d9404eeb"). InnerVolumeSpecName "kube-api-access-97xmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:59.210388 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.210355    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97xmd\" (UniqueName: \"kubernetes.io/projected/90c951db-3a3e-48a4-84c1-45c0d9404eeb-kube-api-access-97xmd\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.210388 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.210386    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c951db-3a3e-48a4-84c1-45c0d9404eeb-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.213980 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.213942    2585 generic.go:356] "Generic (PLEG): container finished" podID="90c951db-3a3e-48a4-84c1-45c0d9404eeb" containerID="2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8" exitCode=0
Sep 18 14:06:59.214136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.213998    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"
Sep 18 14:06:59.214136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.214033    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d" event={"ID":"90c951db-3a3e-48a4-84c1-45c0d9404eeb","Type":"ContainerDied","Data":"2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8"}
Sep 18 14:06:59.214136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.214092    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d" event={"ID":"90c951db-3a3e-48a4-84c1-45c0d9404eeb","Type":"ContainerDied","Data":"e8d5af8a08170faf512e39378805387d1d61ddca9ff32e82970fa28cc04d36fa"}
Sep 18 14:06:59.214136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.214116    2585 scope.go:117] "RemoveContainer" containerID="2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8"
Sep 18 14:06:59.223877 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.223858    2585 scope.go:117] "RemoveContainer" containerID="2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8"
Sep 18 14:06:59.227200 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:06:59.227170    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8\": container with ID starting with 2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8 not found: ID does not exist" containerID="2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8"
Sep 18 14:06:59.227323 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.227212    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8"} err="failed to get container status \"2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8\": rpc error: code = NotFound desc = could not find container \"2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8\": container with ID starting with 2dd9e5b61da36fa546597b1b533739a2595970c98b099f03243d4f040baf45b8 not found: ID does not exist"
Sep 18 14:06:59.238707 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.238675    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"]
Sep 18 14:06:59.243668 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.243645    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d"]
Sep 18 14:06:59.641823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.641783    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c951db-3a3e-48a4-84c1-45c0d9404eeb" path="/var/lib/kubelet/pods/90c951db-3a3e-48a4-84c1-45c0d9404eeb/volumes"
Sep 18 14:06:59.642153 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:06:59.642138    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea2bf467-fb2e-468f-847a-10dd1e1dfbf5" path="/var/lib/kubelet/pods/ea2bf467-fb2e-468f-847a-10dd1e1dfbf5/volumes"
Sep 18 14:07:01.075722 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:01.075681    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:07:05.497564 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:05.497485    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"]
Sep 18 14:07:05.497936 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:05.497741    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy" containerID="cri-o://649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18" gracePeriod=30
Sep 18 14:07:06.309915 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.309860    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"]
Sep 18 14:07:06.310468 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310443    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy"
Sep 18 14:07:06.310614 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310491    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy"
Sep 18 14:07:06.310614 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310534    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c951db-3a3e-48a4-84c1-45c0d9404eeb" containerName="payload-processing"
Sep 18 14:07:06.310614 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310544    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c951db-3a3e-48a4-84c1-45c0d9404eeb" containerName="payload-processing"
Sep 18 14:07:06.310614 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310596    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2bf467-fb2e-468f-847a-10dd1e1dfbf5" containerName="revoke-keys"
Sep 18 14:07:06.310614 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310604    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2bf467-fb2e-468f-847a-10dd1e1dfbf5" containerName="revoke-keys"
Sep 18 14:07:06.310864 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310743    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy"
Sep 18 14:07:06.310864 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310755    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy"
Sep 18 14:07:06.310864 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310766    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2bf467-fb2e-468f-847a-10dd1e1dfbf5" containerName="revoke-keys"
Sep 18 14:07:06.310864 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.310787    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c951db-3a3e-48a4-84c1-45c0d9404eeb" containerName="payload-processing"
Sep 18 14:07:06.319142 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.319100    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.323177 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.323152    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-d25bfb-openshift-default-dockercfg-6f8xg\""
Sep 18 14:07:06.327379 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.327353    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"]
Sep 18 14:07:06.390519 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390484    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06707cc-b680-4715-9a2b-16a7c7955070-istio-podinfo\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390701 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390547    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brtmk\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-kube-api-access-brtmk\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390701 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390625    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-envoy\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390701 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390675    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-data\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390701 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390696    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-certs\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390710    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06707cc-b680-4715-9a2b-16a7c7955070-istiod-ca-cert\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390749    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-socket\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390783    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-istio-token\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.390847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.390812    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-credential-socket\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491679 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491646    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-data\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491679 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491683    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-certs\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491701    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06707cc-b680-4715-9a2b-16a7c7955070-istiod-ca-cert\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-socket\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491769    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-istio-token\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491810    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-credential-socket\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.491906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.491898    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06707cc-b680-4715-9a2b-16a7c7955070-istio-podinfo\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492164 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492055    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-data\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492164 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492086    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brtmk\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-kube-api-access-brtmk\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492164 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492107    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-certs\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492164 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492143    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-socket\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492164 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492146    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-envoy\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492489 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492275    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-credential-socket\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.492573 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.492556    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06707cc-b680-4715-9a2b-16a7c7955070-istiod-ca-cert\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.494408 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.494388    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-envoy\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.494770 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.494749    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06707cc-b680-4715-9a2b-16a7c7955070-istio-podinfo\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.501337 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.501309    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-istio-token\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.501712 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.501554    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brtmk\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-kube-api-access-brtmk\") pod \"e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") " pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.632580 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.632492    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:06.914782 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.914750    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"]
Sep 18 14:07:06.916491 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:07:06.916460    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06707cc_b680_4715_9a2b_16a7c7955070.slice/crio-1439a3a0348505c755f3c34d09390586f1368929da6e1c7a6481641a0767e6a0 WatchSource:0}: Error finding container 1439a3a0348505c755f3c34d09390586f1368929da6e1c7a6481641a0767e6a0: Status 404 returned error can't find the container with id 1439a3a0348505c755f3c34d09390586f1368929da6e1c7a6481641a0767e6a0
Sep 18 14:07:06.919237 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.919200    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:06.919349 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.919286    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:06.919349 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:06.919314    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:07.265500 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:07.265464    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" event={"ID":"b06707cc-b680-4715-9a2b-16a7c7955070","Type":"ContainerStarted","Data":"e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"}
Sep 18 14:07:07.265801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:07.265528    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" event={"ID":"b06707cc-b680-4715-9a2b-16a7c7955070","Type":"ContainerStarted","Data":"1439a3a0348505c755f3c34d09390586f1368929da6e1c7a6481641a0767e6a0"}
Sep 18 14:07:07.286622 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:07.286564    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podStartSLOduration=1.2865476550000001 podStartE2EDuration="1.286547655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:07.284250932 +0000 UTC m=+1337.784008445" watchObservedRunningTime="2026-09-18 14:07:07.286547655 +0000 UTC m=+1337.786305171"
Sep 18 14:07:07.633208 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:07.633118    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:07.641859 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:07.641832    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:08.271653 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:08.271623    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:08.272777 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:08.272758    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:10.768171 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.768099    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 14:07:10.943285 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943247    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-token\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943285 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943288    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-socket\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943543 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943336    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea94fc1-4509-43d4-88df-986c0fef9a5f-istiod-ca-cert\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943543 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943517    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-envoy\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943634 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943548    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-certs\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943687 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943665    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwwpr\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-kube-api-access-fwwpr\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943687 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943667    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:10.943801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943702    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-podinfo\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943764    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-data\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943765    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea94fc1-4509-43d4-88df-986c0fef9a5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:07:10.943959 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943852    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-credential-socket\") pod \"eea94fc1-4509-43d4-88df-986c0fef9a5f\" (UID: \"eea94fc1-4509-43d4-88df-986c0fef9a5f\") "
Sep 18 14:07:10.943959 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.943904    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:10.944203 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944179    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:10.944301 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944257    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:10.944429 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944392    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:10.944512 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944445    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:10.944512 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944461    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:10.944512 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944473    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea94fc1-4509-43d4-88df-986c0fef9a5f-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:10.944512 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.944485    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:10.945786 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.945762    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:07:10.945884 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.945793    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:07:10.946374 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.946356    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:07:10.946464 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:10.946372    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-kube-api-access-fwwpr" (OuterVolumeSpecName: "kube-api-access-fwwpr") pod "eea94fc1-4509-43d4-88df-986c0fef9a5f" (UID: "eea94fc1-4509-43d4-88df-986c0fef9a5f"). InnerVolumeSpecName "kube-api-access-fwwpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:07:11.045561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.045457    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwwpr\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-kube-api-access-fwwpr\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:11.045561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.045494    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:11.045561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.045506    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:11.045561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.045517    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea94fc1-4509-43d4-88df-986c0fef9a5f-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:11.293870 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.293836    2585 generic.go:356] "Generic (PLEG): container finished" podID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerID="649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18" exitCode=0
Sep 18 14:07:11.294081 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.293882    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"
Sep 18 14:07:11.294081 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.293923    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" event={"ID":"eea94fc1-4509-43d4-88df-986c0fef9a5f","Type":"ContainerDied","Data":"649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18"}
Sep 18 14:07:11.294081 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.294006    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g" event={"ID":"eea94fc1-4509-43d4-88df-986c0fef9a5f","Type":"ContainerDied","Data":"5b36e8c4e6a2fa637d8a052c7216930391942151951b54a47f0df1ac6ee23c1e"}
Sep 18 14:07:11.294081 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.294028    2585 scope.go:117] "RemoveContainer" containerID="649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18"
Sep 18 14:07:11.307120 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.307087    2585 scope.go:117] "RemoveContainer" containerID="50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"
Sep 18 14:07:11.316723 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.316704    2585 scope.go:117] "RemoveContainer" containerID="649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18"
Sep 18 14:07:11.317012 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:07:11.316993    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18\": container with ID starting with 649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18 not found: ID does not exist" containerID="649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18"
Sep 18 14:07:11.317070 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.317025    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18"} err="failed to get container status \"649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18\": rpc error: code = NotFound desc = could not find container \"649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18\": container with ID starting with 649af8e3b4102c2ce89efcfe3975a7cc26dae04bd3d5a80864f25763b329ad18 not found: ID does not exist"
Sep 18 14:07:11.317070 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.317043    2585 scope.go:117] "RemoveContainer" containerID="50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"
Sep 18 14:07:11.317305 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:07:11.317286    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a\": container with ID starting with 50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a not found: ID does not exist" containerID="50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"
Sep 18 14:07:11.317351 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.317313    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a"} err="failed to get container status \"50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a\": rpc error: code = NotFound desc = could not find container \"50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a\": container with ID starting with 50a1701143d819e7e08fcf658ed9f97b325d06a8b7e8b54a57999a1b2c40a19a not found: ID does not exist"
Sep 18 14:07:11.322041 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.322010    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"]
Sep 18 14:07:11.326806 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.326774    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g"]
Sep 18 14:07:11.641677 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:11.641598    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" path="/var/lib/kubelet/pods/eea94fc1-4509-43d4-88df-986c0fef9a5f/volumes"
Sep 18 14:07:14.125129 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125093    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"]
Sep 18 14:07:14.125616 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125594    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy"
Sep 18 14:07:14.125616 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125612    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy"
Sep 18 14:07:14.125815 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125630    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy"
Sep 18 14:07:14.125815 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125638    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy"
Sep 18 14:07:14.125815 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125657    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy"
Sep 18 14:07:14.125815 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125664    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae04f1ad-1e26-411e-bac9-fccaf28a2888" containerName="istio-proxy"
Sep 18 14:07:14.125815 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125791    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy"
Sep 18 14:07:14.125815 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.125805    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea94fc1-4509-43d4-88df-986c0fef9a5f" containerName="istio-proxy"
Sep 18 14:07:14.130624 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.130604    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.132851 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.132836    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-d25bfb-dockercfg-rkxc2\""
Sep 18 14:07:14.133269 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.133251    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-d25bfb\""
Sep 18 14:07:14.142430 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.142387    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"]
Sep 18 14:07:14.153285 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.153258    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"]
Sep 18 14:07:14.157803 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.157780    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.178965 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.178926    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"]
Sep 18 14:07:14.281104 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.281049    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z8kg\" (UniqueName: \"kubernetes.io/projected/21b6ce03-8591-451a-8e1e-e4d41929f189-kube-api-access-2z8kg\") pod \"payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.281104 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.281115    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdls5\" (UniqueName: \"kubernetes.io/projected/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-kube-api-access-vdls5\") pod \"payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.281385 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.281326    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.281483 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.281380    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21b6ce03-8591-451a-8e1e-e4d41929f189-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.382128 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.382009    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z8kg\" (UniqueName: \"kubernetes.io/projected/21b6ce03-8591-451a-8e1e-e4d41929f189-kube-api-access-2z8kg\") pod \"payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.382128 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.382077    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdls5\" (UniqueName: \"kubernetes.io/projected/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-kube-api-access-vdls5\") pod \"payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.382381 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.382198    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.382381 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.382224    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21b6ce03-8591-451a-8e1e-e4d41929f189-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.383202 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.383177    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.383253 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.383177    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21b6ce03-8591-451a-8e1e-e4d41929f189-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.390640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.390610    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdls5\" (UniqueName: \"kubernetes.io/projected/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-kube-api-access-vdls5\") pod \"payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.390783 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.390612    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z8kg\" (UniqueName: \"kubernetes.io/projected/21b6ce03-8591-451a-8e1e-e4d41929f189-kube-api-access-2z8kg\") pod \"payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.443646 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.443601    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:14.470947 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.470919    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:14.720877 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.720848    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"]
Sep 18 14:07:14.721638 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:07:14.721612    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2d60c3_fe6d_4c6c_95ab_bfcc90403913.slice/crio-9dcba447a9590ad450f35c23944f931ab55c75dd0d4b1f58b1cc99710964f1c9 WatchSource:0}: Error finding container 9dcba447a9590ad450f35c23944f931ab55c75dd0d4b1f58b1cc99710964f1c9: Status 404 returned error can't find the container with id 9dcba447a9590ad450f35c23944f931ab55c75dd0d4b1f58b1cc99710964f1c9
Sep 18 14:07:14.759455 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:14.757004    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"]
Sep 18 14:07:14.763083 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:07:14.763053    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b6ce03_8591_451a_8e1e_e4d41929f189.slice/crio-d924887426a9800baab946d229615d85ec31244a5cf008e2dca717ac6a906989 WatchSource:0}: Error finding container d924887426a9800baab946d229615d85ec31244a5cf008e2dca717ac6a906989: Status 404 returned error can't find the container with id d924887426a9800baab946d229615d85ec31244a5cf008e2dca717ac6a906989
Sep 18 14:07:15.322116 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.322074    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv" event={"ID":"21b6ce03-8591-451a-8e1e-e4d41929f189","Type":"ContainerStarted","Data":"40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29"}
Sep 18 14:07:15.322589 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.322149    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:15.322589 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.322174    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv" event={"ID":"21b6ce03-8591-451a-8e1e-e4d41929f189","Type":"ContainerStarted","Data":"d924887426a9800baab946d229615d85ec31244a5cf008e2dca717ac6a906989"}
Sep 18 14:07:15.327195 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.327163    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5" event={"ID":"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913","Type":"ContainerStarted","Data":"c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9"}
Sep 18 14:07:15.327353 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.327223    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5" event={"ID":"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913","Type":"ContainerStarted","Data":"9dcba447a9590ad450f35c23944f931ab55c75dd0d4b1f58b1cc99710964f1c9"}
Sep 18 14:07:15.327353 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.327252    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:15.340954 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.340910    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv" podStartSLOduration=1.340893731 podStartE2EDuration="1.340893731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:15.339628911 +0000 UTC m=+1345.839386427" watchObservedRunningTime="2026-09-18 14:07:15.340893731 +0000 UTC m=+1345.840651238"
Sep 18 14:07:15.357481 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:15.357431    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5" podStartSLOduration=1.357397342 podStartE2EDuration="1.357397342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:15.355655619 +0000 UTC m=+1345.855413146" watchObservedRunningTime="2026-09-18 14:07:15.357397342 +0000 UTC m=+1345.857154858"
Sep 18 14:07:26.335970 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:26.335940    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:07:26.336361 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:26.336098    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:07:34.593686 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:34.593645    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:07:45.519582 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:45.519498    2585 generic.go:356] "Generic (PLEG): container finished" podID="b06707cc-b680-4715-9a2b-16a7c7955070" containerID="e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f" exitCode=0
Sep 18 14:07:45.519977 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:45.519575    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" event={"ID":"b06707cc-b680-4715-9a2b-16a7c7955070","Type":"ContainerDied","Data":"e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"}
Sep 18 14:07:45.520046 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:45.520032    2585 scope.go:117] "RemoveContainer" containerID="e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"
Sep 18 14:07:45.521217 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:45.521187    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:45.521321 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:45.521271    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:45.521383 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:45.521322    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:46.528948 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:46.528913    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" event={"ID":"b06707cc-b680-4715-9a2b-16a7c7955070","Type":"ContainerStarted","Data":"25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc"}
Sep 18 14:07:46.633018 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:46.632980    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:46.633248 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:46.633225    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:46.633332 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:46.633286    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:47.633223 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:47.633188    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:47.633639 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:47.633254    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:48.634000 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:48.633951    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:48.634434 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:48.634034    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:49.556332 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.556280    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"]
Sep 18 14:07:49.561777 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.561738    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.565922 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.565893    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-d634d2\""
Sep 18 14:07:49.566405 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.565972    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-d634d2-dockercfg-fssmn\""
Sep 18 14:07:49.572555 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.572527    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"]
Sep 18 14:07:49.646890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.646852    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:49.647695 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.647663    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:49.656948 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.656914    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"]
Sep 18 14:07:49.663545 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.663517    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.664184 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.663568    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"]
Sep 18 14:07:49.762881 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.762840    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab386c1b-7c9c-40f8-9992-46a99b6af22b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.763314 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.762942    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjjrw\" (UniqueName: \"kubernetes.io/projected/ab386c1b-7c9c-40f8-9992-46a99b6af22b-kube-api-access-kjjrw\") pod \"payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.763493 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.763354    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5dlq\" (UniqueName: \"kubernetes.io/projected/74bfa6b6-6017-4d0e-b7c1-46478648966a-kube-api-access-d5dlq\") pod \"payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.763493 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.763465    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bfa6b6-6017-4d0e-b7c1-46478648966a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.864066 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.863967    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab386c1b-7c9c-40f8-9992-46a99b6af22b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.864066 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.864022    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjjrw\" (UniqueName: \"kubernetes.io/projected/ab386c1b-7c9c-40f8-9992-46a99b6af22b-kube-api-access-kjjrw\") pod \"payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.864066 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.864057    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dlq\" (UniqueName: \"kubernetes.io/projected/74bfa6b6-6017-4d0e-b7c1-46478648966a-kube-api-access-d5dlq\") pod \"payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.864318 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.864095    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bfa6b6-6017-4d0e-b7c1-46478648966a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.864760 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.864738    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab386c1b-7c9c-40f8-9992-46a99b6af22b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.864829 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.864809    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bfa6b6-6017-4d0e-b7c1-46478648966a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.872833 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.872805    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5dlq\" (UniqueName: \"kubernetes.io/projected/74bfa6b6-6017-4d0e-b7c1-46478648966a-kube-api-access-d5dlq\") pod \"payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.872970 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.872922    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjjrw\" (UniqueName: \"kubernetes.io/projected/ab386c1b-7c9c-40f8-9992-46a99b6af22b-kube-api-access-kjjrw\") pod \"payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:49.877708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.877684    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:49.977143 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:49.977109    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:50.177462 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.177403    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"]
Sep 18 14:07:50.180163 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:07:50.180130    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bfa6b6_6017_4d0e_b7c1_46478648966a.slice/crio-d30e16be3168577e5b5cc304570fa874aa676391d244ba7a502d8aebdf640e1b WatchSource:0}: Error finding container d30e16be3168577e5b5cc304570fa874aa676391d244ba7a502d8aebdf640e1b: Status 404 returned error can't find the container with id d30e16be3168577e5b5cc304570fa874aa676391d244ba7a502d8aebdf640e1b
Sep 18 14:07:50.288067 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.288031    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"]
Sep 18 14:07:50.289289 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:07:50.289261    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab386c1b_7c9c_40f8_9992_46a99b6af22b.slice/crio-9a7dbc06597c84d84159e1d813a361c197f70ff2663e57cc50e6d3ce43738210 WatchSource:0}: Error finding container 9a7dbc06597c84d84159e1d813a361c197f70ff2663e57cc50e6d3ce43738210: Status 404 returned error can't find the container with id 9a7dbc06597c84d84159e1d813a361c197f70ff2663e57cc50e6d3ce43738210
Sep 18 14:07:50.556603 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.556398    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c" event={"ID":"74bfa6b6-6017-4d0e-b7c1-46478648966a","Type":"ContainerStarted","Data":"022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97"}
Sep 18 14:07:50.556603 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.556486    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:07:50.556603 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.556513    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c" event={"ID":"74bfa6b6-6017-4d0e-b7c1-46478648966a","Type":"ContainerStarted","Data":"d30e16be3168577e5b5cc304570fa874aa676391d244ba7a502d8aebdf640e1b"}
Sep 18 14:07:50.558318 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.558289    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx" event={"ID":"ab386c1b-7c9c-40f8-9992-46a99b6af22b","Type":"ContainerStarted","Data":"f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06"}
Sep 18 14:07:50.558496 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.558346    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx" event={"ID":"ab386c1b-7c9c-40f8-9992-46a99b6af22b","Type":"ContainerStarted","Data":"9a7dbc06597c84d84159e1d813a361c197f70ff2663e57cc50e6d3ce43738210"}
Sep 18 14:07:50.558496 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.558377    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:07:50.574718 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.574662    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c" podStartSLOduration=1.574641349 podStartE2EDuration="1.574641349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:50.573343382 +0000 UTC m=+1381.073100898" watchObservedRunningTime="2026-09-18 14:07:50.574641349 +0000 UTC m=+1381.074398867"
Sep 18 14:07:50.591202 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.591140    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx" podStartSLOduration=1.591115912 podStartE2EDuration="1.591115912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:50.589635766 +0000 UTC m=+1381.089393284" watchObservedRunningTime="2026-09-18 14:07:50.591115912 +0000 UTC m=+1381.090873430"
Sep 18 14:07:50.633945 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.633895    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:50.634181 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:50.633978    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:51.639583 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:51.639547    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:51.640138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:51.640110    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:51.859630 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:51.859591    2585 scope.go:117] "RemoveContainer" containerID="ab370dd9af01f5e834bf824ed64ae88c29a426481ad2bfe43bcf37bcf62d4490"
Sep 18 14:07:51.871243 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:51.871221    2585 scope.go:117] "RemoveContainer" containerID="24483544a55dd46876aa6c28cd52efb2ad9298e6bae5c0d762e56491b88fe08f"
Sep 18 14:07:52.633773 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:52.633732    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:52.633962 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:52.633810    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:53.272574 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:53.272536    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:53.633179 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:53.633085    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 18 14:07:53.633179 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:53.633158    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 18 14:07:54.163352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.163318    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"]
Sep 18 14:07:54.167169 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.167148    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:54.169146 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.169124    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:07:54.175256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.175232    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"]
Sep 18 14:07:54.208261 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.208224    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a745d4d-db69-4403-936a-f08cfccd6716-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr\" (UID: \"2a745d4d-db69-4403-936a-f08cfccd6716\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:54.309652 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.309622    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a745d4d-db69-4403-936a-f08cfccd6716-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr\" (UID: \"2a745d4d-db69-4403-936a-f08cfccd6716\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:54.310243 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.310225    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a745d4d-db69-4403-936a-f08cfccd6716-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr\" (UID: \"2a745d4d-db69-4403-936a-f08cfccd6716\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:54.480712 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.480680    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:54.637070 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.637039    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:54.638201 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.638183    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:07:54.756239 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:54.756163    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"]
Sep 18 14:07:54.759572 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:07:54.759546    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a745d4d_db69_4403_936a_f08cfccd6716.slice/crio-ce2ad85a57997ddafdfcfb144424cb2cdaae6fdd40ba097ed11fc6957044a73a WatchSource:0}: Error finding container ce2ad85a57997ddafdfcfb144424cb2cdaae6fdd40ba097ed11fc6957044a73a: Status 404 returned error can't find the container with id ce2ad85a57997ddafdfcfb144424cb2cdaae6fdd40ba097ed11fc6957044a73a
Sep 18 14:07:55.601167 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:55.601138    2585 generic.go:356] "Generic (PLEG): container finished" podID="2a745d4d-db69-4403-936a-f08cfccd6716" containerID="81030371f07e0517f4c4d693ac4774244c01f957a72a16ef99498a2340285dc1" exitCode=0
Sep 18 14:07:55.601537 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:55.601183    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr" event={"ID":"2a745d4d-db69-4403-936a-f08cfccd6716","Type":"ContainerDied","Data":"81030371f07e0517f4c4d693ac4774244c01f957a72a16ef99498a2340285dc1"}
Sep 18 14:07:55.601537 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:55.601257    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr" event={"ID":"2a745d4d-db69-4403-936a-f08cfccd6716","Type":"ContainerStarted","Data":"ce2ad85a57997ddafdfcfb144424cb2cdaae6fdd40ba097ed11fc6957044a73a"}
Sep 18 14:07:56.760946 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:56.760912    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:56.838054 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:56.838021    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a745d4d-db69-4403-936a-f08cfccd6716-maas-api-service-ca\") pod \"2a745d4d-db69-4403-936a-f08cfccd6716\" (UID: \"2a745d4d-db69-4403-936a-f08cfccd6716\") "
Sep 18 14:07:56.838367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:56.838342    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a745d4d-db69-4403-936a-f08cfccd6716-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a745d4d-db69-4403-936a-f08cfccd6716" (UID: "2a745d4d-db69-4403-936a-f08cfccd6716"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:07:56.939926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:56.939890    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a745d4d-db69-4403-936a-f08cfccd6716-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:07:57.614391 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:57.614355    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr" event={"ID":"2a745d4d-db69-4403-936a-f08cfccd6716","Type":"ContainerDied","Data":"ce2ad85a57997ddafdfcfb144424cb2cdaae6fdd40ba097ed11fc6957044a73a"}
Sep 18 14:07:57.614586 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:57.614394    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"
Sep 18 14:07:57.614586 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:07:57.614464    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce2ad85a57997ddafdfcfb144424cb2cdaae6fdd40ba097ed11fc6957044a73a"
Sep 18 14:08:01.568026 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:01.567990    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:08:01.568551 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:01.568265    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:08:09.426256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.426212    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"]
Sep 18 14:08:09.426761 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.426540    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d" podUID="836af829-1932-4456-a03d-d3c01bc9b220" containerName="payload-processing" containerID="cri-o://52ccd8f36936057452719a4aabe65b279dba38e60f97aeeefe07e4b3e567f98c" gracePeriod=30
Sep 18 14:08:09.438455 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.437315    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"]
Sep 18 14:08:09.438455 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.437597    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m" podUID="a6f9c413-10a9-40cf-89d3-8cff0ef76511" containerName="payload-pre-processing" containerID="cri-o://01cf3a7841d92ffb395fca82433d801a530e3070f6bb64b282cfc4718576e4e9" gracePeriod=30
Sep 18 14:08:09.652527 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.652479    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"]
Sep 18 14:08:09.656470 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.656399    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31cca2d1-zs6mr"]
Sep 18 14:08:09.699122 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.699038    2585 generic.go:356] "Generic (PLEG): container finished" podID="a6f9c413-10a9-40cf-89d3-8cff0ef76511" containerID="01cf3a7841d92ffb395fca82433d801a530e3070f6bb64b282cfc4718576e4e9" exitCode=0
Sep 18 14:08:09.699273 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.699113    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m" event={"ID":"a6f9c413-10a9-40cf-89d3-8cff0ef76511","Type":"ContainerDied","Data":"01cf3a7841d92ffb395fca82433d801a530e3070f6bb64b282cfc4718576e4e9"}
Sep 18 14:08:09.700961 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.700935    2585 generic.go:356] "Generic (PLEG): container finished" podID="836af829-1932-4456-a03d-d3c01bc9b220" containerID="52ccd8f36936057452719a4aabe65b279dba38e60f97aeeefe07e4b3e567f98c" exitCode=0
Sep 18 14:08:09.701086 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.700993    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d" event={"ID":"836af829-1932-4456-a03d-d3c01bc9b220","Type":"ContainerDied","Data":"52ccd8f36936057452719a4aabe65b279dba38e60f97aeeefe07e4b3e567f98c"}
Sep 18 14:08:09.756465 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.756433    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:08:09.759757 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.759733    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:08:09.876089 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876060    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f9c413-10a9-40cf-89d3-8cff0ef76511-plugins-config-volume\") pod \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") "
Sep 18 14:08:09.876264 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876130    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lkmq\" (UniqueName: \"kubernetes.io/projected/836af829-1932-4456-a03d-d3c01bc9b220-kube-api-access-7lkmq\") pod \"836af829-1932-4456-a03d-d3c01bc9b220\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") "
Sep 18 14:08:09.876317 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876285    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836af829-1932-4456-a03d-d3c01bc9b220-plugins-config-volume\") pod \"836af829-1932-4456-a03d-d3c01bc9b220\" (UID: \"836af829-1932-4456-a03d-d3c01bc9b220\") "
Sep 18 14:08:09.876357 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876328    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnc72\" (UniqueName: \"kubernetes.io/projected/a6f9c413-10a9-40cf-89d3-8cff0ef76511-kube-api-access-cnc72\") pod \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\" (UID: \"a6f9c413-10a9-40cf-89d3-8cff0ef76511\") "
Sep 18 14:08:09.876648 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876622    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6f9c413-10a9-40cf-89d3-8cff0ef76511-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6f9c413-10a9-40cf-89d3-8cff0ef76511" (UID: "a6f9c413-10a9-40cf-89d3-8cff0ef76511"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:08:09.876769 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876659    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/836af829-1932-4456-a03d-d3c01bc9b220-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "836af829-1932-4456-a03d-d3c01bc9b220" (UID: "836af829-1932-4456-a03d-d3c01bc9b220"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:08:09.876847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876831    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836af829-1932-4456-a03d-d3c01bc9b220-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:09.876896 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.876850    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f9c413-10a9-40cf-89d3-8cff0ef76511-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:09.878459 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.878433    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836af829-1932-4456-a03d-d3c01bc9b220-kube-api-access-7lkmq" (OuterVolumeSpecName: "kube-api-access-7lkmq") pod "836af829-1932-4456-a03d-d3c01bc9b220" (UID: "836af829-1932-4456-a03d-d3c01bc9b220"). InnerVolumeSpecName "kube-api-access-7lkmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:09.878546 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.878522    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6f9c413-10a9-40cf-89d3-8cff0ef76511-kube-api-access-cnc72" (OuterVolumeSpecName: "kube-api-access-cnc72") pod "a6f9c413-10a9-40cf-89d3-8cff0ef76511" (UID: "a6f9c413-10a9-40cf-89d3-8cff0ef76511"). InnerVolumeSpecName "kube-api-access-cnc72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:09.978161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.978075    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lkmq\" (UniqueName: \"kubernetes.io/projected/836af829-1932-4456-a03d-d3c01bc9b220-kube-api-access-7lkmq\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:09.978161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:09.978102    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnc72\" (UniqueName: \"kubernetes.io/projected/a6f9c413-10a9-40cf-89d3-8cff0ef76511-kube-api-access-cnc72\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:10.708445 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.708335    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"
Sep 18 14:08:10.708445 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.708371    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m" event={"ID":"a6f9c413-10a9-40cf-89d3-8cff0ef76511","Type":"ContainerDied","Data":"e651a0277ac7b0fdbfe5a140188fd5cc7ecc8422fd184036b1dd65bece45509f"}
Sep 18 14:08:10.708981 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.708453    2585 scope.go:117] "RemoveContainer" containerID="01cf3a7841d92ffb395fca82433d801a530e3070f6bb64b282cfc4718576e4e9"
Sep 18 14:08:10.709894 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.709869    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d" event={"ID":"836af829-1932-4456-a03d-d3c01bc9b220","Type":"ContainerDied","Data":"923fe1c7b210bbbb42671fc90bd9cbd113fe607031595c5228e4ce40d867e2cd"}
Sep 18 14:08:10.709961 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.709874    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"
Sep 18 14:08:10.719388 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.719363    2585 scope.go:117] "RemoveContainer" containerID="52ccd8f36936057452719a4aabe65b279dba38e60f97aeeefe07e4b3e567f98c"
Sep 18 14:08:10.733490 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.733466    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"]
Sep 18 14:08:10.738349 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.738325    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d"]
Sep 18 14:08:10.750549 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.750528    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"]
Sep 18 14:08:10.762069 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:10.762046    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m"]
Sep 18 14:08:11.648342 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:11.648310    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a745d4d-db69-4403-936a-f08cfccd6716" path="/var/lib/kubelet/pods/2a745d4d-db69-4403-936a-f08cfccd6716/volumes"
Sep 18 14:08:11.648713 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:11.648699    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="836af829-1932-4456-a03d-d3c01bc9b220" path="/var/lib/kubelet/pods/836af829-1932-4456-a03d-d3c01bc9b220/volumes"
Sep 18 14:08:11.649023 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:11.649012    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6f9c413-10a9-40cf-89d3-8cff0ef76511" path="/var/lib/kubelet/pods/a6f9c413-10a9-40cf-89d3-8cff0ef76511/volumes"
Sep 18 14:08:12.411225 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:12.411187    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:08:17.765043 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:17.765006    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"]
Sep 18 14:08:32.785639 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:32.785552    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg" podUID="7adca6ac-a3d6-4896-85e7-960564b70944" containerName="main" containerID="cri-o://461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0" gracePeriod=45
Sep 18 14:08:33.039708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.039644    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:08:33.123526 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123490    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-dshm\") pod \"7adca6ac-a3d6-4896-85e7-960564b70944\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") "
Sep 18 14:08:33.123696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123556    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-tmp-dir\") pod \"7adca6ac-a3d6-4896-85e7-960564b70944\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") "
Sep 18 14:08:33.123696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123601    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4wn7\" (UniqueName: \"kubernetes.io/projected/7adca6ac-a3d6-4896-85e7-960564b70944-kube-api-access-j4wn7\") pod \"7adca6ac-a3d6-4896-85e7-960564b70944\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") "
Sep 18 14:08:33.123696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123675    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adca6ac-a3d6-4896-85e7-960564b70944-tls-certs\") pod \"7adca6ac-a3d6-4896-85e7-960564b70944\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") "
Sep 18 14:08:33.123813 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123701    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-home\") pod \"7adca6ac-a3d6-4896-85e7-960564b70944\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") "
Sep 18 14:08:33.123864 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123812    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-model-cache\") pod \"7adca6ac-a3d6-4896-85e7-960564b70944\" (UID: \"7adca6ac-a3d6-4896-85e7-960564b70944\") "
Sep 18 14:08:33.123864 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.123849    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7adca6ac-a3d6-4896-85e7-960564b70944" (UID: "7adca6ac-a3d6-4896-85e7-960564b70944"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:33.124141 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.124080    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-home" (OuterVolumeSpecName: "home") pod "7adca6ac-a3d6-4896-85e7-960564b70944" (UID: "7adca6ac-a3d6-4896-85e7-960564b70944"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:33.124246 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.124145    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-model-cache" (OuterVolumeSpecName: "model-cache") pod "7adca6ac-a3d6-4896-85e7-960564b70944" (UID: "7adca6ac-a3d6-4896-85e7-960564b70944"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:33.124246 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.124226    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:33.124343 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.124246    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:33.125998 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.125970    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-dshm" (OuterVolumeSpecName: "dshm") pod "7adca6ac-a3d6-4896-85e7-960564b70944" (UID: "7adca6ac-a3d6-4896-85e7-960564b70944"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:33.125998 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.125974    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7adca6ac-a3d6-4896-85e7-960564b70944-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7adca6ac-a3d6-4896-85e7-960564b70944" (UID: "7adca6ac-a3d6-4896-85e7-960564b70944"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:08:33.126124 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.126050    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7adca6ac-a3d6-4896-85e7-960564b70944-kube-api-access-j4wn7" (OuterVolumeSpecName: "kube-api-access-j4wn7") pod "7adca6ac-a3d6-4896-85e7-960564b70944" (UID: "7adca6ac-a3d6-4896-85e7-960564b70944"). InnerVolumeSpecName "kube-api-access-j4wn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:33.225708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.225672    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:33.225708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.225705    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adca6ac-a3d6-4896-85e7-960564b70944-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:33.225708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.225714    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4wn7\" (UniqueName: \"kubernetes.io/projected/7adca6ac-a3d6-4896-85e7-960564b70944-kube-api-access-j4wn7\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:33.225948 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.225725    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adca6ac-a3d6-4896-85e7-960564b70944-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:08:33.850702 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.850662    2585 generic.go:356] "Generic (PLEG): container finished" podID="7adca6ac-a3d6-4896-85e7-960564b70944" containerID="461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0" exitCode=0
Sep 18 14:08:33.851089 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.850715    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"
Sep 18 14:08:33.851089 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.850749    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg" event={"ID":"7adca6ac-a3d6-4896-85e7-960564b70944","Type":"ContainerDied","Data":"461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0"}
Sep 18 14:08:33.851089 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.850797    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg" event={"ID":"7adca6ac-a3d6-4896-85e7-960564b70944","Type":"ContainerDied","Data":"98bcb8204833047c6a6543f38f2cc3699dbc3278197364e04f79ff470d5c4d75"}
Sep 18 14:08:33.851089 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.850817    2585 scope.go:117] "RemoveContainer" containerID="461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0"
Sep 18 14:08:33.860256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.860235    2585 scope.go:117] "RemoveContainer" containerID="461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0"
Sep 18 14:08:33.860570 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:08:33.860548    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0\": container with ID starting with 461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0 not found: ID does not exist" containerID="461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0"
Sep 18 14:08:33.860654 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.860577    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0"} err="failed to get container status \"461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0\": rpc error: code = NotFound desc = could not find container \"461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0\": container with ID starting with 461b750a48a076fef2794806520eea29108b7b2cb1a5a5b5101d4b8a72d228e0 not found: ID does not exist"
Sep 18 14:08:33.868518 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.868491    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"]
Sep 18 14:08:33.870797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:33.870782    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-31cca2d1/e2e-lifecycle-model-31cca2d1-kserve-7f8d56f78c-7b4rg"]
Sep 18 14:08:35.641361 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:35.641332    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7adca6ac-a3d6-4896-85e7-960564b70944" path="/var/lib/kubelet/pods/7adca6ac-a3d6-4896-85e7-960564b70944/volumes"
Sep 18 14:08:40.481397 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:40.481362    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:08:47.281001 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.280969    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"]
Sep 18 14:08:47.281527 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281512    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a745d4d-db69-4403-936a-f08cfccd6716" containerName="revoke-keys"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281529    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a745d4d-db69-4403-936a-f08cfccd6716" containerName="revoke-keys"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281545    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6f9c413-10a9-40cf-89d3-8cff0ef76511" containerName="payload-pre-processing"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281550    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6f9c413-10a9-40cf-89d3-8cff0ef76511" containerName="payload-pre-processing"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281572    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="836af829-1932-4456-a03d-d3c01bc9b220" containerName="payload-processing"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281578    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="836af829-1932-4456-a03d-d3c01bc9b220" containerName="payload-processing"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281586    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7adca6ac-a3d6-4896-85e7-960564b70944" containerName="main"
Sep 18 14:08:47.281594 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281592    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adca6ac-a3d6-4896-85e7-960564b70944" containerName="main"
Sep 18 14:08:47.281813 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281660    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7adca6ac-a3d6-4896-85e7-960564b70944" containerName="main"
Sep 18 14:08:47.281813 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281667    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="836af829-1932-4456-a03d-d3c01bc9b220" containerName="payload-processing"
Sep 18 14:08:47.281813 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281673    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a745d4d-db69-4403-936a-f08cfccd6716" containerName="revoke-keys"
Sep 18 14:08:47.281813 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.281680    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6f9c413-10a9-40cf-89d3-8cff0ef76511" containerName="payload-pre-processing"
Sep 18 14:08:47.284075 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.284057    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.287410 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.287387    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"auth-test-model-d25bfb-kserve-self-signed-certs\""
Sep 18 14:08:47.287545 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.287439    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"kube-root-ca.crt\""
Sep 18 14:08:47.287811 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.287794    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"default-dockercfg-zxc6l\""
Sep 18 14:08:47.288199 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.288185    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"openshift-service-ca.crt\""
Sep 18 14:08:47.298474 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.298449    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"]
Sep 18 14:08:47.379044 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.379006    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-dshm\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.379044 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.379042    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-model-cache\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.379274 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.379087    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b10875-8d88-4502-93a2-540d186f28b3-tls-certs\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.379274 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.379129    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-home\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.379274 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.379190    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-tmp-dir\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.379274 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.379254    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xnfm\" (UniqueName: \"kubernetes.io/projected/39b10875-8d88-4502-93a2-540d186f28b3-kube-api-access-4xnfm\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480353 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480302    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-home\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480551 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480393    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-tmp-dir\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480551 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480494    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xnfm\" (UniqueName: \"kubernetes.io/projected/39b10875-8d88-4502-93a2-540d186f28b3-kube-api-access-4xnfm\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480658 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480556    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-dshm\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480658 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480577    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-model-cache\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480658 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480636    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b10875-8d88-4502-93a2-540d186f28b3-tls-certs\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480810 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480774    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-home\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.480810 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.480791    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-tmp-dir\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.481031 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.481010    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-model-cache\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.483045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.483022    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-dshm\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.483511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.483494    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b10875-8d88-4502-93a2-540d186f28b3-tls-certs\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.489836 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.489785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xnfm\" (UniqueName: \"kubernetes.io/projected/39b10875-8d88-4502-93a2-540d186f28b3-kube-api-access-4xnfm\") pod \"auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.594290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.594189    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:47.874222 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.874196    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"]
Sep 18 14:08:47.876653 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:08:47.876625    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b10875_8d88_4502_93a2_540d186f28b3.slice/crio-f218348bfada02acd998f2ba5941b6448d165c1cadefbf3236c6f24fd8e2b41d WatchSource:0}: Error finding container f218348bfada02acd998f2ba5941b6448d165c1cadefbf3236c6f24fd8e2b41d: Status 404 returned error can't find the container with id f218348bfada02acd998f2ba5941b6448d165c1cadefbf3236c6f24fd8e2b41d
Sep 18 14:08:47.937101 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.937067    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw" event={"ID":"39b10875-8d88-4502-93a2-540d186f28b3","Type":"ContainerStarted","Data":"f218348bfada02acd998f2ba5941b6448d165c1cadefbf3236c6f24fd8e2b41d"}
Sep 18 14:08:47.958056 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:47.958006    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw" podStartSLOduration=0.957974678 podStartE2EDuration="957.974678ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:08:47.95538497 +0000 UTC m=+1438.455142486" watchObservedRunningTime="2026-09-18 14:08:47.957974678 +0000 UTC m=+1438.457732196"
Sep 18 14:08:48.945140 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:48.945104    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw" event={"ID":"39b10875-8d88-4502-93a2-540d186f28b3","Type":"ContainerStarted","Data":"15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84"}
Sep 18 14:08:57.594855 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:57.594803    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:57.595467 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:57.594889    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:57.607787 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:57.607759    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:08:58.011893 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:08:58.011868    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:09:10.474242 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:09:10.474203    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:09:51.691556 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:09:51.691529    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:09:51.695574 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:09:51.695549    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:09:51.968974 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:09:51.968895    2585 scope.go:117] "RemoveContainer" containerID="72aa87774a1d026672f89d2bbcfed8ec32c4c0e9a7c7da2fde7f3d1640979156"
Sep 18 14:09:54.279136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:09:54.279098    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:10:24.288159 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:24.288081    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:10:33.486981 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.486934    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"]
Sep 18 14:10:33.490872 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.490851    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.492997 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.492974    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"kube-root-ca.crt\""
Sep 18 14:10:33.493115 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.492974    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"openshift-service-ca.crt\""
Sep 18 14:10:33.493361 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.493344    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"default-dockercfg-hzkhc\""
Sep 18 14:10:33.493435 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.493385    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"distinct-2-w4-a02b2c-kserve-self-signed-certs\""
Sep 18 14:10:33.498080 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.498058    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"]
Sep 18 14:10:33.607464 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.607397    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-tmp-dir\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.607645 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.607519    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm6jv\" (UniqueName: \"kubernetes.io/projected/d2ade38b-62aa-4756-9c0e-0671171c818c-kube-api-access-pm6jv\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.607645 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.607550    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade38b-62aa-4756-9c0e-0671171c818c-tls-certs\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.607645 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.607608    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-dshm\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.607645 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.607626    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-model-cache\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.607789 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.607680    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-home\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.708928 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.708890    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm6jv\" (UniqueName: \"kubernetes.io/projected/d2ade38b-62aa-4756-9c0e-0671171c818c-kube-api-access-pm6jv\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.709126 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709061    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade38b-62aa-4756-9c0e-0671171c818c-tls-certs\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.709301 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709274    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-dshm\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.709384 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709344    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-model-cache\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.709511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709490    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-home\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.709606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709585    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-tmp-dir\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.709851 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-home\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.710035 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.710012    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-model-cache\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.710181 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.709874    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-tmp-dir\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.711642 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.711611    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-dshm\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.711822 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.711804    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade38b-62aa-4756-9c0e-0671171c818c-tls-certs\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.725605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.725586    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm6jv\" (UniqueName: \"kubernetes.io/projected/d2ade38b-62aa-4756-9c0e-0671171c818c-kube-api-access-pm6jv\") pod \"distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:33.802264 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:33.802180    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:34.078065 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:34.078039    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"]
Sep 18 14:10:34.079760 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:10:34.079737    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2ade38b_62aa_4756_9c0e_0671171c818c.slice/crio-ddacec468d7a992cbe8b6a26fb1bb3df3e0782698e1eb2e9e3c3166734d1096c WatchSource:0}: Error finding container ddacec468d7a992cbe8b6a26fb1bb3df3e0782698e1eb2e9e3c3166734d1096c: Status 404 returned error can't find the container with id ddacec468d7a992cbe8b6a26fb1bb3df3e0782698e1eb2e9e3c3166734d1096c
Sep 18 14:10:34.588258 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:34.588218    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g" event={"ID":"d2ade38b-62aa-4756-9c0e-0671171c818c","Type":"ContainerStarted","Data":"d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99"}
Sep 18 14:10:34.588258 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:34.588273    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g" event={"ID":"d2ade38b-62aa-4756-9c0e-0671171c818c","Type":"ContainerStarted","Data":"ddacec468d7a992cbe8b6a26fb1bb3df3e0782698e1eb2e9e3c3166734d1096c"}
Sep 18 14:10:34.607313 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:34.607264    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g" podStartSLOduration=1.607246221 podStartE2EDuration="1.607246221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:34.606763279 +0000 UTC m=+1545.106520795" watchObservedRunningTime="2026-09-18 14:10:34.607246221 +0000 UTC m=+1545.107003846"
Sep 18 14:10:43.803136 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:43.803095    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:43.803563 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:43.803159    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:43.816480 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:43.816452    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:44.661305 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:44.661278    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:10:49.891723 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:49.891688    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:10:51.991930 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:51.991890    2585 scope.go:117] "RemoveContainer" containerID="1280757557db3ce46bd1519716cc9d00a4efdb7aba62df5c4f5030f307eb8520"
Sep 18 14:10:58.662911 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.662878    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"]
Sep 18 14:10:58.667919 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.667900    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.670488 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.670464    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"openshift-service-ca.crt\""
Sep 18 14:10:58.670618 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.670483    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"kube-root-ca.crt\""
Sep 18 14:10:58.670618 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.670467    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"auth-test-model-d634d2-kserve-self-signed-certs\""
Sep 18 14:10:58.670618 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.670467    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"default-dockercfg-qwgsc\""
Sep 18 14:10:58.675405 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.675383    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"]
Sep 18 14:10:58.780976 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.780944    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-dshm\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.781161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.780984    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-model-cache\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.781161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.781093    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t764\" (UniqueName: \"kubernetes.io/projected/dbfc97c0-c2a4-4469-be12-c824c427a818-kube-api-access-5t764\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.781161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.781138    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-home\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.781334 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.781198    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc97c0-c2a4-4469-be12-c824c427a818-tls-certs\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.781334 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.781226    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-tmp-dir\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882100 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882063    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc97c0-c2a4-4469-be12-c824c427a818-tls-certs\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882100 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882103    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-tmp-dir\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882355 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882180    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-dshm\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882355 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882201    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-model-cache\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882355 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882274    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t764\" (UniqueName: \"kubernetes.io/projected/dbfc97c0-c2a4-4469-be12-c824c427a818-kube-api-access-5t764\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882355 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882309    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-home\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882764 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882723    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-model-cache\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882863 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882771    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-tmp-dir\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.882863 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.882847    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-home\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.884729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.884709    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-dshm\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.884904 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.884888    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc97c0-c2a4-4469-be12-c824c427a818-tls-certs\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.892484 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.892461    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t764\" (UniqueName: \"kubernetes.io/projected/dbfc97c0-c2a4-4469-be12-c824c427a818-kube-api-access-5t764\") pod \"auth-test-model-d634d2-kserve-bcd9b6599-hb888\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:58.978001 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:58.977962    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:10:59.256790 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:59.256766    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"]
Sep 18 14:10:59.258372 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:10:59.258341    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbfc97c0_c2a4_4469_be12_c824c427a818.slice/crio-b738da13fde9073217c1a29ad3f77e19a8d2e714bb183d653db908b255be91ae WatchSource:0}: Error finding container b738da13fde9073217c1a29ad3f77e19a8d2e714bb183d653db908b255be91ae: Status 404 returned error can't find the container with id b738da13fde9073217c1a29ad3f77e19a8d2e714bb183d653db908b255be91ae
Sep 18 14:10:59.755880 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:59.755844    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888" event={"ID":"dbfc97c0-c2a4-4469-be12-c824c427a818","Type":"ContainerStarted","Data":"82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94"}
Sep 18 14:10:59.756250 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:59.755889    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888" event={"ID":"dbfc97c0-c2a4-4469-be12-c824c427a818","Type":"ContainerStarted","Data":"b738da13fde9073217c1a29ad3f77e19a8d2e714bb183d653db908b255be91ae"}
Sep 18 14:10:59.773765 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:10:59.773720    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888" podStartSLOduration=1.7737058559999999 podStartE2EDuration="1.773705856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:59.772843014 +0000 UTC m=+1570.272600531" watchObservedRunningTime="2026-09-18 14:10:59.773705856 +0000 UTC m=+1570.273463372"
Sep 18 14:11:08.979092 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:08.979056    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:11:08.979504 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:08.979105    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:11:08.991783 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:08.991759    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:11:09.825991 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:09.825962    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:11:12.335251 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.335217    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"]
Sep 18 14:11:12.339458 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.339438    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.341533 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.341505    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3c1586-openshift-default-dockercfg-2vnl8\""
Sep 18 14:11:12.357156 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.357130    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"]
Sep 18 14:11:12.435210 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.435172    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-data\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.435599 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.435575    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-certs\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.435787 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.435771    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-socket\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.435973 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.435956    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-token\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.436113 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.436097    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-credential-socket\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.436267 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.436244    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9g6\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-kube-api-access-4q9g6\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.436436 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.436284    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-envoy\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.436436 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.436313    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istiod-ca-cert\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.436436 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.436342    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-podinfo\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537773 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537732    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-data\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537801    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-certs\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537834    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-socket\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537892    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-token\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537918    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-credential-socket\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537937    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9g6\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-kube-api-access-4q9g6\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.537986 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537967    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-envoy\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538322 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.537994    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istiod-ca-cert\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538322 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.538031    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-podinfo\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538322 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.538200    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-certs\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538322 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.538245    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-socket\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538526 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.538339    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-data\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538526 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.538407    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-credential-socket\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.538825 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.538806    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istiod-ca-cert\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.540631 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.540613    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-envoy\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.540768 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.540750    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-podinfo\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.546070 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.546048    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9g6\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-kube-api-access-4q9g6\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.546200 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.546101    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-token\") pod \"e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") " pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.651199 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.651105    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:12.940755 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:11:12.940725    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d78d577_8bd1_4943_b94a_c3cc7f1f737a.slice/crio-4c608964e859293843bcaeecfb8b6d025455554433533ec5b7d2a644af7314ab WatchSource:0}: Error finding container 4c608964e859293843bcaeecfb8b6d025455554433533ec5b7d2a644af7314ab: Status 404 returned error can't find the container with id 4c608964e859293843bcaeecfb8b6d025455554433533ec5b7d2a644af7314ab
Sep 18 14:11:12.940878 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.940813    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"]
Sep 18 14:11:12.943384 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.943345    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:12.943501 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.943468    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:12.943549 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:12.943518    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:13.841307 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:13.841276    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" event={"ID":"6d78d577-8bd1-4943-b94a-c3cc7f1f737a","Type":"ContainerStarted","Data":"e7c9f7e15ee5da7b6d2c478e1c66b02b7f66e7d244862edd3fb9daeaee6e2263"}
Sep 18 14:11:13.841703 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:13.841329    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" event={"ID":"6d78d577-8bd1-4943-b94a-c3cc7f1f737a","Type":"ContainerStarted","Data":"4c608964e859293843bcaeecfb8b6d025455554433533ec5b7d2a644af7314ab"}
Sep 18 14:11:13.864757 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:13.864699    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podStartSLOduration=1.8646830699999999 podStartE2EDuration="1.86468307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:11:13.861374143 +0000 UTC m=+1584.361131659" watchObservedRunningTime="2026-09-18 14:11:13.86468307 +0000 UTC m=+1584.364440586"
Sep 18 14:11:14.651944 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:14.651911    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:14.657715 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:14.657689    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:14.847050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:14.847016    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:14.848146 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:14.848127    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:23.394736 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.394701    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"]
Sep 18 14:11:23.398697 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.398680    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.402582 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.402559    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-3c1586\""
Sep 18 14:11:23.403041 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.403023    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-3c1586-dockercfg-nnc5k\""
Sep 18 14:11:23.412349 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.412328    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"]
Sep 18 14:11:23.461161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.461130    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89qnr\" (UniqueName: \"kubernetes.io/projected/44673a76-3f64-40e6-b5ca-0178d4d19950-kube-api-access-89qnr\") pod \"payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.461161 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.461164    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44673a76-3f64-40e6-b5ca-0178d4d19950-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.562670 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.562621    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89qnr\" (UniqueName: \"kubernetes.io/projected/44673a76-3f64-40e6-b5ca-0178d4d19950-kube-api-access-89qnr\") pod \"payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.562670 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.562666    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44673a76-3f64-40e6-b5ca-0178d4d19950-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.563343 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.563324    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44673a76-3f64-40e6-b5ca-0178d4d19950-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.585884 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.585854    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89qnr\" (UniqueName: \"kubernetes.io/projected/44673a76-3f64-40e6-b5ca-0178d4d19950-kube-api-access-89qnr\") pod \"payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.710566 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.710531    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:23.988811 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:23.988780    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"]
Sep 18 14:11:23.991031 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:11:23.991002    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44673a76_3f64_40e6_b5ca_0178d4d19950.slice/crio-531eb06b812632f854e0e9a7172441f0efc23c28dd09c8a25f7eb569634e8aeb WatchSource:0}: Error finding container 531eb06b812632f854e0e9a7172441f0efc23c28dd09c8a25f7eb569634e8aeb: Status 404 returned error can't find the container with id 531eb06b812632f854e0e9a7172441f0efc23c28dd09c8a25f7eb569634e8aeb
Sep 18 14:11:24.909443 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:24.909382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq" event={"ID":"44673a76-3f64-40e6-b5ca-0178d4d19950","Type":"ContainerStarted","Data":"152772f3fa728b5f15cfe2252a9157a47ddeda6414ca060512eff749d6c044b7"}
Sep 18 14:11:24.909856 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:24.909470    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:24.909856 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:24.909493    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq" event={"ID":"44673a76-3f64-40e6-b5ca-0178d4d19950","Type":"ContainerStarted","Data":"531eb06b812632f854e0e9a7172441f0efc23c28dd09c8a25f7eb569634e8aeb"}
Sep 18 14:11:24.928267 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:24.928213    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq" podStartSLOduration=1.928197459 podStartE2EDuration="1.928197459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:11:24.925260737 +0000 UTC m=+1595.425018254" watchObservedRunningTime="2026-09-18 14:11:24.928197459 +0000 UTC m=+1595.427954976"
Sep 18 14:11:29.578491 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:29.578451    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:11:35.917381 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:35.917308    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:11:48.818314 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:48.818256    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"]
Sep 18 14:11:48.832941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:48.832888    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:48.839267 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:48.839239    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:11:48.845678 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:48.845647    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"]
Sep 18 14:11:48.942972 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:48.942937    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d9ae71-b52d-4c70-bf47-58a997db2916-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql\" (UID: \"99d9ae71-b52d-4c70-bf47-58a997db2916\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:49.043827 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:49.043790    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d9ae71-b52d-4c70-bf47-58a997db2916-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql\" (UID: \"99d9ae71-b52d-4c70-bf47-58a997db2916\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:49.044469 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:49.044399    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d9ae71-b52d-4c70-bf47-58a997db2916-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql\" (UID: \"99d9ae71-b52d-4c70-bf47-58a997db2916\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:49.147592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:49.147503    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:49.435073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:49.428391    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"]
Sep 18 14:11:50.075219 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:50.075181    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql" event={"ID":"99d9ae71-b52d-4c70-bf47-58a997db2916","Type":"ContainerStarted","Data":"dcb5a2e310f3a1098cb36c255291a4741f5ed35e6ed52b99016074923f3df70d"}
Sep 18 14:11:50.075631 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:50.075242    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql" event={"ID":"99d9ae71-b52d-4c70-bf47-58a997db2916","Type":"ContainerStarted","Data":"b4b7c2ec61a7617f6403aa47736d8b3c10ff379ec252bf967358840636a87924"}
Sep 18 14:11:50.093797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:50.093714    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql" podStartSLOduration=2.09369833 podStartE2EDuration="2.09369833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:11:50.092633472 +0000 UTC m=+1620.592390989" watchObservedRunningTime="2026-09-18 14:11:50.09369833 +0000 UTC m=+1620.593455891"
Sep 18 14:11:51.082104 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:51.082069    2585 generic.go:356] "Generic (PLEG): container finished" podID="99d9ae71-b52d-4c70-bf47-58a997db2916" containerID="dcb5a2e310f3a1098cb36c255291a4741f5ed35e6ed52b99016074923f3df70d" exitCode=0
Sep 18 14:11:51.082533 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:51.082132    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql" event={"ID":"99d9ae71-b52d-4c70-bf47-58a997db2916","Type":"ContainerDied","Data":"dcb5a2e310f3a1098cb36c255291a4741f5ed35e6ed52b99016074923f3df70d"}
Sep 18 14:11:52.299143 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:52.299111    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:52.483967 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:52.483922    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d9ae71-b52d-4c70-bf47-58a997db2916-maas-api-service-ca\") pod \"99d9ae71-b52d-4c70-bf47-58a997db2916\" (UID: \"99d9ae71-b52d-4c70-bf47-58a997db2916\") "
Sep 18 14:11:52.484253 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:52.484230    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99d9ae71-b52d-4c70-bf47-58a997db2916-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99d9ae71-b52d-4c70-bf47-58a997db2916" (UID: "99d9ae71-b52d-4c70-bf47-58a997db2916"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:11:52.484341 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:52.484326    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d9ae71-b52d-4c70-bf47-58a997db2916-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:11:53.099742 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.099713    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"
Sep 18 14:11:53.099920 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.099738    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql" event={"ID":"99d9ae71-b52d-4c70-bf47-58a997db2916","Type":"ContainerDied","Data":"b4b7c2ec61a7617f6403aa47736d8b3c10ff379ec252bf967358840636a87924"}
Sep 18 14:11:53.099920 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.099796    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4b7c2ec61a7617f6403aa47736d8b3c10ff379ec252bf967358840636a87924"
Sep 18 14:11:53.246284 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.246243    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"]
Sep 18 14:11:53.246953 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.246930    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d9ae71-b52d-4c70-bf47-58a997db2916" containerName="revoke-keys"
Sep 18 14:11:53.247073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.246955    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d9ae71-b52d-4c70-bf47-58a997db2916" containerName="revoke-keys"
Sep 18 14:11:53.247073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.247070    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d9ae71-b52d-4c70-bf47-58a997db2916" containerName="revoke-keys"
Sep 18 14:11:53.250818 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.250797    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:53.252891 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.252869    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:11:53.258400 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.258337    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"]
Sep 18 14:11:53.394955 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.394851    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18167f8-5e5f-4c26-a975-4cbf1ade17fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt\" (UID: \"b18167f8-5e5f-4c26-a975-4cbf1ade17fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:53.496600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.496555    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18167f8-5e5f-4c26-a975-4cbf1ade17fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt\" (UID: \"b18167f8-5e5f-4c26-a975-4cbf1ade17fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:53.497494 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.497465    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18167f8-5e5f-4c26-a975-4cbf1ade17fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt\" (UID: \"b18167f8-5e5f-4c26-a975-4cbf1ade17fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:53.565511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.565467    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:53.845597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:53.845566    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"]
Sep 18 14:11:53.846716 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:11:53.846688    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18167f8_5e5f_4c26_a975_4cbf1ade17fc.slice/crio-0353c93a52394e1a3a74997e044bcfeca6da8b1d031988626427b8400d534313 WatchSource:0}: Error finding container 0353c93a52394e1a3a74997e044bcfeca6da8b1d031988626427b8400d534313: Status 404 returned error can't find the container with id 0353c93a52394e1a3a74997e044bcfeca6da8b1d031988626427b8400d534313
Sep 18 14:11:54.109678 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:54.109600    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt" event={"ID":"b18167f8-5e5f-4c26-a975-4cbf1ade17fc","Type":"ContainerStarted","Data":"0353c93a52394e1a3a74997e044bcfeca6da8b1d031988626427b8400d534313"}
Sep 18 14:11:55.117866 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:55.117826    2585 generic.go:356] "Generic (PLEG): container finished" podID="b18167f8-5e5f-4c26-a975-4cbf1ade17fc" containerID="18311154b1b784db8907e6e7c537dd6a25ec5a97d8bdbb55d179d6d3682c163d" exitCode=0
Sep 18 14:11:55.118309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:55.117908    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt" event={"ID":"b18167f8-5e5f-4c26-a975-4cbf1ade17fc","Type":"ContainerDied","Data":"18311154b1b784db8907e6e7c537dd6a25ec5a97d8bdbb55d179d6d3682c163d"}
Sep 18 14:11:56.125583 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.125509    2585 generic.go:356] "Generic (PLEG): container finished" podID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerID="e7c9f7e15ee5da7b6d2c478e1c66b02b7f66e7d244862edd3fb9daeaee6e2263" exitCode=0
Sep 18 14:11:56.126005 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.125583    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" event={"ID":"6d78d577-8bd1-4943-b94a-c3cc7f1f737a","Type":"ContainerDied","Data":"e7c9f7e15ee5da7b6d2c478e1c66b02b7f66e7d244862edd3fb9daeaee6e2263"}
Sep 18 14:11:56.126374 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.126105    2585 scope.go:117] "RemoveContainer" containerID="e7c9f7e15ee5da7b6d2c478e1c66b02b7f66e7d244862edd3fb9daeaee6e2263"
Sep 18 14:11:56.127327 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.127297    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:56.127463 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.127369    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:56.127463 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.127404    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:56.277331 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.277296    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:56.328047 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.328013    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18167f8-5e5f-4c26-a975-4cbf1ade17fc-maas-api-service-ca\") pod \"b18167f8-5e5f-4c26-a975-4cbf1ade17fc\" (UID: \"b18167f8-5e5f-4c26-a975-4cbf1ade17fc\") "
Sep 18 14:11:56.328472 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.328405    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18167f8-5e5f-4c26-a975-4cbf1ade17fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b18167f8-5e5f-4c26-a975-4cbf1ade17fc" (UID: "b18167f8-5e5f-4c26-a975-4cbf1ade17fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:11:56.328606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:56.328580    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18167f8-5e5f-4c26-a975-4cbf1ade17fc-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:11:57.137293 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.137253    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" event={"ID":"6d78d577-8bd1-4943-b94a-c3cc7f1f737a","Type":"ContainerStarted","Data":"2149a704ee63c76964dd8aec534f3a3924e0b9887a0cb9a94e8277e0a2f24fe1"}
Sep 18 14:11:57.138708 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.138688    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"
Sep 18 14:11:57.138842 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.138688    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt" event={"ID":"b18167f8-5e5f-4c26-a975-4cbf1ade17fc","Type":"ContainerDied","Data":"0353c93a52394e1a3a74997e044bcfeca6da8b1d031988626427b8400d534313"}
Sep 18 14:11:57.138842 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.138817    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0353c93a52394e1a3a74997e044bcfeca6da8b1d031988626427b8400d534313"
Sep 18 14:11:57.651922 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.651887    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:11:57.653133 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.653102    2585 patch_prober.go:28] interesting pod/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:11:57.653272 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:57.653153    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:11:58.652352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:58.652310    2585 patch_prober.go:28] interesting pod/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:11:58.652832 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:58.652375    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:11:59.651697 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:59.651664    2585 patch_prober.go:28] interesting pod/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:11:59.651914 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:59.651719    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:11:59.847672 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:11:59.847635    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:12:00.651597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:00.651558    2585 patch_prober.go:28] interesting pod/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:12:00.651790 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:00.651618    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:12:01.651605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:01.651567    2585 patch_prober.go:28] interesting pod/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 18 14:12:01.651979 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:01.651633    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 18 14:12:02.656636 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:02.656605    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:12:02.657774 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:02.657755    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:12:05.977410 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:05.977373    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"]
Sep 18 14:12:05.991269 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:05.991236    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7b5a6c-hhqql"]
Sep 18 14:12:07.641782 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:07.641749    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99d9ae71-b52d-4c70-bf47-58a997db2916" path="/var/lib/kubelet/pods/99d9ae71-b52d-4c70-bf47-58a997db2916/volumes"
Sep 18 14:12:08.344353 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.344317    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"]
Sep 18 14:12:08.344559 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.344540    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br" podUID="ee2a0919-8486-4640-b037-0ca6dc73bace" containerName="payload-processing" containerID="cri-o://ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2" gracePeriod=30
Sep 18 14:12:08.356162 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.356126    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"]
Sep 18 14:12:08.356445 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.356398    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh" podUID="e0d9aaaf-cf20-4860-b178-3bc32b18f1af" containerName="payload-pre-processing" containerID="cri-o://e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47" gracePeriod=30
Sep 18 14:12:08.661510 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.661484    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 14:12:08.665274 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.665252    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 14:12:08.726901 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.726870    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"]
Sep 18 14:12:08.738704 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.738679    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-40970f-n59mt"]
Sep 18 14:12:08.767247 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.767215    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-kube-api-access-r7khx\") pod \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") "
Sep 18 14:12:08.767406 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.767299    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfwnj\" (UniqueName: \"kubernetes.io/projected/ee2a0919-8486-4640-b037-0ca6dc73bace-kube-api-access-rfwnj\") pod \"ee2a0919-8486-4640-b037-0ca6dc73bace\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") "
Sep 18 14:12:08.767546 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.767493    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-plugins-config-volume\") pod \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\" (UID: \"e0d9aaaf-cf20-4860-b178-3bc32b18f1af\") "
Sep 18 14:12:08.767647 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.767549    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee2a0919-8486-4640-b037-0ca6dc73bace-plugins-config-volume\") pod \"ee2a0919-8486-4640-b037-0ca6dc73bace\" (UID: \"ee2a0919-8486-4640-b037-0ca6dc73bace\") "
Sep 18 14:12:08.768252 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.767963    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0d9aaaf-cf20-4860-b178-3bc32b18f1af" (UID: "e0d9aaaf-cf20-4860-b178-3bc32b18f1af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:08.768252 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.768215    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:08.768451 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.768257    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2a0919-8486-4640-b037-0ca6dc73bace-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee2a0919-8486-4640-b037-0ca6dc73bace" (UID: "ee2a0919-8486-4640-b037-0ca6dc73bace"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:08.769607 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.769575    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-kube-api-access-r7khx" (OuterVolumeSpecName: "kube-api-access-r7khx") pod "e0d9aaaf-cf20-4860-b178-3bc32b18f1af" (UID: "e0d9aaaf-cf20-4860-b178-3bc32b18f1af"). InnerVolumeSpecName "kube-api-access-r7khx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:08.769718 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.769686    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee2a0919-8486-4640-b037-0ca6dc73bace-kube-api-access-rfwnj" (OuterVolumeSpecName: "kube-api-access-rfwnj") pod "ee2a0919-8486-4640-b037-0ca6dc73bace" (UID: "ee2a0919-8486-4640-b037-0ca6dc73bace"). InnerVolumeSpecName "kube-api-access-rfwnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:08.869072 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.868981    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/e0d9aaaf-cf20-4860-b178-3bc32b18f1af-kube-api-access-r7khx\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:08.869072 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.869014    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfwnj\" (UniqueName: \"kubernetes.io/projected/ee2a0919-8486-4640-b037-0ca6dc73bace-kube-api-access-rfwnj\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:08.869072 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:08.869028    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee2a0919-8486-4640-b037-0ca6dc73bace-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:09.225058 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.225022    2585 generic.go:356] "Generic (PLEG): container finished" podID="ee2a0919-8486-4640-b037-0ca6dc73bace" containerID="ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2" exitCode=0
Sep 18 14:12:09.225254 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.225079    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"
Sep 18 14:12:09.225254 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.225156    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br" event={"ID":"ee2a0919-8486-4640-b037-0ca6dc73bace","Type":"ContainerDied","Data":"ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2"}
Sep 18 14:12:09.225254 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.225245    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br" event={"ID":"ee2a0919-8486-4640-b037-0ca6dc73bace","Type":"ContainerDied","Data":"a305f17065a18e4aa5d243dcbbf9a5694c601cde83db207ff75247147d8b2595"}
Sep 18 14:12:09.225467 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.225275    2585 scope.go:117] "RemoveContainer" containerID="ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2"
Sep 18 14:12:09.226671 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.226647    2585 generic.go:356] "Generic (PLEG): container finished" podID="e0d9aaaf-cf20-4860-b178-3bc32b18f1af" containerID="e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47" exitCode=0
Sep 18 14:12:09.226773 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.226691    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"
Sep 18 14:12:09.226773 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.226718    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh" event={"ID":"e0d9aaaf-cf20-4860-b178-3bc32b18f1af","Type":"ContainerDied","Data":"e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47"}
Sep 18 14:12:09.226858 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.226778    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh" event={"ID":"e0d9aaaf-cf20-4860-b178-3bc32b18f1af","Type":"ContainerDied","Data":"528009bf9e576198499f0a1deb073df4bb859ffd15f02ace3436303f61c71fc1"}
Sep 18 14:12:09.235537 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.235519    2585 scope.go:117] "RemoveContainer" containerID="ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2"
Sep 18 14:12:09.235805 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:12:09.235785    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2\": container with ID starting with ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2 not found: ID does not exist" containerID="ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2"
Sep 18 14:12:09.235896 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.235815    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2"} err="failed to get container status \"ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2\": rpc error: code = NotFound desc = could not find container \"ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2\": container with ID starting with ede5548cf6428239f51087da7b01fff98c900f4ab2278e40a5e6001dea6bdfd2 not found: ID does not exist"
Sep 18 14:12:09.235896 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.235838    2585 scope.go:117] "RemoveContainer" containerID="e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47"
Sep 18 14:12:09.244574 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.244556    2585 scope.go:117] "RemoveContainer" containerID="e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47"
Sep 18 14:12:09.244861 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:12:09.244839    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47\": container with ID starting with e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47 not found: ID does not exist" containerID="e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47"
Sep 18 14:12:09.244940 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.244870    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47"} err="failed to get container status \"e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47\": rpc error: code = NotFound desc = could not find container \"e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47\": container with ID starting with e0ed6e4aa3946e61ee723a46b9b1119f4b83f47541216a7a60ce460c26e4ef47 not found: ID does not exist"
Sep 18 14:12:09.269715 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.269691    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"]
Sep 18 14:12:09.279453 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.279427    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br"]
Sep 18 14:12:09.294971 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.294926    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"]
Sep 18 14:12:09.297661 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.297641    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh"]
Sep 18 14:12:09.313997 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.313977    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:12:09.641538 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.641463    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18167f8-5e5f-4c26-a975-4cbf1ade17fc" path="/var/lib/kubelet/pods/b18167f8-5e5f-4c26-a975-4cbf1ade17fc/volumes"
Sep 18 14:12:09.641871 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.641857    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d9aaaf-cf20-4860-b178-3bc32b18f1af" path="/var/lib/kubelet/pods/e0d9aaaf-cf20-4860-b178-3bc32b18f1af/volumes"
Sep 18 14:12:09.642210 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:09.642196    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee2a0919-8486-4640-b037-0ca6dc73bace" path="/var/lib/kubelet/pods/ee2a0919-8486-4640-b037-0ca6dc73bace/volumes"
Sep 18 14:12:14.233497 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.233466    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"]
Sep 18 14:12:14.233990 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.233975    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee2a0919-8486-4640-b037-0ca6dc73bace" containerName="payload-processing"
Sep 18 14:12:14.234045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.233992    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee2a0919-8486-4640-b037-0ca6dc73bace" containerName="payload-processing"
Sep 18 14:12:14.234045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234015    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d9aaaf-cf20-4860-b178-3bc32b18f1af" containerName="payload-pre-processing"
Sep 18 14:12:14.234045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234021    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d9aaaf-cf20-4860-b178-3bc32b18f1af" containerName="payload-pre-processing"
Sep 18 14:12:14.234160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234046    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18167f8-5e5f-4c26-a975-4cbf1ade17fc" containerName="revoke-keys"
Sep 18 14:12:14.234160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234053    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18167f8-5e5f-4c26-a975-4cbf1ade17fc" containerName="revoke-keys"
Sep 18 14:12:14.234160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234124    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18167f8-5e5f-4c26-a975-4cbf1ade17fc" containerName="revoke-keys"
Sep 18 14:12:14.234160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234133    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee2a0919-8486-4640-b037-0ca6dc73bace" containerName="payload-processing"
Sep 18 14:12:14.234160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.234142    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d9aaaf-cf20-4860-b178-3bc32b18f1af" containerName="payload-pre-processing"
Sep 18 14:12:14.237531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.237508    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:14.239408 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.239387    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:12:14.248833 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.248808    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"]
Sep 18 14:12:14.333291 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.333243    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7576a7-c494-40c0-9645-0e2a0f529bbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9\" (UID: \"1c7576a7-c494-40c0-9645-0e2a0f529bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:14.434858 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.434820    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7576a7-c494-40c0-9645-0e2a0f529bbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9\" (UID: \"1c7576a7-c494-40c0-9645-0e2a0f529bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:14.435460 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.435407    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7576a7-c494-40c0-9645-0e2a0f529bbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9\" (UID: \"1c7576a7-c494-40c0-9645-0e2a0f529bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:14.555635 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.555555    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:14.833923 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:14.833895    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"]
Sep 18 14:12:14.836129 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:12:14.836103    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7576a7_c494_40c0_9645_0e2a0f529bbd.slice/crio-8d251b51606d247b44548c333bddfaeb9026e1c85015dbd7e21da0f5798a8c0a WatchSource:0}: Error finding container 8d251b51606d247b44548c333bddfaeb9026e1c85015dbd7e21da0f5798a8c0a: Status 404 returned error can't find the container with id 8d251b51606d247b44548c333bddfaeb9026e1c85015dbd7e21da0f5798a8c0a
Sep 18 14:12:15.270709 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:15.270672    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9" event={"ID":"1c7576a7-c494-40c0-9645-0e2a0f529bbd","Type":"ContainerStarted","Data":"f3324ceb228b9e01e685313405d913743282a7e1c587f20f41894d50df8bc2c9"}
Sep 18 14:12:15.271106 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:15.270731    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9" event={"ID":"1c7576a7-c494-40c0-9645-0e2a0f529bbd","Type":"ContainerStarted","Data":"8d251b51606d247b44548c333bddfaeb9026e1c85015dbd7e21da0f5798a8c0a"}
Sep 18 14:12:15.285748 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:15.285700    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9" podStartSLOduration=1.285683837 podStartE2EDuration="1.285683837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:12:15.284018383 +0000 UTC m=+1645.783775899" watchObservedRunningTime="2026-09-18 14:12:15.285683837 +0000 UTC m=+1645.785441353"
Sep 18 14:12:16.279863 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:16.279379    2585 generic.go:356] "Generic (PLEG): container finished" podID="1c7576a7-c494-40c0-9645-0e2a0f529bbd" containerID="f3324ceb228b9e01e685313405d913743282a7e1c587f20f41894d50df8bc2c9" exitCode=0
Sep 18 14:12:16.279863 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:16.279599    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9" event={"ID":"1c7576a7-c494-40c0-9645-0e2a0f529bbd","Type":"ContainerDied","Data":"f3324ceb228b9e01e685313405d913743282a7e1c587f20f41894d50df8bc2c9"}
Sep 18 14:12:16.414983 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:16.414951    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"]
Sep 18 14:12:16.415177 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:16.415156    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" containerID="cri-o://a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f" gracePeriod=30
Sep 18 14:12:17.435215 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:17.435191    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:17.568942 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:17.568852    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7576a7-c494-40c0-9645-0e2a0f529bbd-maas-api-service-ca\") pod \"1c7576a7-c494-40c0-9645-0e2a0f529bbd\" (UID: \"1c7576a7-c494-40c0-9645-0e2a0f529bbd\") "
Sep 18 14:12:17.569192 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:17.569170    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c7576a7-c494-40c0-9645-0e2a0f529bbd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c7576a7-c494-40c0-9645-0e2a0f529bbd" (UID: "1c7576a7-c494-40c0-9645-0e2a0f529bbd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:17.670209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:17.670177    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7576a7-c494-40c0-9645-0e2a0f529bbd-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:18.293552 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:18.293523    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"
Sep 18 14:12:18.293759 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:18.293574    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9" event={"ID":"1c7576a7-c494-40c0-9645-0e2a0f529bbd","Type":"ContainerDied","Data":"8d251b51606d247b44548c333bddfaeb9026e1c85015dbd7e21da0f5798a8c0a"}
Sep 18 14:12:18.293759 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:18.293634    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d251b51606d247b44548c333bddfaeb9026e1c85015dbd7e21da0f5798a8c0a"
Sep 18 14:12:19.878571 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:19.878532    2585 patch_prober.go:28] interesting pod/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:12:19.878948 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:19.878594    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:12:21.684175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.684112    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 14:12:21.817208 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817179    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-socket\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817396 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817218    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-envoy\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817396 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817235    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-data\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817396 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817300    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-podinfo\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817396 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817316    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istiod-ca-cert\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817396 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817336    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqc6p\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-kube-api-access-xqc6p\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817396 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817362    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-token\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817769 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817399    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-credential-socket\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817863    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-certs\") pod \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\" (UID: \"805f52e9-dbc3-4270-a673-d83a9b1a4e08\") "
Sep 18 14:12:21.817974 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817496    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:21.818045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817719    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:21.818045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817731    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:21.818045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.817738    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-data" (OuterVolumeSpecName: "istio-data") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:21.818172 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.818107    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:21.818531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.818474    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.818531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.818499    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.818531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.818514    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.818531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.818527    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.818716 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.818541    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.820234 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.820205    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:21.820319 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.820238    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-token" (OuterVolumeSpecName: "istio-token") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:21.820319 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.820256    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:12:21.820319 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.820277    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-kube-api-access-xqc6p" (OuterVolumeSpecName: "kube-api-access-xqc6p") pod "805f52e9-dbc3-4270-a673-d83a9b1a4e08" (UID: "805f52e9-dbc3-4270-a673-d83a9b1a4e08"). InnerVolumeSpecName "kube-api-access-xqc6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:21.919980 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.919948    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.919980 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.919975    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.919980 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.919985    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqc6p\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-kube-api-access-xqc6p\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:21.920193 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:21.919994    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805f52e9-dbc3-4270-a673-d83a9b1a4e08-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:22.319734 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.319700    2585 generic.go:356] "Generic (PLEG): container finished" podID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerID="a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f" exitCode=0
Sep 18 14:12:22.319885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.319755    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"
Sep 18 14:12:22.319885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.319787    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" event={"ID":"805f52e9-dbc3-4270-a673-d83a9b1a4e08","Type":"ContainerDied","Data":"a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f"}
Sep 18 14:12:22.319885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.319842    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db" event={"ID":"805f52e9-dbc3-4270-a673-d83a9b1a4e08","Type":"ContainerDied","Data":"3263a0d16cbcf05b8084af824d45c6901f000050491212708526e8457871be39"}
Sep 18 14:12:22.319885 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.319868    2585 scope.go:117] "RemoveContainer" containerID="a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f"
Sep 18 14:12:22.330310 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.330295    2585 scope.go:117] "RemoveContainer" containerID="049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"
Sep 18 14:12:22.339976 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.339957    2585 scope.go:117] "RemoveContainer" containerID="a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f"
Sep 18 14:12:22.340246 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:12:22.340230    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f\": container with ID starting with a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f not found: ID does not exist" containerID="a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f"
Sep 18 14:12:22.340294 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.340256    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f"} err="failed to get container status \"a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f\": rpc error: code = NotFound desc = could not find container \"a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f\": container with ID starting with a29288ec5ab8166842743dac76305ce27c77da192d48b7834bd931ecafc5936f not found: ID does not exist"
Sep 18 14:12:22.340294 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.340271    2585 scope.go:117] "RemoveContainer" containerID="049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"
Sep 18 14:12:22.340560 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:12:22.340543    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4\": container with ID starting with 049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4 not found: ID does not exist" containerID="049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"
Sep 18 14:12:22.340626 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.340566    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4"} err="failed to get container status \"049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4\": rpc error: code = NotFound desc = could not find container \"049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4\": container with ID starting with 049b59deb642b32ca240d277b6d19b76492bf70a8e4cbb61a888288670d30dc4 not found: ID does not exist"
Sep 18 14:12:22.340691 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.340633    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"]
Sep 18 14:12:22.344133 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:22.344108    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db"]
Sep 18 14:12:23.641531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:23.641493    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" path="/var/lib/kubelet/pods/805f52e9-dbc3-4270-a673-d83a9b1a4e08/volumes"
Sep 18 14:12:30.165788 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.165749    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"]
Sep 18 14:12:30.166224 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.166071    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq" podUID="44673a76-3f64-40e6-b5ca-0178d4d19950" containerName="payload-processing" containerID="cri-o://152772f3fa728b5f15cfe2252a9157a47ddeda6414ca060512eff749d6c044b7" gracePeriod=30
Sep 18 14:12:30.351085 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.351051    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"]
Sep 18 14:12:30.355767 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.355734    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3c1586-8nmc9"]
Sep 18 14:12:30.372348 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.372314    2585 generic.go:356] "Generic (PLEG): container finished" podID="44673a76-3f64-40e6-b5ca-0178d4d19950" containerID="152772f3fa728b5f15cfe2252a9157a47ddeda6414ca060512eff749d6c044b7" exitCode=0
Sep 18 14:12:30.372528 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.372382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq" event={"ID":"44673a76-3f64-40e6-b5ca-0178d4d19950","Type":"ContainerDied","Data":"152772f3fa728b5f15cfe2252a9157a47ddeda6414ca060512eff749d6c044b7"}
Sep 18 14:12:30.430384 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.430361    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:12:30.507935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.507905    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89qnr\" (UniqueName: \"kubernetes.io/projected/44673a76-3f64-40e6-b5ca-0178d4d19950-kube-api-access-89qnr\") pod \"44673a76-3f64-40e6-b5ca-0178d4d19950\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") "
Sep 18 14:12:30.508152 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.508104    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44673a76-3f64-40e6-b5ca-0178d4d19950-plugins-config-volume\") pod \"44673a76-3f64-40e6-b5ca-0178d4d19950\" (UID: \"44673a76-3f64-40e6-b5ca-0178d4d19950\") "
Sep 18 14:12:30.508610 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.508584    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44673a76-3f64-40e6-b5ca-0178d4d19950-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44673a76-3f64-40e6-b5ca-0178d4d19950" (UID: "44673a76-3f64-40e6-b5ca-0178d4d19950"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:30.510367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.510337    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44673a76-3f64-40e6-b5ca-0178d4d19950-kube-api-access-89qnr" (OuterVolumeSpecName: "kube-api-access-89qnr") pod "44673a76-3f64-40e6-b5ca-0178d4d19950" (UID: "44673a76-3f64-40e6-b5ca-0178d4d19950"). InnerVolumeSpecName "kube-api-access-89qnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:30.610035 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.609993    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44673a76-3f64-40e6-b5ca-0178d4d19950-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:30.610035 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:30.610033    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89qnr\" (UniqueName: \"kubernetes.io/projected/44673a76-3f64-40e6-b5ca-0178d4d19950-kube-api-access-89qnr\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:31.379858 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.379822    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq" event={"ID":"44673a76-3f64-40e6-b5ca-0178d4d19950","Type":"ContainerDied","Data":"531eb06b812632f854e0e9a7172441f0efc23c28dd09c8a25f7eb569634e8aeb"}
Sep 18 14:12:31.380331 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.379885    2585 scope.go:117] "RemoveContainer" containerID="152772f3fa728b5f15cfe2252a9157a47ddeda6414ca060512eff749d6c044b7"
Sep 18 14:12:31.380331 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.379835    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"
Sep 18 14:12:31.403470 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.403434    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"]
Sep 18 14:12:31.409929 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.409904    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq"]
Sep 18 14:12:31.642035 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.641950    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7576a7-c494-40c0-9645-0e2a0f529bbd" path="/var/lib/kubelet/pods/1c7576a7-c494-40c0-9645-0e2a0f529bbd/volumes"
Sep 18 14:12:31.642336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:31.642321    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44673a76-3f64-40e6-b5ca-0178d4d19950" path="/var/lib/kubelet/pods/44673a76-3f64-40e6-b5ca-0178d4d19950/volumes"
Sep 18 14:12:39.313452 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.313398    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"]
Sep 18 14:12:39.313893 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.313641    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy" containerID="cri-o://2149a704ee63c76964dd8aec534f3a3924e0b9887a0cb9a94e8277e0a2f24fe1" gracePeriod=30
Sep 18 14:12:39.660794 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.660708    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"]
Sep 18 14:12:39.661200 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661186    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy"
Sep 18 14:12:39.661265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661213    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy"
Sep 18 14:12:39.661265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661242    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy"
Sep 18 14:12:39.661265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661248    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy"
Sep 18 14:12:39.661265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661261    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44673a76-3f64-40e6-b5ca-0178d4d19950" containerName="payload-processing"
Sep 18 14:12:39.661265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661266    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="44673a76-3f64-40e6-b5ca-0178d4d19950" containerName="payload-processing"
Sep 18 14:12:39.661454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661276    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7576a7-c494-40c0-9645-0e2a0f529bbd" containerName="revoke-keys"
Sep 18 14:12:39.661454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661282    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7576a7-c494-40c0-9645-0e2a0f529bbd" containerName="revoke-keys"
Sep 18 14:12:39.661454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661366    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy"
Sep 18 14:12:39.661454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661374    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7576a7-c494-40c0-9645-0e2a0f529bbd" containerName="revoke-keys"
Sep 18 14:12:39.661454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.661381    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="44673a76-3f64-40e6-b5ca-0178d4d19950" containerName="payload-processing"
Sep 18 14:12:39.665869 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.665851    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:39.668059 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.668036    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:12:39.672527 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.672496    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"]
Sep 18 14:12:39.810243 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.810187    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b390c83e-50c8-469e-8266-6ca676b7fcd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl\" (UID: \"b390c83e-50c8-469e-8266-6ca676b7fcd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:39.911212 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.911114    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b390c83e-50c8-469e-8266-6ca676b7fcd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl\" (UID: \"b390c83e-50c8-469e-8266-6ca676b7fcd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:39.911816 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.911788    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b390c83e-50c8-469e-8266-6ca676b7fcd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl\" (UID: \"b390c83e-50c8-469e-8266-6ca676b7fcd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:39.979336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:39.979305    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:40.258024 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:40.255983    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"]
Sep 18 14:12:40.448159 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:40.448118    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl" event={"ID":"b390c83e-50c8-469e-8266-6ca676b7fcd6","Type":"ContainerStarted","Data":"66cb86b86c6a696af2c0286278f8c3cbe2102280019d82c5248015e91154922e"}
Sep 18 14:12:41.456273 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:41.456240    2585 generic.go:356] "Generic (PLEG): container finished" podID="b390c83e-50c8-469e-8266-6ca676b7fcd6" containerID="2a6f574043afda3c1f51602e51110dbcf9f1e5f59fc75fceea74a08b5881b43f" exitCode=0
Sep 18 14:12:41.456689 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:41.456325    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl" event={"ID":"b390c83e-50c8-469e-8266-6ca676b7fcd6","Type":"ContainerDied","Data":"2a6f574043afda3c1f51602e51110dbcf9f1e5f59fc75fceea74a08b5881b43f"}
Sep 18 14:12:42.610984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:42.610957    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:42.741925 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:42.741836    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b390c83e-50c8-469e-8266-6ca676b7fcd6-maas-api-service-ca\") pod \"b390c83e-50c8-469e-8266-6ca676b7fcd6\" (UID: \"b390c83e-50c8-469e-8266-6ca676b7fcd6\") "
Sep 18 14:12:42.742256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:42.742229    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b390c83e-50c8-469e-8266-6ca676b7fcd6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b390c83e-50c8-469e-8266-6ca676b7fcd6" (UID: "b390c83e-50c8-469e-8266-6ca676b7fcd6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:42.843370 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:42.843339    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b390c83e-50c8-469e-8266-6ca676b7fcd6-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:43.470103 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:43.470067    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl" event={"ID":"b390c83e-50c8-469e-8266-6ca676b7fcd6","Type":"ContainerDied","Data":"66cb86b86c6a696af2c0286278f8c3cbe2102280019d82c5248015e91154922e"}
Sep 18 14:12:43.470258 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:43.470117    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66cb86b86c6a696af2c0286278f8c3cbe2102280019d82c5248015e91154922e"
Sep 18 14:12:43.470258 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:43.470077    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"
Sep 18 14:12:44.478826 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.478780    2585 generic.go:356] "Generic (PLEG): container finished" podID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerID="2149a704ee63c76964dd8aec534f3a3924e0b9887a0cb9a94e8277e0a2f24fe1" exitCode=0
Sep 18 14:12:44.479225 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.478848    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" event={"ID":"6d78d577-8bd1-4943-b94a-c3cc7f1f737a","Type":"ContainerDied","Data":"2149a704ee63c76964dd8aec534f3a3924e0b9887a0cb9a94e8277e0a2f24fe1"}
Sep 18 14:12:44.479225 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.478912    2585 scope.go:117] "RemoveContainer" containerID="e7c9f7e15ee5da7b6d2c478e1c66b02b7f66e7d244862edd3fb9daeaee6e2263"
Sep 18 14:12:44.582528 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.582456    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:12:44.662309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662279    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9g6\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-kube-api-access-4q9g6\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662316    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-socket\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662333    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-token\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662440    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-data\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662507    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-podinfo\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662576 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662570    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-certs\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662595    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-credential-socket\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662649    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istiod-ca-cert\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.662797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662649    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:44.662797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662722    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:44.662797 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662780    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-envoy\") pod \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\" (UID: \"6d78d577-8bd1-4943-b94a-c3cc7f1f737a\") "
Sep 18 14:12:44.663048 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662908    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:44.663048 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662956    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:44.663048 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.662977    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:44.663265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.663231    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.663265 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.663255    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.663368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.663268    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.663368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.663281    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.663368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.663294    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.664888 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.664867    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:44.664973 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.664888    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-kube-api-access-4q9g6" (OuterVolumeSpecName: "kube-api-access-4q9g6") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "kube-api-access-4q9g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:44.665430 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.665389    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:12:44.665500 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.665399    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d78d577-8bd1-4943-b94a-c3cc7f1f737a" (UID: "6d78d577-8bd1-4943-b94a-c3cc7f1f737a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:44.764943 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.764813    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.764943 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.764846    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q9g6\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-kube-api-access-4q9g6\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.764943 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.764861    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:44.764943 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:44.764876    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d78d577-8bd1-4943-b94a-c3cc7f1f737a-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:12:45.489996 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:45.489970    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"
Sep 18 14:12:45.490455 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:45.490026    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw" event={"ID":"6d78d577-8bd1-4943-b94a-c3cc7f1f737a","Type":"ContainerDied","Data":"4c608964e859293843bcaeecfb8b6d025455554433533ec5b7d2a644af7314ab"}
Sep 18 14:12:45.490455 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:45.490096    2585 scope.go:117] "RemoveContainer" containerID="2149a704ee63c76964dd8aec534f3a3924e0b9887a0cb9a94e8277e0a2f24fe1"
Sep 18 14:12:45.512345 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:45.512316    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"]
Sep 18 14:12:45.516386 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:45.516357    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw"]
Sep 18 14:12:45.645952 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:45.645909    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" path="/var/lib/kubelet/pods/6d78d577-8bd1-4943-b94a-c3cc7f1f737a/volumes"
Sep 18 14:12:47.780795 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:47.780761    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:12:50.726362 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:50.726330    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"]
Sep 18 14:12:50.729959 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:50.729937    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d4e72b-zwwwl"]
Sep 18 14:12:51.641604 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:51.641567    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b390c83e-50c8-469e-8266-6ca676b7fcd6" path="/var/lib/kubelet/pods/b390c83e-50c8-469e-8266-6ca676b7fcd6/volumes"
Sep 18 14:12:52.042130 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:52.042086    2585 scope.go:117] "RemoveContainer" containerID="49e0be2cc20482f2de07e446f1ea56b9547b306e84b1816ff275ae9359dca6aa"
Sep 18 14:12:52.055664 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:52.055636    2585 scope.go:117] "RemoveContainer" containerID="464ecb7120aa6d5c511af7f94b49dfd34dddc07379a246789db25b9e0ffbe457"
Sep 18 14:12:57.082338 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.082299    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"]
Sep 18 14:12:57.082820 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.082592    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy" containerID="cri-o://5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42" gracePeriod=30
Sep 18 14:12:57.424822 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.424796    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"]
Sep 18 14:12:57.425271 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425259    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy"
Sep 18 14:12:57.425317 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425273    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy"
Sep 18 14:12:57.425317 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425294    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b390c83e-50c8-469e-8266-6ca676b7fcd6" containerName="revoke-keys"
Sep 18 14:12:57.425317 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425299    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b390c83e-50c8-469e-8266-6ca676b7fcd6" containerName="revoke-keys"
Sep 18 14:12:57.425430 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425391    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy"
Sep 18 14:12:57.425430 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425406    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="805f52e9-dbc3-4270-a673-d83a9b1a4e08" containerName="istio-proxy"
Sep 18 14:12:57.425430 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.425427    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b390c83e-50c8-469e-8266-6ca676b7fcd6" containerName="revoke-keys"
Sep 18 14:12:57.430382 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.430364    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:12:57.434238 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.434220    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:12:57.444520 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.444498    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"]
Sep 18 14:12:57.490142 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.490111    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/224083f2-9d64-407f-bf00-b3fa9ac2a565-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf\" (UID: \"224083f2-9d64-407f-bf00-b3fa9ac2a565\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:12:57.591011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.590974    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/224083f2-9d64-407f-bf00-b3fa9ac2a565-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf\" (UID: \"224083f2-9d64-407f-bf00-b3fa9ac2a565\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:12:57.591650 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.591632    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/224083f2-9d64-407f-bf00-b3fa9ac2a565-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf\" (UID: \"224083f2-9d64-407f-bf00-b3fa9ac2a565\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:12:57.740896 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:57.740810    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:12:58.019745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:58.019288    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"]
Sep 18 14:12:58.585174 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:58.585083    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf" event={"ID":"224083f2-9d64-407f-bf00-b3fa9ac2a565","Type":"ContainerStarted","Data":"088250f48beb688e1997dd4d0ad7eecefe56e21359265915987b85f222602c69"}
Sep 18 14:12:58.585174 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:58.585144    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf" event={"ID":"224083f2-9d64-407f-bf00-b3fa9ac2a565","Type":"ContainerStarted","Data":"21b4b62c9987d23a3561c201b222bfbdf7b90fb9b5b828ffdf34009f0e061e60"}
Sep 18 14:12:58.604149 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:58.604101    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf" podStartSLOduration=1.604086846 podStartE2EDuration="1.604086846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:12:58.601995624 +0000 UTC m=+1689.101753132" watchObservedRunningTime="2026-09-18 14:12:58.604086846 +0000 UTC m=+1689.103844367"
Sep 18 14:12:59.593635 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:59.593604    2585 generic.go:356] "Generic (PLEG): container finished" podID="224083f2-9d64-407f-bf00-b3fa9ac2a565" containerID="088250f48beb688e1997dd4d0ad7eecefe56e21359265915987b85f222602c69" exitCode=0
Sep 18 14:12:59.594035 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:12:59.593696    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf" event={"ID":"224083f2-9d64-407f-bf00-b3fa9ac2a565","Type":"ContainerDied","Data":"088250f48beb688e1997dd4d0ad7eecefe56e21359265915987b85f222602c69"}
Sep 18 14:13:00.740182 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:00.740157    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:13:00.825443 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:00.825371    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/224083f2-9d64-407f-bf00-b3fa9ac2a565-maas-api-service-ca\") pod \"224083f2-9d64-407f-bf00-b3fa9ac2a565\" (UID: \"224083f2-9d64-407f-bf00-b3fa9ac2a565\") "
Sep 18 14:13:00.825787 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:00.825761    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/224083f2-9d64-407f-bf00-b3fa9ac2a565-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "224083f2-9d64-407f-bf00-b3fa9ac2a565" (UID: "224083f2-9d64-407f-bf00-b3fa9ac2a565"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:13:00.927263 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:00.927228    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/224083f2-9d64-407f-bf00-b3fa9ac2a565-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:01.606698 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:01.606665    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf" event={"ID":"224083f2-9d64-407f-bf00-b3fa9ac2a565","Type":"ContainerDied","Data":"21b4b62c9987d23a3561c201b222bfbdf7b90fb9b5b828ffdf34009f0e061e60"}
Sep 18 14:13:01.606698 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:01.606686    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"
Sep 18 14:13:01.606886 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:01.606714    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21b4b62c9987d23a3561c201b222bfbdf7b90fb9b5b828ffdf34009f0e061e60"
Sep 18 14:13:02.352974 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.352907    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:13:02.442516 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442488    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istiod-ca-cert\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442704 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442536    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-podinfo\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442704 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442561    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-envoy\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442704 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442613    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-certs\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442704 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442645    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-credential-socket\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442707    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-token\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442745    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z7cv\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-kube-api-access-9z7cv\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442792    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-data\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442835    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-socket\") pod \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\" (UID: \"6a57be34-b7f6-475d-9a40-0b81fc919fb5\") "
Sep 18 14:13:02.442926 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442906    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:02.443191 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442957    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:13:02.443191 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.442999    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:02.443191 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443113    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:02.443346 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443215    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:02.443346 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443312    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.443346 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443328    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.443346 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443342    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.443539 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443356    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.443539 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.443368    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.445052 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.445026    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:02.445052 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.445036    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:13:02.445322 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.445307    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:13:02.445433 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.445399    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-kube-api-access-9z7cv" (OuterVolumeSpecName: "kube-api-access-9z7cv") pod "6a57be34-b7f6-475d-9a40-0b81fc919fb5" (UID: "6a57be34-b7f6-475d-9a40-0b81fc919fb5"). InnerVolumeSpecName "kube-api-access-9z7cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:13:02.544113 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.544071    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.544113 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.544105    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.544113 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.544113    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.544113 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.544121    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z7cv\" (UniqueName: \"kubernetes.io/projected/6a57be34-b7f6-475d-9a40-0b81fc919fb5-kube-api-access-9z7cv\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:02.614731 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.614642    2585 generic.go:356] "Generic (PLEG): container finished" podID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerID="5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42" exitCode=0
Sep 18 14:13:02.614731 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.614690    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"
Sep 18 14:13:02.614903 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.614736    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" event={"ID":"6a57be34-b7f6-475d-9a40-0b81fc919fb5","Type":"ContainerDied","Data":"5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42"}
Sep 18 14:13:02.614903 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.614793    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf" event={"ID":"6a57be34-b7f6-475d-9a40-0b81fc919fb5","Type":"ContainerDied","Data":"646354e9ac57f137710c74001ec0f39bed41d4fa05d948f90ec9966b1cd618a0"}
Sep 18 14:13:02.614903 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.614819    2585 scope.go:117] "RemoveContainer" containerID="5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42"
Sep 18 14:13:02.625110 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.625091    2585 scope.go:117] "RemoveContainer" containerID="c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"
Sep 18 14:13:02.634854 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.634830    2585 scope.go:117] "RemoveContainer" containerID="5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42"
Sep 18 14:13:02.635203 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:13:02.635178    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42\": container with ID starting with 5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42 not found: ID does not exist" containerID="5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42"
Sep 18 14:13:02.635291 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.635217    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42"} err="failed to get container status \"5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42\": rpc error: code = NotFound desc = could not find container \"5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42\": container with ID starting with 5be57183ad33847004c998d27892f2e8824ddfbf32934147102db8ecdb16bf42 not found: ID does not exist"
Sep 18 14:13:02.635291 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.635240    2585 scope.go:117] "RemoveContainer" containerID="c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"
Sep 18 14:13:02.635544 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:13:02.635526    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0\": container with ID starting with c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0 not found: ID does not exist" containerID="c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"
Sep 18 14:13:02.635586 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.635550    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0"} err="failed to get container status \"c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0\": rpc error: code = NotFound desc = could not find container \"c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0\": container with ID starting with c54c532db57f934e405f3ba03359056cfe7461a43aa6be04d246427d2ec02ed0 not found: ID does not exist"
Sep 18 14:13:02.636464 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.636445    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"]
Sep 18 14:13:02.644121 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:02.644086    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf"]
Sep 18 14:13:03.640839 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:03.640798    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" path="/var/lib/kubelet/pods/6a57be34-b7f6-475d-9a40-0b81fc919fb5/volumes"
Sep 18 14:13:08.082050 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.082014    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"]
Sep 18 14:13:08.082737 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.082268    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5" podUID="5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" containerName="payload-pre-processing" containerID="cri-o://84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4" gracePeriod=30
Sep 18 14:13:08.262605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.262532    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"]
Sep 18 14:13:08.264978 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.264951    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-75dcf1-945pf"]
Sep 18 14:13:08.330733 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.330710    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:13:08.405498 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.405377    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf8qk\" (UniqueName: \"kubernetes.io/projected/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-kube-api-access-bf8qk\") pod \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") "
Sep 18 14:13:08.405669 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.405538    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-plugins-config-volume\") pod \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\" (UID: \"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b\") "
Sep 18 14:13:08.405929 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.405904    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" (UID: "5bae8268-d1a3-4625-80f8-c3a4fbcfd19b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:13:08.407784 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.407761    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-kube-api-access-bf8qk" (OuterVolumeSpecName: "kube-api-access-bf8qk") pod "5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" (UID: "5bae8268-d1a3-4625-80f8-c3a4fbcfd19b"). InnerVolumeSpecName "kube-api-access-bf8qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:13:08.506558 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.506511    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf8qk\" (UniqueName: \"kubernetes.io/projected/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-kube-api-access-bf8qk\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:08.506558 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.506555    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:13:08.651555 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.651518    2585 generic.go:356] "Generic (PLEG): container finished" podID="5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" containerID="84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4" exitCode=0
Sep 18 14:13:08.651730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.651575    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"
Sep 18 14:13:08.651730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.651603    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5" event={"ID":"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b","Type":"ContainerDied","Data":"84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4"}
Sep 18 14:13:08.651730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.651664    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5" event={"ID":"5bae8268-d1a3-4625-80f8-c3a4fbcfd19b","Type":"ContainerDied","Data":"08869299c3b46337087d34ccd07cff894c3f76a3f0f1e2db638ac5f6cff11cec"}
Sep 18 14:13:08.651730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.651688    2585 scope.go:117] "RemoveContainer" containerID="84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4"
Sep 18 14:13:08.661929 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.661911    2585 scope.go:117] "RemoveContainer" containerID="84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4"
Sep 18 14:13:08.662366 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:13:08.662342    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4\": container with ID starting with 84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4 not found: ID does not exist" containerID="84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4"
Sep 18 14:13:08.662500 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.662372    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4"} err="failed to get container status \"84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4\": rpc error: code = NotFound desc = could not find container \"84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4\": container with ID starting with 84b960f7c44337ccd47af7e060abe255cce1634f2302c3ca28e2d03aa73784c4 not found: ID does not exist"
Sep 18 14:13:08.672755 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.672732    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"]
Sep 18 14:13:08.676652 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:08.676628    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5"]
Sep 18 14:13:09.641616 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:09.641580    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224083f2-9d64-407f-bf00-b3fa9ac2a565" path="/var/lib/kubelet/pods/224083f2-9d64-407f-bf00-b3fa9ac2a565/volumes"
Sep 18 14:13:09.641991 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:09.641982    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" path="/var/lib/kubelet/pods/5bae8268-d1a3-4625-80f8-c3a4fbcfd19b/volumes"
Sep 18 14:13:17.503951 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:17.503913    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:13:38.879962 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:38.879925    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:13:56.958823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.958787    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"]
Sep 18 14:13:56.959311 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959297    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" containerName="payload-pre-processing"
Sep 18 14:13:56.959358 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959314    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" containerName="payload-pre-processing"
Sep 18 14:13:56.959358 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959337    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy"
Sep 18 14:13:56.959358 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959343    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy"
Sep 18 14:13:56.959358 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959358    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224083f2-9d64-407f-bf00-b3fa9ac2a565" containerName="revoke-keys"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959363    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="224083f2-9d64-407f-bf00-b3fa9ac2a565" containerName="revoke-keys"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959374    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959379    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959459    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959469    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bae8268-d1a3-4625-80f8-c3a4fbcfd19b" containerName="payload-pre-processing"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959474    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="224083f2-9d64-407f-bf00-b3fa9ac2a565" containerName="revoke-keys"
Sep 18 14:13:56.959508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.959484    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d78d577-8bd1-4943-b94a-c3cc7f1f737a" containerName="istio-proxy"
Sep 18 14:13:56.964051 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.964035    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:13:56.966353 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.966327    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:13:56.968709 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:56.968682    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"]
Sep 18 14:13:57.019739 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.019696    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e64fc76-a3e9-497c-846c-f78792537217-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6\" (UID: \"4e64fc76-a3e9-497c-846c-f78792537217\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:13:57.121134 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.121093    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e64fc76-a3e9-497c-846c-f78792537217-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6\" (UID: \"4e64fc76-a3e9-497c-846c-f78792537217\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:13:57.121801 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.121780    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e64fc76-a3e9-497c-846c-f78792537217-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6\" (UID: \"4e64fc76-a3e9-497c-846c-f78792537217\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:13:57.278079 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.277996    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:13:57.553472 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.553446    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"]
Sep 18 14:13:57.556076 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:13:57.556052    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e64fc76_a3e9_497c_846c_f78792537217.slice/crio-d9dcbee892d257f99cb55deab0db36b58b2f8d1754a951df25c834d43e835832 WatchSource:0}: Error finding container d9dcbee892d257f99cb55deab0db36b58b2f8d1754a951df25c834d43e835832: Status 404 returned error can't find the container with id d9dcbee892d257f99cb55deab0db36b58b2f8d1754a951df25c834d43e835832
Sep 18 14:13:57.951444 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.951381    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6" event={"ID":"4e64fc76-a3e9-497c-846c-f78792537217","Type":"ContainerStarted","Data":"6e2dd6ed742dfcd2434e3801488bb845233663470eccc661a70fce3215c5caf8"}
Sep 18 14:13:57.951595 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.951517    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6" event={"ID":"4e64fc76-a3e9-497c-846c-f78792537217","Type":"ContainerStarted","Data":"d9dcbee892d257f99cb55deab0db36b58b2f8d1754a951df25c834d43e835832"}
Sep 18 14:13:57.969798 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:57.969750    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6" podStartSLOduration=1.9697355829999998 podStartE2EDuration="1.969735583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:13:57.968967401 +0000 UTC m=+1748.468724919" watchObservedRunningTime="2026-09-18 14:13:57.969735583 +0000 UTC m=+1748.469493099"
Sep 18 14:13:58.958906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:58.958868    2585 generic.go:356] "Generic (PLEG): container finished" podID="4e64fc76-a3e9-497c-846c-f78792537217" containerID="6e2dd6ed742dfcd2434e3801488bb845233663470eccc661a70fce3215c5caf8" exitCode=0
Sep 18 14:13:58.959128 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:13:58.958953    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6" event={"ID":"4e64fc76-a3e9-497c-846c-f78792537217","Type":"ContainerDied","Data":"6e2dd6ed742dfcd2434e3801488bb845233663470eccc661a70fce3215c5caf8"}
Sep 18 14:14:00.111883 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.111851    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:14:00.155782 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.155745    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e64fc76-a3e9-497c-846c-f78792537217-maas-api-service-ca\") pod \"4e64fc76-a3e9-497c-846c-f78792537217\" (UID: \"4e64fc76-a3e9-497c-846c-f78792537217\") "
Sep 18 14:14:00.156108 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.156086    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e64fc76-a3e9-497c-846c-f78792537217-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e64fc76-a3e9-497c-846c-f78792537217" (UID: "4e64fc76-a3e9-497c-846c-f78792537217"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:14:00.257320 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.257231    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e64fc76-a3e9-497c-846c-f78792537217-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:00.582181 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.582093    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:14:00.972560 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.972530    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"
Sep 18 14:14:00.972779 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.972568    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6" event={"ID":"4e64fc76-a3e9-497c-846c-f78792537217","Type":"ContainerDied","Data":"d9dcbee892d257f99cb55deab0db36b58b2f8d1754a951df25c834d43e835832"}
Sep 18 14:14:00.972779 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:00.972616    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9dcbee892d257f99cb55deab0db36b58b2f8d1754a951df25c834d43e835832"
Sep 18 14:14:01.800299 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:01.800261    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"]
Sep 18 14:14:12.522915 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.522872    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"]
Sep 18 14:14:12.525210 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.525184    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a02b2c-29829000-jndh6"]
Sep 18 14:14:12.560716 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.560679    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"]
Sep 18 14:14:12.561009 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.560956    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55" podUID="8ac3f19f-7563-48c1-90ce-2bf61b3662b9" containerName="payload-pre-processing" containerID="cri-o://f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309" gracePeriod=30
Sep 18 14:14:12.725952 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.725919    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"]
Sep 18 14:14:12.728890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.728866    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-a02b2c-zcls6"]
Sep 18 14:14:12.828289 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.828261    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 14:14:12.890340 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.890310    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqnsj\" (UniqueName: \"kubernetes.io/projected/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-kube-api-access-wqnsj\") pod \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") "
Sep 18 14:14:12.890340 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.890348    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-plugins-config-volume\") pod \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\" (UID: \"8ac3f19f-7563-48c1-90ce-2bf61b3662b9\") "
Sep 18 14:14:12.890822 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.890795    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ac3f19f-7563-48c1-90ce-2bf61b3662b9" (UID: "8ac3f19f-7563-48c1-90ce-2bf61b3662b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:14:12.890909 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.890884    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:12.892825 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.892798    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-kube-api-access-wqnsj" (OuterVolumeSpecName: "kube-api-access-wqnsj") pod "8ac3f19f-7563-48c1-90ce-2bf61b3662b9" (UID: "8ac3f19f-7563-48c1-90ce-2bf61b3662b9"). InnerVolumeSpecName "kube-api-access-wqnsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:12.991538 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:12.991500    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqnsj\" (UniqueName: \"kubernetes.io/projected/8ac3f19f-7563-48c1-90ce-2bf61b3662b9-kube-api-access-wqnsj\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:13.044998 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.044964    2585 generic.go:356] "Generic (PLEG): container finished" podID="8ac3f19f-7563-48c1-90ce-2bf61b3662b9" containerID="f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309" exitCode=0
Sep 18 14:14:13.045166 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.045012    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"
Sep 18 14:14:13.045166 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.045041    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55" event={"ID":"8ac3f19f-7563-48c1-90ce-2bf61b3662b9","Type":"ContainerDied","Data":"f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309"}
Sep 18 14:14:13.045166 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.045085    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55" event={"ID":"8ac3f19f-7563-48c1-90ce-2bf61b3662b9","Type":"ContainerDied","Data":"0c47ddbfaaa8cda3172907f933e21bc512f5445e8cca1a60980eef42eab7067f"}
Sep 18 14:14:13.045166 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.045107    2585 scope.go:117] "RemoveContainer" containerID="f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309"
Sep 18 14:14:13.055241 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.055221    2585 scope.go:117] "RemoveContainer" containerID="f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309"
Sep 18 14:14:13.055609 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:14:13.055588    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309\": container with ID starting with f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309 not found: ID does not exist" containerID="f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309"
Sep 18 14:14:13.055704 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.055616    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309"} err="failed to get container status \"f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309\": rpc error: code = NotFound desc = could not find container \"f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309\": container with ID starting with f48f88c86272f79bfc448434b8fa8e4a9143f7d35401079b2764c7e6a0cf3309 not found: ID does not exist"
Sep 18 14:14:13.066545 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.066521    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"]
Sep 18 14:14:13.070330 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.070309    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55"]
Sep 18 14:14:13.641666 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.641623    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e64fc76-a3e9-497c-846c-f78792537217" path="/var/lib/kubelet/pods/4e64fc76-a3e9-497c-846c-f78792537217/volumes"
Sep 18 14:14:13.642166 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.642096    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b0ff3a-9964-48cf-8d20-6be38099cfb6" path="/var/lib/kubelet/pods/53b0ff3a-9964-48cf-8d20-6be38099cfb6/volumes"
Sep 18 14:14:13.642513 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:13.642493    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac3f19f-7563-48c1-90ce-2bf61b3662b9" path="/var/lib/kubelet/pods/8ac3f19f-7563-48c1-90ce-2bf61b3662b9/volumes"
Sep 18 14:14:16.821193 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:16.821150    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g" podUID="d2ade38b-62aa-4756-9c0e-0671171c818c" containerName="main" containerID="cri-o://d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99" gracePeriod=45
Sep 18 14:14:17.075140 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.075067    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:14:17.077533 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.077506    2585 generic.go:356] "Generic (PLEG): container finished" podID="d2ade38b-62aa-4756-9c0e-0671171c818c" containerID="d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99" exitCode=0
Sep 18 14:14:17.077655 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.077540    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"
Sep 18 14:14:17.077655 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.077584    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g" event={"ID":"d2ade38b-62aa-4756-9c0e-0671171c818c","Type":"ContainerDied","Data":"d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99"}
Sep 18 14:14:17.077655 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.077628    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g" event={"ID":"d2ade38b-62aa-4756-9c0e-0671171c818c","Type":"ContainerDied","Data":"ddacec468d7a992cbe8b6a26fb1bb3df3e0782698e1eb2e9e3c3166734d1096c"}
Sep 18 14:14:17.077655 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.077647    2585 scope.go:117] "RemoveContainer" containerID="d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99"
Sep 18 14:14:17.086956 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.086935    2585 scope.go:117] "RemoveContainer" containerID="d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99"
Sep 18 14:14:17.087276 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:14:17.087257    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99\": container with ID starting with d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99 not found: ID does not exist" containerID="d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99"
Sep 18 14:14:17.087333 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.087286    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99"} err="failed to get container status \"d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99\": rpc error: code = NotFound desc = could not find container \"d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99\": container with ID starting with d953ee7460cdd03fb3155f76ef3ddaa74b881f8de0e0d806a4e1e776e1ee8c99 not found: ID does not exist"
Sep 18 14:14:17.236359 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236330    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-tmp-dir\") pod \"d2ade38b-62aa-4756-9c0e-0671171c818c\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") "
Sep 18 14:14:17.236531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236470    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-home\") pod \"d2ade38b-62aa-4756-9c0e-0671171c818c\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") "
Sep 18 14:14:17.236531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236525    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-model-cache\") pod \"d2ade38b-62aa-4756-9c0e-0671171c818c\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") "
Sep 18 14:14:17.236632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236558    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-dshm\") pod \"d2ade38b-62aa-4756-9c0e-0671171c818c\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") "
Sep 18 14:14:17.236632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236601    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2ade38b-62aa-4756-9c0e-0671171c818c" (UID: "d2ade38b-62aa-4756-9c0e-0671171c818c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.236632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236610    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm6jv\" (UniqueName: \"kubernetes.io/projected/d2ade38b-62aa-4756-9c0e-0671171c818c-kube-api-access-pm6jv\") pod \"d2ade38b-62aa-4756-9c0e-0671171c818c\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") "
Sep 18 14:14:17.236757 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236670    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade38b-62aa-4756-9c0e-0671171c818c-tls-certs\") pod \"d2ade38b-62aa-4756-9c0e-0671171c818c\" (UID: \"d2ade38b-62aa-4756-9c0e-0671171c818c\") "
Sep 18 14:14:17.236814 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236749    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-home" (OuterVolumeSpecName: "home") pod "d2ade38b-62aa-4756-9c0e-0671171c818c" (UID: "d2ade38b-62aa-4756-9c0e-0671171c818c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.236875 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.236830    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2ade38b-62aa-4756-9c0e-0671171c818c" (UID: "d2ade38b-62aa-4756-9c0e-0671171c818c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.237206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.237133    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.237206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.237161    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.237206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.237180    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.238961 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.238933    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-dshm" (OuterVolumeSpecName: "dshm") pod "d2ade38b-62aa-4756-9c0e-0671171c818c" (UID: "d2ade38b-62aa-4756-9c0e-0671171c818c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.238961 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.238944    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ade38b-62aa-4756-9c0e-0671171c818c-kube-api-access-pm6jv" (OuterVolumeSpecName: "kube-api-access-pm6jv") pod "d2ade38b-62aa-4756-9c0e-0671171c818c" (UID: "d2ade38b-62aa-4756-9c0e-0671171c818c"). InnerVolumeSpecName "kube-api-access-pm6jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:17.239203 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.239184    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ade38b-62aa-4756-9c0e-0671171c818c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2ade38b-62aa-4756-9c0e-0671171c818c" (UID: "d2ade38b-62aa-4756-9c0e-0671171c818c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:14:17.338847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.338756    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade38b-62aa-4756-9c0e-0671171c818c-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.338847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.338782    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm6jv\" (UniqueName: \"kubernetes.io/projected/d2ade38b-62aa-4756-9c0e-0671171c818c-kube-api-access-pm6jv\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.338847 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.338795    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade38b-62aa-4756-9c0e-0671171c818c-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.402717 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.402671    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"]
Sep 18 14:14:17.408457 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.408405    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-2-w4-a02b2c-kserve-79764dc98-xxs5g"]
Sep 18 14:14:17.642896 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:17.642817    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2ade38b-62aa-4756-9c0e-0671171c818c" path="/var/lib/kubelet/pods/d2ade38b-62aa-4756-9c0e-0671171c818c/volumes"
Sep 18 14:14:23.689125 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:23.689087    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:14:37.576207 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:37.576123    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:14:37.784262 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:37.784229    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"]
Sep 18 14:14:48.382354 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:48.382317    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:14:51.734090 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:51.734059    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:14:51.740436 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:51.740388    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:14:52.128841 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:52.128746    2585 scope.go:117] "RemoveContainer" containerID="e5b2529408d246ddd6bb5c496009e37beef6aec1100af43a60c5fe6c8fb042f2"
Sep 18 14:14:52.138983 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:52.138949    2585 scope.go:117] "RemoveContainer" containerID="81030371f07e0517f4c4d693ac4774244c01f957a72a16ef99498a2340285dc1"
Sep 18 14:14:52.806922 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:52.806850    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw" podUID="39b10875-8d88-4502-93a2-540d186f28b3" containerName="main" containerID="cri-o://15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84" gracePeriod=45
Sep 18 14:14:53.063772 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.063715    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:14:53.210660 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.210631    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xnfm\" (UniqueName: \"kubernetes.io/projected/39b10875-8d88-4502-93a2-540d186f28b3-kube-api-access-4xnfm\") pod \"39b10875-8d88-4502-93a2-540d186f28b3\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") "
Sep 18 14:14:53.210855 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.210682    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-dshm\") pod \"39b10875-8d88-4502-93a2-540d186f28b3\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") "
Sep 18 14:14:53.210855 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.210724    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-model-cache\") pod \"39b10875-8d88-4502-93a2-540d186f28b3\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") "
Sep 18 14:14:53.210855 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.210766    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-home\") pod \"39b10875-8d88-4502-93a2-540d186f28b3\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") "
Sep 18 14:14:53.210855 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.210800    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b10875-8d88-4502-93a2-540d186f28b3-tls-certs\") pod \"39b10875-8d88-4502-93a2-540d186f28b3\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") "
Sep 18 14:14:53.211073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.210865    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-tmp-dir\") pod \"39b10875-8d88-4502-93a2-540d186f28b3\" (UID: \"39b10875-8d88-4502-93a2-540d186f28b3\") "
Sep 18 14:14:53.211073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.211037    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-home" (OuterVolumeSpecName: "home") pod "39b10875-8d88-4502-93a2-540d186f28b3" (UID: "39b10875-8d88-4502-93a2-540d186f28b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:53.211073 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.211050    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "39b10875-8d88-4502-93a2-540d186f28b3" (UID: "39b10875-8d88-4502-93a2-540d186f28b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:53.211235 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.211164    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39b10875-8d88-4502-93a2-540d186f28b3" (UID: "39b10875-8d88-4502-93a2-540d186f28b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:53.211401 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.211381    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:53.211524 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.211408    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:53.211658 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.211643    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:53.213126 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.213096    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-dshm" (OuterVolumeSpecName: "dshm") pod "39b10875-8d88-4502-93a2-540d186f28b3" (UID: "39b10875-8d88-4502-93a2-540d186f28b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:53.213126 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.213125    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b10875-8d88-4502-93a2-540d186f28b3-kube-api-access-4xnfm" (OuterVolumeSpecName: "kube-api-access-4xnfm") pod "39b10875-8d88-4502-93a2-540d186f28b3" (UID: "39b10875-8d88-4502-93a2-540d186f28b3"). InnerVolumeSpecName "kube-api-access-4xnfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:53.213309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.213148    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b10875-8d88-4502-93a2-540d186f28b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39b10875-8d88-4502-93a2-540d186f28b3" (UID: "39b10875-8d88-4502-93a2-540d186f28b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:14:53.296803 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.296773    2585 generic.go:356] "Generic (PLEG): container finished" podID="39b10875-8d88-4502-93a2-540d186f28b3" containerID="15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84" exitCode=0
Sep 18 14:14:53.296942 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.296823    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"
Sep 18 14:14:53.296942 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.296865    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw" event={"ID":"39b10875-8d88-4502-93a2-540d186f28b3","Type":"ContainerDied","Data":"15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84"}
Sep 18 14:14:53.296942 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.296913    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw" event={"ID":"39b10875-8d88-4502-93a2-540d186f28b3","Type":"ContainerDied","Data":"f218348bfada02acd998f2ba5941b6448d165c1cadefbf3236c6f24fd8e2b41d"}
Sep 18 14:14:53.296942 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.296931    2585 scope.go:117] "RemoveContainer" containerID="15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84"
Sep 18 14:14:53.306460 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.306438    2585 scope.go:117] "RemoveContainer" containerID="15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84"
Sep 18 14:14:53.306749 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:14:53.306729    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84\": container with ID starting with 15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84 not found: ID does not exist" containerID="15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84"
Sep 18 14:14:53.306818 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.306755    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84"} err="failed to get container status \"15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84\": rpc error: code = NotFound desc = could not find container \"15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84\": container with ID starting with 15362e9050f4db4eeaa36a7d5f609ee88c5a0f89f22eee2f3fe697ee455edb84 not found: ID does not exist"
Sep 18 14:14:53.312938 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.312918    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xnfm\" (UniqueName: \"kubernetes.io/projected/39b10875-8d88-4502-93a2-540d186f28b3-kube-api-access-4xnfm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:53.313023 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.312939    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b10875-8d88-4502-93a2-540d186f28b3-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:53.313023 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.312949    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b10875-8d88-4502-93a2-540d186f28b3-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:14:53.317197 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.317150    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"]
Sep 18 14:14:53.321816 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.321797    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/auth-test-model-d25bfb-kserve-65f677b9bc-5rlmw"]
Sep 18 14:14:53.641454 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:53.641351    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b10875-8d88-4502-93a2-540d186f28b3" path="/var/lib/kubelet/pods/39b10875-8d88-4502-93a2-540d186f28b3/volumes"
Sep 18 14:14:58.029891 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:14:58.029855    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"]
Sep 18 14:15:00.158177 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158143    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"]
Sep 18 14:15:00.158610 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158594    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy"
Sep 18 14:15:00.158610 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158606    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158620    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ade38b-62aa-4756-9c0e-0671171c818c" containerName="main"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158626    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ade38b-62aa-4756-9c0e-0671171c818c" containerName="main"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158639    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b10875-8d88-4502-93a2-540d186f28b3" containerName="main"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158645    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b10875-8d88-4502-93a2-540d186f28b3" containerName="main"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158657    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac3f19f-7563-48c1-90ce-2bf61b3662b9" containerName="payload-pre-processing"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158662    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac3f19f-7563-48c1-90ce-2bf61b3662b9" containerName="payload-pre-processing"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158676    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e64fc76-a3e9-497c-846c-f78792537217" containerName="revoke-keys"
Sep 18 14:15:00.158696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158682    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e64fc76-a3e9-497c-846c-f78792537217" containerName="revoke-keys"
Sep 18 14:15:00.158984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158749    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b10875-8d88-4502-93a2-540d186f28b3" containerName="main"
Sep 18 14:15:00.158984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158757    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac3f19f-7563-48c1-90ce-2bf61b3662b9" containerName="payload-pre-processing"
Sep 18 14:15:00.158984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158763    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ade38b-62aa-4756-9c0e-0671171c818c" containerName="main"
Sep 18 14:15:00.158984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158770    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a57be34-b7f6-475d-9a40-0b81fc919fb5" containerName="istio-proxy"
Sep 18 14:15:00.158984 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.158777    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e64fc76-a3e9-497c-846c-f78792537217" containerName="revoke-keys"
Sep 18 14:15:00.164913 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.164874    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"
Sep 18 14:15:00.170276 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.170250    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"]
Sep 18 14:15:00.172923 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.172904    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"
Sep 18 14:15:00.173749 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.173732    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:15:00.177106 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.177089    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"
Sep 18 14:15:00.184642 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.184626    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"
Sep 18 14:15:00.193220 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.193167    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"]
Sep 18 14:15:00.195916 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.195883    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"]
Sep 18 14:15:00.463255 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.463230    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"]
Sep 18 14:15:00.465498 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:15:00.465471    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be66984_fd75_4a42_9720_cfd500d8da79.slice/crio-eec4d6c050e5924ef762cb8a593958a8c0052df4f7d2ea3956a1f6f7bd0c9379 WatchSource:0}: Error finding container eec4d6c050e5924ef762cb8a593958a8c0052df4f7d2ea3956a1f6f7bd0c9379: Status 404 returned error can't find the container with id eec4d6c050e5924ef762cb8a593958a8c0052df4f7d2ea3956a1f6f7bd0c9379
Sep 18 14:15:00.470072 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:00.470051    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"]
Sep 18 14:15:00.472680 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:15:00.472569    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95edbab1_9690_42e3_a4c3_516e36af68f0.slice/crio-f8bef2136e11ac9948d8dec6aeb490cf0166448e8b6af131e7a2e32d5794a162 WatchSource:0}: Error finding container f8bef2136e11ac9948d8dec6aeb490cf0166448e8b6af131e7a2e32d5794a162: Status 404 returned error can't find the container with id f8bef2136e11ac9948d8dec6aeb490cf0166448e8b6af131e7a2e32d5794a162
Sep 18 14:15:01.080082 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.079995    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:15:01.344350 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.344256    2585 generic.go:356] "Generic (PLEG): container finished" podID="2be66984-fd75-4a42-9720-cfd500d8da79" containerID="ddfa19f04a7206d5641262f74edcc8e03c609d4d9bf8330a53e2c5f3d30a72d4" exitCode=0
Sep 18 14:15:01.344812 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.344338    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48" event={"ID":"2be66984-fd75-4a42-9720-cfd500d8da79","Type":"ContainerDied","Data":"ddfa19f04a7206d5641262f74edcc8e03c609d4d9bf8330a53e2c5f3d30a72d4"}
Sep 18 14:15:01.344812 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.344400    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48" event={"ID":"2be66984-fd75-4a42-9720-cfd500d8da79","Type":"ContainerStarted","Data":"eec4d6c050e5924ef762cb8a593958a8c0052df4f7d2ea3956a1f6f7bd0c9379"}
Sep 18 14:15:01.346001 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.345969    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw" event={"ID":"95edbab1-9690-42e3-a4c3-516e36af68f0","Type":"ContainerStarted","Data":"f6561936332716042626ee26d93f64e67410a4726f0c5f51a16650605ef1b718"}
Sep 18 14:15:01.346112 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.346026    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw" event={"ID":"95edbab1-9690-42e3-a4c3-516e36af68f0","Type":"ContainerStarted","Data":"f8bef2136e11ac9948d8dec6aeb490cf0166448e8b6af131e7a2e32d5794a162"}
Sep 18 14:15:01.373359 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:01.373306    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw" podStartSLOduration=1.373288965 podStartE2EDuration="1.373288965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:15:01.3711942 +0000 UTC m=+1811.870951715" watchObservedRunningTime="2026-09-18 14:15:01.373288965 +0000 UTC m=+1811.873046481"
Sep 18 14:15:02.354527 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:02.354487    2585 generic.go:356] "Generic (PLEG): container finished" podID="95edbab1-9690-42e3-a4c3-516e36af68f0" containerID="f6561936332716042626ee26d93f64e67410a4726f0c5f51a16650605ef1b718" exitCode=0
Sep 18 14:15:02.354971 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:02.354550    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw" event={"ID":"95edbab1-9690-42e3-a4c3-516e36af68f0","Type":"ContainerDied","Data":"f6561936332716042626ee26d93f64e67410a4726f0c5f51a16650605ef1b718"}
Sep 18 14:15:02.507997 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:02.507971    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"
Sep 18 14:15:03.362253 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:03.362219    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"
Sep 18 14:15:03.362713 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:03.362253    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48" event={"ID":"2be66984-fd75-4a42-9720-cfd500d8da79","Type":"ContainerDied","Data":"eec4d6c050e5924ef762cb8a593958a8c0052df4f7d2ea3956a1f6f7bd0c9379"}
Sep 18 14:15:03.362713 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:03.362301    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec4d6c050e5924ef762cb8a593958a8c0052df4f7d2ea3956a1f6f7bd0c9379"
Sep 18 14:15:03.498382 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:03.498355    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"
Sep 18 14:15:04.369684 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:04.369652    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw" event={"ID":"95edbab1-9690-42e3-a4c3-516e36af68f0","Type":"ContainerDied","Data":"f8bef2136e11ac9948d8dec6aeb490cf0166448e8b6af131e7a2e32d5794a162"}
Sep 18 14:15:04.369684 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:04.369680    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829015-pqfcw"
Sep 18 14:15:04.370160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:04.369700    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8bef2136e11ac9948d8dec6aeb490cf0166448e8b6af131e7a2e32d5794a162"
Sep 18 14:15:10.085577 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:10.085541    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:15:13.050104 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.050064    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888" podUID="dbfc97c0-c2a4-4469-be12-c824c427a818" containerName="main" containerID="cri-o://82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94" gracePeriod=45
Sep 18 14:15:13.317953 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.317919    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:15:13.414405 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414367    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-dshm\") pod \"dbfc97c0-c2a4-4469-be12-c824c427a818\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") "
Sep 18 14:15:13.414632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414443    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc97c0-c2a4-4469-be12-c824c427a818-tls-certs\") pod \"dbfc97c0-c2a4-4469-be12-c824c427a818\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") "
Sep 18 14:15:13.414632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414514    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-model-cache\") pod \"dbfc97c0-c2a4-4469-be12-c824c427a818\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") "
Sep 18 14:15:13.414632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414586    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-tmp-dir\") pod \"dbfc97c0-c2a4-4469-be12-c824c427a818\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") "
Sep 18 14:15:13.414632 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414624    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t764\" (UniqueName: \"kubernetes.io/projected/dbfc97c0-c2a4-4469-be12-c824c427a818-kube-api-access-5t764\") pod \"dbfc97c0-c2a4-4469-be12-c824c427a818\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") "
Sep 18 14:15:13.414860 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414671    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-home\") pod \"dbfc97c0-c2a4-4469-be12-c824c427a818\" (UID: \"dbfc97c0-c2a4-4469-be12-c824c427a818\") "
Sep 18 14:15:13.414860 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414775    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbfc97c0-c2a4-4469-be12-c824c427a818" (UID: "dbfc97c0-c2a4-4469-be12-c824c427a818"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:13.414860 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.414845    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbfc97c0-c2a4-4469-be12-c824c427a818" (UID: "dbfc97c0-c2a4-4469-be12-c824c427a818"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:13.415066 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.415035    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-home" (OuterVolumeSpecName: "home") pod "dbfc97c0-c2a4-4469-be12-c824c427a818" (UID: "dbfc97c0-c2a4-4469-be12-c824c427a818"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:13.415129 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.415105    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-model-cache\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:15:13.415129 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.415121    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-tmp-dir\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:15:13.417004 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.416979    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-dshm" (OuterVolumeSpecName: "dshm") pod "dbfc97c0-c2a4-4469-be12-c824c427a818" (UID: "dbfc97c0-c2a4-4469-be12-c824c427a818"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:15:13.417101 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.417061    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbfc97c0-c2a4-4469-be12-c824c427a818-kube-api-access-5t764" (OuterVolumeSpecName: "kube-api-access-5t764") pod "dbfc97c0-c2a4-4469-be12-c824c427a818" (UID: "dbfc97c0-c2a4-4469-be12-c824c427a818"). InnerVolumeSpecName "kube-api-access-5t764". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:15:13.417214 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.417191    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbfc97c0-c2a4-4469-be12-c824c427a818-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbfc97c0-c2a4-4469-be12-c824c427a818" (UID: "dbfc97c0-c2a4-4469-be12-c824c427a818"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:15:13.423368 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.423340    2585 generic.go:356] "Generic (PLEG): container finished" podID="dbfc97c0-c2a4-4469-be12-c824c427a818" containerID="82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94" exitCode=0
Sep 18 14:15:13.423495 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.423386    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"
Sep 18 14:15:13.423495 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.423435    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888" event={"ID":"dbfc97c0-c2a4-4469-be12-c824c427a818","Type":"ContainerDied","Data":"82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94"}
Sep 18 14:15:13.423495 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.423482    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888" event={"ID":"dbfc97c0-c2a4-4469-be12-c824c427a818","Type":"ContainerDied","Data":"b738da13fde9073217c1a29ad3f77e19a8d2e714bb183d653db908b255be91ae"}
Sep 18 14:15:13.423629 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.423504    2585 scope.go:117] "RemoveContainer" containerID="82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94"
Sep 18 14:15:13.437822 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.437800    2585 scope.go:117] "RemoveContainer" containerID="82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94"
Sep 18 14:15:13.438149 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:15:13.438129    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94\": container with ID starting with 82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94 not found: ID does not exist" containerID="82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94"
Sep 18 14:15:13.438212 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.438160    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94"} err="failed to get container status \"82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94\": rpc error: code = NotFound desc = could not find container \"82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94\": container with ID starting with 82f2e282d0c35ad868ddadacf05ffd78d54ec12c8fc16e1e998ed410159cfd94 not found: ID does not exist"
Sep 18 14:15:13.449078 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.449045    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"]
Sep 18 14:15:13.453795 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.453757    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/auth-test-model-d634d2-kserve-bcd9b6599-hb888"]
Sep 18 14:15:13.516705 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.516666    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t764\" (UniqueName: \"kubernetes.io/projected/dbfc97c0-c2a4-4469-be12-c824c427a818-kube-api-access-5t764\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:15:13.516705 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.516696    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-home\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:15:13.516705 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.516707    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc97c0-c2a4-4469-be12-c824c427a818-dshm\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:15:13.517014 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.516715    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc97c0-c2a4-4469-be12-c824c427a818-tls-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:15:13.640939 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:13.640858    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbfc97c0-c2a4-4469-be12-c824c427a818" path="/var/lib/kubelet/pods/dbfc97c0-c2a4-4469-be12-c824c427a818/volumes"
Sep 18 14:15:44.593862 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:15:44.593824    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:16:00.971026 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:16:00.970990    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:16:16.073564 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:16:16.073476    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:16:26.283645 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:16:26.283600    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:16:53.378673 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:16:53.378630    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:17:10.170011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:17:10.169964    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:17:19.579383 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:17:19.579345    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:17:29.572074 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:17:29.572031    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:17:41.665433 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:17:41.665325    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:17:52.199718 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:17:52.199688    2585 scope.go:117] "RemoveContainer" containerID="dcb5a2e310f3a1098cb36c255291a4741f5ed35e6ed52b99016074923f3df70d"
Sep 18 14:18:06.872676 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:06.872640    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:18:29.607766 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:29.607733    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z44zd_1e2d11ab-7c5b-462b-a830-c9f669899f7b/payload-processing/0.log"
Sep 18 14:18:42.775785 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:42.775744    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:18:52.222862 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:52.222833    2585 scope.go:117] "RemoveContainer" containerID="2a6f574043afda3c1f51602e51110dbcf9f1e5f59fc75fceea74a08b5881b43f"
Sep 18 14:18:52.234347 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:52.234314    2585 scope.go:117] "RemoveContainer" containerID="18311154b1b784db8907e6e7c537dd6a25ec5a97d8bdbb55d179d6d3682c163d"
Sep 18 14:18:52.242976 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:52.242952    2585 scope.go:117] "RemoveContainer" containerID="f3324ceb228b9e01e685313405d913743282a7e1c587f20f41894d50df8bc2c9"
Sep 18 14:18:59.981429 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:18:59.981390    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:19:05.775857 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:05.775778    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z44zd_1e2d11ab-7c5b-462b-a830-c9f669899f7b/payload-processing/0.log"
Sep 18 14:19:06.548092 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548047    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"]
Sep 18 14:19:06.548716 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548684    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95edbab1-9690-42e3-a4c3-516e36af68f0" containerName="cleanup"
Sep 18 14:19:06.548716 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548709    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="95edbab1-9690-42e3-a4c3-516e36af68f0" containerName="cleanup"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548726    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfc97c0-c2a4-4469-be12-c824c427a818" containerName="main"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548731    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfc97c0-c2a4-4469-be12-c824c427a818" containerName="main"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548756    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be66984-fd75-4a42-9720-cfd500d8da79" containerName="cleanup"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548761    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be66984-fd75-4a42-9720-cfd500d8da79" containerName="cleanup"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548830    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbfc97c0-c2a4-4469-be12-c824c427a818" containerName="main"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548839    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="95edbab1-9690-42e3-a4c3-516e36af68f0" containerName="cleanup"
Sep 18 14:19:06.548935 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.548849    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be66984-fd75-4a42-9720-cfd500d8da79" containerName="cleanup"
Sep 18 14:19:06.554239 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.554216    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.556453 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.556410    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-4ce51f-openshift-default-dockercfg-pkv25\""
Sep 18 14:19:06.565175 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.565149    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"]
Sep 18 14:19:06.673880 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.673834    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-socket\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674075 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.673887    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-envoy\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674075 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.673937    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-credential-socket\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674075 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.673962    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-certs\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674075 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.674058    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8a31e0-f55f-408c-8cf2-7ee741439697-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674248 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.674077    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8sw\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-kube-api-access-wr8sw\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674248 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.674100    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-token\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674248 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.674125    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-data\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.674248 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.674191    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-podinfo\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775278 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775246    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8a31e0-f55f-408c-8cf2-7ee741439697-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775278 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775280    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8sw\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-kube-api-access-wr8sw\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775303    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-token\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775326    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-data\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775351    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-podinfo\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775374    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-socket\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775400    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-envoy\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775491    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-credential-socket\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.775579 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775548    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-certs\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.776180 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775815    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-socket\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.776180 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775878    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-credential-socket\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.776180 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.775983    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-certs\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.776180 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.776081    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-data\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.776180 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.776112    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8a31e0-f55f-408c-8cf2-7ee741439697-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.777968 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.777952    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-envoy\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.778217 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.778192    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-podinfo\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.783895 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.783865    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-token\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.784014 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.783925    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8sw\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-kube-api-access-wr8sw\") pod \"e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") " pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:06.867609 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:06.867519    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:07.150729 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.150697    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"]
Sep 18 14:19:07.152452 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:19:07.152392    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8a31e0_f55f_408c_8cf2_7ee741439697.slice/crio-d83928d9685e1af90b7578416c8d1478a12e8dde2c058156fa073b2d68bad781 WatchSource:0}: Error finding container d83928d9685e1af90b7578416c8d1478a12e8dde2c058156fa073b2d68bad781: Status 404 returned error can't find the container with id d83928d9685e1af90b7578416c8d1478a12e8dde2c058156fa073b2d68bad781
Sep 18 14:19:07.154771 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.154740    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:19:07.154849 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.154810    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:19:07.154849 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.154843    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:19:07.796095 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.796057    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" event={"ID":"6e8a31e0-f55f-408c-8cf2-7ee741439697","Type":"ContainerStarted","Data":"9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"}
Sep 18 14:19:07.796609 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.796124    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" event={"ID":"6e8a31e0-f55f-408c-8cf2-7ee741439697","Type":"ContainerStarted","Data":"d83928d9685e1af90b7578416c8d1478a12e8dde2c058156fa073b2d68bad781"}
Sep 18 14:19:07.816720 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.816623    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podStartSLOduration=1.8166028170000001 podStartE2EDuration="1.816602817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:19:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:19:07.816469018 +0000 UTC m=+2058.316226540" watchObservedRunningTime="2026-09-18 14:19:07.816602817 +0000 UTC m=+2058.316360342"
Sep 18 14:19:07.868498 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:07.868460    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:08.874215 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:08.874181    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:09.808199 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:09.808155    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:09.809224 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:09.809205    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:14.028924 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.028887    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"]
Sep 18 14:19:14.032736 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.032703    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.035542 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.035514    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-4ce51f-dockercfg-nck7n\""
Sep 18 14:19:14.035675 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.035558    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-4ce51f\""
Sep 18 14:19:14.049945 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.048860    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"]
Sep 18 14:19:14.053948 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.053815    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-466vg\" (UniqueName: \"kubernetes.io/projected/cce914da-81ce-480c-ad57-0413477346ae-kube-api-access-466vg\") pod \"payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.054061 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.053954    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce914da-81ce-480c-ad57-0413477346ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.154721 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.154684    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-466vg\" (UniqueName: \"kubernetes.io/projected/cce914da-81ce-480c-ad57-0413477346ae-kube-api-access-466vg\") pod \"payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.154932 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.154765    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce914da-81ce-480c-ad57-0413477346ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.155770 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.155741    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce914da-81ce-480c-ad57-0413477346ae-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.165953 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.165918    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-466vg\" (UniqueName: \"kubernetes.io/projected/cce914da-81ce-480c-ad57-0413477346ae-kube-api-access-466vg\") pod \"payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.357804 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.357714    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.633160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.633123    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"]
Sep 18 14:19:14.635146 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:19:14.635121    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce914da_81ce_480c_ad57_0413477346ae.slice/crio-0dfc90a027b8cd0b99e9e9cea925de94f5f5d2e357e14b705149c9aecdb19791 WatchSource:0}: Error finding container 0dfc90a027b8cd0b99e9e9cea925de94f5f5d2e357e14b705149c9aecdb19791: Status 404 returned error can't find the container with id 0dfc90a027b8cd0b99e9e9cea925de94f5f5d2e357e14b705149c9aecdb19791
Sep 18 14:19:14.842494 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.842452    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp" event={"ID":"cce914da-81ce-480c-ad57-0413477346ae","Type":"ContainerStarted","Data":"98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4"}
Sep 18 14:19:14.842685 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.842512    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp" event={"ID":"cce914da-81ce-480c-ad57-0413477346ae","Type":"ContainerStarted","Data":"0dfc90a027b8cd0b99e9e9cea925de94f5f5d2e357e14b705149c9aecdb19791"}
Sep 18 14:19:14.842685 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.842551    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:14.858114 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:14.858045    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp" podStartSLOduration=0.857860079 podStartE2EDuration="857.860079ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:19:14.85710387 +0000 UTC m=+2065.356861386" watchObservedRunningTime="2026-09-18 14:19:14.857860079 +0000 UTC m=+2065.357617596"
Sep 18 14:19:18.883139 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:18.883105    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:19:25.851261 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:25.851177    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:28.928547 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:28.928512    2585 generic.go:356] "Generic (PLEG): container finished" podID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerID="9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0" exitCode=0
Sep 18 14:19:28.929071 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:28.928593    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" event={"ID":"6e8a31e0-f55f-408c-8cf2-7ee741439697","Type":"ContainerDied","Data":"9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"}
Sep 18 14:19:28.929177 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:28.929159    2585 scope.go:117] "RemoveContainer" containerID="9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"
Sep 18 14:19:28.930398 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:28.930369    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:19:28.930486 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:28.930456    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:19:28.930524 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:28.930488    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:19:29.937308 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:29.937275    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" event={"ID":"6e8a31e0-f55f-408c-8cf2-7ee741439697","Type":"ContainerStarted","Data":"f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48"}
Sep 18 14:19:30.867741 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:30.867695    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:30.868107 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:30.868078    2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 18 14:19:30.868220 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:30.868137    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 18 14:19:31.868619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:31.868573    2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 18 14:19:31.869196 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:31.868657    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 18 14:19:32.868685 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:32.868641    2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 18 14:19:32.869080 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:32.868721    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 18 14:19:33.868209 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:33.868170    2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 18 14:19:33.868394 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:33.868227    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 18 14:19:34.868021 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:34.867983    2585 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 18 14:19:34.868468 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:34.868040    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 18 14:19:35.872565 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:35.872535    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:35.872972 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:35.872818    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:35.873514 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:35.873498    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:19:40.486091 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.486056    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"]
Sep 18 14:19:40.488908 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.488890    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:40.491221 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.491196    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:19:40.498331 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.498302    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"]
Sep 18 14:19:40.642096 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.642053    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50258340-3666-4d5e-a773-014b53681f01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s\" (UID: \"50258340-3666-4d5e-a773-014b53681f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:40.743848 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.743757    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50258340-3666-4d5e-a773-014b53681f01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s\" (UID: \"50258340-3666-4d5e-a773-014b53681f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:40.744408 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.744387    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50258340-3666-4d5e-a773-014b53681f01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s\" (UID: \"50258340-3666-4d5e-a773-014b53681f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:40.801890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:40.801831    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:41.074755 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:41.074725    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"]
Sep 18 14:19:41.076599 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:19:41.076573    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50258340_3666_4d5e_a773_014b53681f01.slice/crio-8fb8b5452f30ef4307d12143bd7230ae227cd688a7ec3fc03a51405435f22d1a WatchSource:0}: Error finding container 8fb8b5452f30ef4307d12143bd7230ae227cd688a7ec3fc03a51405435f22d1a: Status 404 returned error can't find the container with id 8fb8b5452f30ef4307d12143bd7230ae227cd688a7ec3fc03a51405435f22d1a
Sep 18 14:19:42.009221 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:42.009190    2585 generic.go:356] "Generic (PLEG): container finished" podID="50258340-3666-4d5e-a773-014b53681f01" containerID="98c7ea622403970de7b5de0a98948b23ff0fc5ea14bc85de15a73c9c8796fe45" exitCode=0
Sep 18 14:19:42.009619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:42.009241    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s" event={"ID":"50258340-3666-4d5e-a773-014b53681f01","Type":"ContainerDied","Data":"98c7ea622403970de7b5de0a98948b23ff0fc5ea14bc85de15a73c9c8796fe45"}
Sep 18 14:19:42.009619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:42.009283    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s" event={"ID":"50258340-3666-4d5e-a773-014b53681f01","Type":"ContainerStarted","Data":"8fb8b5452f30ef4307d12143bd7230ae227cd688a7ec3fc03a51405435f22d1a"}
Sep 18 14:19:43.157517 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:43.157492    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:43.165730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:43.165705    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50258340-3666-4d5e-a773-014b53681f01-maas-api-service-ca\") pod \"50258340-3666-4d5e-a773-014b53681f01\" (UID: \"50258340-3666-4d5e-a773-014b53681f01\") "
Sep 18 14:19:43.166036 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:43.166016    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50258340-3666-4d5e-a773-014b53681f01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50258340-3666-4d5e-a773-014b53681f01" (UID: "50258340-3666-4d5e-a773-014b53681f01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:19:43.267572 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:43.267484    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50258340-3666-4d5e-a773-014b53681f01-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:19:44.020941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:44.020909    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"
Sep 18 14:19:44.021094 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:44.020955    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s" event={"ID":"50258340-3666-4d5e-a773-014b53681f01","Type":"ContainerDied","Data":"8fb8b5452f30ef4307d12143bd7230ae227cd688a7ec3fc03a51405435f22d1a"}
Sep 18 14:19:44.021094 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:44.020999    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fb8b5452f30ef4307d12143bd7230ae227cd688a7ec3fc03a51405435f22d1a"
Sep 18 14:19:51.792188 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:51.792154    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"]
Sep 18 14:19:51.792970 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:51.792915    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp" podUID="cce914da-81ce-480c-ad57-0413477346ae" containerName="payload-processing" containerID="cri-o://98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4" gracePeriod=30
Sep 18 14:19:51.793957 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:51.793935    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:19:51.800639 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:51.800617    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:19:52.060981 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.060947    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:52.062951 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.062924    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"]
Sep 18 14:19:52.066507 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.066480    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4ce51f-bwn7s"]
Sep 18 14:19:52.067928 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.067901    2585 generic.go:356] "Generic (PLEG): container finished" podID="cce914da-81ce-480c-ad57-0413477346ae" containerID="98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4" exitCode=0
Sep 18 14:19:52.068038 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.067947    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"
Sep 18 14:19:52.068038 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.067991    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp" event={"ID":"cce914da-81ce-480c-ad57-0413477346ae","Type":"ContainerDied","Data":"98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4"}
Sep 18 14:19:52.068132 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.068057    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp" event={"ID":"cce914da-81ce-480c-ad57-0413477346ae","Type":"ContainerDied","Data":"0dfc90a027b8cd0b99e9e9cea925de94f5f5d2e357e14b705149c9aecdb19791"}
Sep 18 14:19:52.068132 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.068091    2585 scope.go:117] "RemoveContainer" containerID="98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4"
Sep 18 14:19:52.081731 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.081301    2585 scope.go:117] "RemoveContainer" containerID="98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4"
Sep 18 14:19:52.081731 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:19:52.081676    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4\": container with ID starting with 98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4 not found: ID does not exist" containerID="98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4"
Sep 18 14:19:52.081731 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.081703    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4"} err="failed to get container status \"98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4\": rpc error: code = NotFound desc = could not find container \"98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4\": container with ID starting with 98385757a92c8f7b7d35b6c8c9b23a637b7fe32b8690ba84337718f4243f57f4 not found: ID does not exist"
Sep 18 14:19:52.156766 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.156732    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce914da-81ce-480c-ad57-0413477346ae-plugins-config-volume\") pod \"cce914da-81ce-480c-ad57-0413477346ae\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") "
Sep 18 14:19:52.156937 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.156851    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-466vg\" (UniqueName: \"kubernetes.io/projected/cce914da-81ce-480c-ad57-0413477346ae-kube-api-access-466vg\") pod \"cce914da-81ce-480c-ad57-0413477346ae\" (UID: \"cce914da-81ce-480c-ad57-0413477346ae\") "
Sep 18 14:19:52.157236 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.157211    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cce914da-81ce-480c-ad57-0413477346ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cce914da-81ce-480c-ad57-0413477346ae" (UID: "cce914da-81ce-480c-ad57-0413477346ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:19:52.157355 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.157343    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce914da-81ce-480c-ad57-0413477346ae-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:19:52.159188 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.159164    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce914da-81ce-480c-ad57-0413477346ae-kube-api-access-466vg" (OuterVolumeSpecName: "kube-api-access-466vg") pod "cce914da-81ce-480c-ad57-0413477346ae" (UID: "cce914da-81ce-480c-ad57-0413477346ae"). InnerVolumeSpecName "kube-api-access-466vg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:19:52.258694 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.258662    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-466vg\" (UniqueName: \"kubernetes.io/projected/cce914da-81ce-480c-ad57-0413477346ae-kube-api-access-466vg\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:19:52.271350 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.271321    2585 scope.go:117] "RemoveContainer" containerID="088250f48beb688e1997dd4d0ad7eecefe56e21359265915987b85f222602c69"
Sep 18 14:19:52.388301 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.388272    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"]
Sep 18 14:19:52.390647 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:52.390626    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp"]
Sep 18 14:19:53.641261 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:53.641221    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50258340-3666-4d5e-a773-014b53681f01" path="/var/lib/kubelet/pods/50258340-3666-4d5e-a773-014b53681f01/volumes"
Sep 18 14:19:53.641822 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:53.641801    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce914da-81ce-480c-ad57-0413477346ae" path="/var/lib/kubelet/pods/cce914da-81ce-480c-ad57-0413477346ae/volumes"
Sep 18 14:19:56.769326 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:56.769288    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:19:58.768389 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:58.768350    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"]
Sep 18 14:19:58.768889 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:19:58.768600    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy" containerID="cri-o://f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48" gracePeriod=30
Sep 18 14:20:02.270203 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270170    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"]
Sep 18 14:20:02.270740 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270723    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce914da-81ce-480c-ad57-0413477346ae" containerName="payload-processing"
Sep 18 14:20:02.270740 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270741    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce914da-81ce-480c-ad57-0413477346ae" containerName="payload-processing"
Sep 18 14:20:02.270867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270763    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50258340-3666-4d5e-a773-014b53681f01" containerName="revoke-keys"
Sep 18 14:20:02.270867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270770    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="50258340-3666-4d5e-a773-014b53681f01" containerName="revoke-keys"
Sep 18 14:20:02.270867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270848    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce914da-81ce-480c-ad57-0413477346ae" containerName="payload-processing"
Sep 18 14:20:02.270867 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.270859    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="50258340-3666-4d5e-a773-014b53681f01" containerName="revoke-keys"
Sep 18 14:20:02.274364 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.274347    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:02.276351 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.276333    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:20:02.280540 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.280518    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"]
Sep 18 14:20:02.360619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.360580    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1cc9ea-7a4e-4517-b651-24923bccf511-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq\" (UID: \"fd1cc9ea-7a4e-4517-b651-24923bccf511\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:02.462151 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.462111    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1cc9ea-7a4e-4517-b651-24923bccf511-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq\" (UID: \"fd1cc9ea-7a4e-4517-b651-24923bccf511\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:02.462806 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.462786    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1cc9ea-7a4e-4517-b651-24923bccf511-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq\" (UID: \"fd1cc9ea-7a4e-4517-b651-24923bccf511\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:02.587488 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.587375    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:02.863694 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:02.863664    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"]
Sep 18 14:20:02.865183 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:20:02.865154    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1cc9ea_7a4e_4517_b651_24923bccf511.slice/crio-847405b0b3064e4310e1c0b9adc9ab25b70391186b5b9c34c48363a22b8c9024 WatchSource:0}: Error finding container 847405b0b3064e4310e1c0b9adc9ab25b70391186b5b9c34c48363a22b8c9024: Status 404 returned error can't find the container with id 847405b0b3064e4310e1c0b9adc9ab25b70391186b5b9c34c48363a22b8c9024
Sep 18 14:20:03.135696 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:03.135657    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq" event={"ID":"fd1cc9ea-7a4e-4517-b651-24923bccf511","Type":"ContainerStarted","Data":"fb33370fbf631f0bd67edbe30638c389ff88b08f16854c180b8e0d6a32d96eba"}
Sep 18 14:20:03.135826 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:03.135710    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq" event={"ID":"fd1cc9ea-7a4e-4517-b651-24923bccf511","Type":"ContainerStarted","Data":"847405b0b3064e4310e1c0b9adc9ab25b70391186b5b9c34c48363a22b8c9024"}
Sep 18 14:20:03.151179 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:03.151133    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq" podStartSLOduration=1.151118636 podStartE2EDuration="1.151118636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:20:03.14973306 +0000 UTC m=+2113.649490590" watchObservedRunningTime="2026-09-18 14:20:03.151118636 +0000 UTC m=+2113.650876152"
Sep 18 14:20:04.030927 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.030855    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:20:04.143567 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.143532    2585 generic.go:356] "Generic (PLEG): container finished" podID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerID="f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48" exitCode=0
Sep 18 14:20:04.143762 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.143580    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"
Sep 18 14:20:04.143762 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.143619    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" event={"ID":"6e8a31e0-f55f-408c-8cf2-7ee741439697","Type":"ContainerDied","Data":"f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48"}
Sep 18 14:20:04.143762 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.143678    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw" event={"ID":"6e8a31e0-f55f-408c-8cf2-7ee741439697","Type":"ContainerDied","Data":"d83928d9685e1af90b7578416c8d1478a12e8dde2c058156fa073b2d68bad781"}
Sep 18 14:20:04.143762 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.143703    2585 scope.go:117] "RemoveContainer" containerID="f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48"
Sep 18 14:20:04.145531 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.145507    2585 generic.go:356] "Generic (PLEG): container finished" podID="fd1cc9ea-7a4e-4517-b651-24923bccf511" containerID="fb33370fbf631f0bd67edbe30638c389ff88b08f16854c180b8e0d6a32d96eba" exitCode=0
Sep 18 14:20:04.145646 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.145556    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq" event={"ID":"fd1cc9ea-7a4e-4517-b651-24923bccf511","Type":"ContainerDied","Data":"fb33370fbf631f0bd67edbe30638c389ff88b08f16854c180b8e0d6a32d96eba"}
Sep 18 14:20:04.153299 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.153283    2585 scope.go:117] "RemoveContainer" containerID="9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"
Sep 18 14:20:04.162142 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.162123    2585 scope.go:117] "RemoveContainer" containerID="f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48"
Sep 18 14:20:04.162450 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:20:04.162426    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48\": container with ID starting with f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48 not found: ID does not exist" containerID="f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48"
Sep 18 14:20:04.162511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.162460    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48"} err="failed to get container status \"f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48\": rpc error: code = NotFound desc = could not find container \"f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48\": container with ID starting with f612c401b0592a10da4b2707198b2c5a5bb72d24d34c61faee69ca4d96426f48 not found: ID does not exist"
Sep 18 14:20:04.162511 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.162484    2585 scope.go:117] "RemoveContainer" containerID="9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"
Sep 18 14:20:04.163678 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:20:04.162911    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0\": container with ID starting with 9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0 not found: ID does not exist" containerID="9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"
Sep 18 14:20:04.163793 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.163690    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0"} err="failed to get container status \"9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0\": rpc error: code = NotFound desc = could not find container \"9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0\": container with ID starting with 9d2e083770c658482033cd0fbed65e345df17ba38a88ab9ffa1590a4f2b60cb0 not found: ID does not exist"
Sep 18 14:20:04.177201 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177177    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr8sw\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-kube-api-access-wr8sw\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.177352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177213    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-credential-socket\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.177352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177234    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-socket\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.177352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177251    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-envoy\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.177352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177265    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-token\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.177352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177290    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-data\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.177352 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177324    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8a31e0-f55f-408c-8cf2-7ee741439697-istiod-ca-cert\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177457    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-podinfo\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177486    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-certs\") pod \"6e8a31e0-f55f-408c-8cf2-7ee741439697\" (UID: \"6e8a31e0-f55f-408c-8cf2-7ee741439697\") "
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177576    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177592    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177870    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8a31e0-f55f-408c-8cf2-7ee741439697-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177883    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.177903    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.178138 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.178112    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:04.179968 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.179945    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:04.181104 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.181066    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-kube-api-access-wr8sw" (OuterVolumeSpecName: "kube-api-access-wr8sw") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "kube-api-access-wr8sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:20:04.181746 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.181722    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:20:04.181883 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.181856    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:20:04.182562 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.182525    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e8a31e0-f55f-408c-8cf2-7ee741439697" (UID: "6e8a31e0-f55f-408c-8cf2-7ee741439697"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:04.278600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278559    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr8sw\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-kube-api-access-wr8sw\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.278600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278591    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.278600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278600    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.278600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278608    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.278868 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278616    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8a31e0-f55f-408c-8cf2-7ee741439697-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.278868 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278623    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8a31e0-f55f-408c-8cf2-7ee741439697-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.278868 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.278630    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8a31e0-f55f-408c-8cf2-7ee741439697-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:04.466045 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.466013    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"]
Sep 18 14:20:04.476060 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:04.476027    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw"]
Sep 18 14:20:05.294812 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:05.294789    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:05.391460 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:05.391380    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1cc9ea-7a4e-4517-b651-24923bccf511-maas-api-service-ca\") pod \"fd1cc9ea-7a4e-4517-b651-24923bccf511\" (UID: \"fd1cc9ea-7a4e-4517-b651-24923bccf511\") "
Sep 18 14:20:05.391730 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:05.391710    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd1cc9ea-7a4e-4517-b651-24923bccf511-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd1cc9ea-7a4e-4517-b651-24923bccf511" (UID: "fd1cc9ea-7a4e-4517-b651-24923bccf511"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:20:05.391803 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:05.391791    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1cc9ea-7a4e-4517-b651-24923bccf511-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:20:05.642030 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:05.641999    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" path="/var/lib/kubelet/pods/6e8a31e0-f55f-408c-8cf2-7ee741439697/volumes"
Sep 18 14:20:06.159600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:06.159571    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"
Sep 18 14:20:06.159777 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:06.159608    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq" event={"ID":"fd1cc9ea-7a4e-4517-b651-24923bccf511","Type":"ContainerDied","Data":"847405b0b3064e4310e1c0b9adc9ab25b70391186b5b9c34c48363a22b8c9024"}
Sep 18 14:20:06.159777 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:06.159651    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="847405b0b3064e4310e1c0b9adc9ab25b70391186b5b9c34c48363a22b8c9024"
Sep 18 14:20:15.578695 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:15.578657    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:20:18.033296 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:18.033249    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"]
Sep 18 14:20:18.040298 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:18.040270    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e8d773-r42wq"]
Sep 18 14:20:19.641702 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:19.641671    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1cc9ea-7a4e-4517-b651-24923bccf511" path="/var/lib/kubelet/pods/fd1cc9ea-7a4e-4517-b651-24923bccf511/volumes"
Sep 18 14:20:28.378665 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:28.378625    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:20:52.296553 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:52.296477    2585 scope.go:117] "RemoveContainer" containerID="6e2dd6ed742dfcd2434e3801488bb845233663470eccc661a70fce3215c5caf8"
Sep 18 14:20:57.291912 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.291881    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"]
Sep 18 14:20:57.292382 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292356    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1cc9ea-7a4e-4517-b651-24923bccf511" containerName="revoke-keys"
Sep 18 14:20:57.292382 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292374    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1cc9ea-7a4e-4517-b651-24923bccf511" containerName="revoke-keys"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292401    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292426    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292436    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292445    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292537    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292545    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1cc9ea-7a4e-4517-b651-24923bccf511" containerName="revoke-keys"
Sep 18 14:20:57.292561 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.292552    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8a31e0-f55f-408c-8cf2-7ee741439697" containerName="istio-proxy"
Sep 18 14:20:57.297365 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.297348    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:20:57.299710 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.299683    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:20:57.302810 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.302784    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"]
Sep 18 14:20:57.418291 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.418252    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a233e64-ba56-4466-896b-34ec6518b907-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5\" (UID: \"8a233e64-ba56-4466-896b-34ec6518b907\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:20:57.519626 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.519593    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a233e64-ba56-4466-896b-34ec6518b907-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5\" (UID: \"8a233e64-ba56-4466-896b-34ec6518b907\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:20:57.520227 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.520206    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a233e64-ba56-4466-896b-34ec6518b907-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5\" (UID: \"8a233e64-ba56-4466-896b-34ec6518b907\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:20:57.609881 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.609799    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:20:57.883013 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:57.882990    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"]
Sep 18 14:20:57.885079 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:20:57.885052    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a233e64_ba56_4466_896b_34ec6518b907.slice/crio-52e84c3a068bc109f4e33aebc54e0fad868c9dce7ea05fa3c3bf7b1ac7e8be0a WatchSource:0}: Error finding container 52e84c3a068bc109f4e33aebc54e0fad868c9dce7ea05fa3c3bf7b1ac7e8be0a: Status 404 returned error can't find the container with id 52e84c3a068bc109f4e33aebc54e0fad868c9dce7ea05fa3c3bf7b1ac7e8be0a
Sep 18 14:20:58.469684 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:58.469586    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5" event={"ID":"8a233e64-ba56-4466-896b-34ec6518b907","Type":"ContainerStarted","Data":"484653473ffe7750e3163e26452a34c29f92e86d772dbe8c28cfac3d871d2610"}
Sep 18 14:20:58.469684 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:58.469649    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5" event={"ID":"8a233e64-ba56-4466-896b-34ec6518b907","Type":"ContainerStarted","Data":"52e84c3a068bc109f4e33aebc54e0fad868c9dce7ea05fa3c3bf7b1ac7e8be0a"}
Sep 18 14:20:58.485309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:58.485263    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5" podStartSLOduration=1.485247092 podStartE2EDuration="1.485247092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:20:58.483682261 +0000 UTC m=+2168.983439780" watchObservedRunningTime="2026-09-18 14:20:58.485247092 +0000 UTC m=+2168.985004608"
Sep 18 14:20:59.476798 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:59.476759    2585 generic.go:356] "Generic (PLEG): container finished" podID="8a233e64-ba56-4466-896b-34ec6518b907" containerID="484653473ffe7750e3163e26452a34c29f92e86d772dbe8c28cfac3d871d2610" exitCode=0
Sep 18 14:20:59.477345 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:20:59.476846    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5" event={"ID":"8a233e64-ba56-4466-896b-34ec6518b907","Type":"ContainerDied","Data":"484653473ffe7750e3163e26452a34c29f92e86d772dbe8c28cfac3d871d2610"}
Sep 18 14:21:00.627832 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:00.627804    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:21:00.650567 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:00.650538    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a233e64-ba56-4466-896b-34ec6518b907-maas-api-service-ca\") pod \"8a233e64-ba56-4466-896b-34ec6518b907\" (UID: \"8a233e64-ba56-4466-896b-34ec6518b907\") "
Sep 18 14:21:00.650994 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:00.650963    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a233e64-ba56-4466-896b-34ec6518b907-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a233e64-ba56-4466-896b-34ec6518b907" (UID: "8a233e64-ba56-4466-896b-34ec6518b907"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:00.751717 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:00.751625    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a233e64-ba56-4466-896b-34ec6518b907-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:01.489906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:01.489875    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5" event={"ID":"8a233e64-ba56-4466-896b-34ec6518b907","Type":"ContainerDied","Data":"52e84c3a068bc109f4e33aebc54e0fad868c9dce7ea05fa3c3bf7b1ac7e8be0a"}
Sep 18 14:21:01.489906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:01.489909    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"
Sep 18 14:21:01.489906 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:01.489920    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52e84c3a068bc109f4e33aebc54e0fad868c9dce7ea05fa3c3bf7b1ac7e8be0a"
Sep 18 14:21:08.087034 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:08.086994    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"]
Sep 18 14:21:08.089747 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:08.089723    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a035eb-x4xt5"]
Sep 18 14:21:09.640648 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:09.640613    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a233e64-ba56-4466-896b-34ec6518b907" path="/var/lib/kubelet/pods/8a233e64-ba56-4466-896b-34ec6518b907/volumes"
Sep 18 14:21:10.977100 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:10.977063    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:21:15.324448 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.321890    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"]
Sep 18 14:21:15.324448 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.322982    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a233e64-ba56-4466-896b-34ec6518b907" containerName="revoke-keys"
Sep 18 14:21:15.324448 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.323014    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a233e64-ba56-4466-896b-34ec6518b907" containerName="revoke-keys"
Sep 18 14:21:15.324448 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.323268    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a233e64-ba56-4466-896b-34ec6518b907" containerName="revoke-keys"
Sep 18 14:21:15.327958 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.327928    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:15.330968 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.330750    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:21:15.331542 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.331517    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"]
Sep 18 14:21:15.400520 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.400485    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb\" (UID: \"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:15.501552 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.501510    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb\" (UID: \"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:15.502149 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.502127    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb\" (UID: \"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:15.641176 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.641075    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:15.917184 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:15.917155    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"]
Sep 18 14:21:15.919627 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:21:15.919600    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcecb033_10fe_44eb_b6d8_ce62cc1b3ec9.slice/crio-d79f147ff3c2402a30c2862e954a32aca1b282d9be89b7101d8bc32d652f352d WatchSource:0}: Error finding container d79f147ff3c2402a30c2862e954a32aca1b282d9be89b7101d8bc32d652f352d: Status 404 returned error can't find the container with id d79f147ff3c2402a30c2862e954a32aca1b282d9be89b7101d8bc32d652f352d
Sep 18 14:21:16.575112 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:16.575080    2585 generic.go:356] "Generic (PLEG): container finished" podID="fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9" containerID="c3058ea2d1ecdd49c5408149b59a5dc79c7ff627321f4380d9530afc3b5b0d39" exitCode=0
Sep 18 14:21:16.575490 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:16.575170    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb" event={"ID":"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9","Type":"ContainerDied","Data":"c3058ea2d1ecdd49c5408149b59a5dc79c7ff627321f4380d9530afc3b5b0d39"}
Sep 18 14:21:16.575490 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:16.575234    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb" event={"ID":"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9","Type":"ContainerStarted","Data":"d79f147ff3c2402a30c2862e954a32aca1b282d9be89b7101d8bc32d652f352d"}
Sep 18 14:21:17.724226 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:17.724199    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:17.824761 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:17.824717    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9-maas-api-service-ca\") pod \"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9\" (UID: \"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9\") "
Sep 18 14:21:17.825086 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:17.825064    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9" (UID: "fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:17.925605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:17.925561    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9-maas-api-service-ca\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:18.587608 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:18.587576    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"
Sep 18 14:21:18.587770 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:18.587604    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb" event={"ID":"fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9","Type":"ContainerDied","Data":"d79f147ff3c2402a30c2862e954a32aca1b282d9be89b7101d8bc32d652f352d"}
Sep 18 14:21:18.587770 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:18.587656    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d79f147ff3c2402a30c2862e954a32aca1b282d9be89b7101d8bc32d652f352d"
Sep 18 14:21:26.018640 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.018602    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"]
Sep 18 14:21:26.020900 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.020874    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d25bfb-29829015-tcz48"]
Sep 18 14:21:26.041079 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.041051    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"]
Sep 18 14:21:26.041307 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.041264    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv" podUID="21b6ce03-8591-451a-8e1e-e4d41929f189" containerName="payload-processing" containerID="cri-o://40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29" gracePeriod=30
Sep 18 14:21:26.050597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.050550    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"]
Sep 18 14:21:26.050845 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.050785    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5" podUID="4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" containerName="payload-pre-processing" containerID="cri-o://c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9" gracePeriod=30
Sep 18 14:21:26.231336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.231298    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"]
Sep 18 14:21:26.234846 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.234816    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d25bfb-xcvqb"]
Sep 18 14:21:26.328768 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.328743    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:21:26.331685 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.331668    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:21:26.409817 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.409725    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z8kg\" (UniqueName: \"kubernetes.io/projected/21b6ce03-8591-451a-8e1e-e4d41929f189-kube-api-access-2z8kg\") pod \"21b6ce03-8591-451a-8e1e-e4d41929f189\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") "
Sep 18 14:21:26.410011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.409877    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdls5\" (UniqueName: \"kubernetes.io/projected/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-kube-api-access-vdls5\") pod \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") "
Sep 18 14:21:26.410011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.409928    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-plugins-config-volume\") pod \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\" (UID: \"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913\") "
Sep 18 14:21:26.410011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.410004    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21b6ce03-8591-451a-8e1e-e4d41929f189-plugins-config-volume\") pod \"21b6ce03-8591-451a-8e1e-e4d41929f189\" (UID: \"21b6ce03-8591-451a-8e1e-e4d41929f189\") "
Sep 18 14:21:26.410395 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.410366    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21b6ce03-8591-451a-8e1e-e4d41929f189-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21b6ce03-8591-451a-8e1e-e4d41929f189" (UID: "21b6ce03-8591-451a-8e1e-e4d41929f189"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:26.410395 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.410377    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" (UID: "4f2d60c3-fe6d-4c6c-95ab-bfcc90403913"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:26.411936 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.411911    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b6ce03-8591-451a-8e1e-e4d41929f189-kube-api-access-2z8kg" (OuterVolumeSpecName: "kube-api-access-2z8kg") pod "21b6ce03-8591-451a-8e1e-e4d41929f189" (UID: "21b6ce03-8591-451a-8e1e-e4d41929f189"). InnerVolumeSpecName "kube-api-access-2z8kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:26.412087 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.412074    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-kube-api-access-vdls5" (OuterVolumeSpecName: "kube-api-access-vdls5") pod "4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" (UID: "4f2d60c3-fe6d-4c6c-95ab-bfcc90403913"). InnerVolumeSpecName "kube-api-access-vdls5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:26.511206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.511168    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdls5\" (UniqueName: \"kubernetes.io/projected/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-kube-api-access-vdls5\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.511206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.511198    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.511206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.511209    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21b6ce03-8591-451a-8e1e-e4d41929f189-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.511206 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.511217    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z8kg\" (UniqueName: \"kubernetes.io/projected/21b6ce03-8591-451a-8e1e-e4d41929f189-kube-api-access-2z8kg\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.641335 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.641250    2585 generic.go:356] "Generic (PLEG): container finished" podID="21b6ce03-8591-451a-8e1e-e4d41929f189" containerID="40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29" exitCode=0
Sep 18 14:21:26.641335 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.641293    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"
Sep 18 14:21:26.641610 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.641339    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv" event={"ID":"21b6ce03-8591-451a-8e1e-e4d41929f189","Type":"ContainerDied","Data":"40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29"}
Sep 18 14:21:26.641610 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.641392    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv" event={"ID":"21b6ce03-8591-451a-8e1e-e4d41929f189","Type":"ContainerDied","Data":"d924887426a9800baab946d229615d85ec31244a5cf008e2dca717ac6a906989"}
Sep 18 14:21:26.641610 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.641450    2585 scope.go:117] "RemoveContainer" containerID="40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29"
Sep 18 14:21:26.642817 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.642788    2585 generic.go:356] "Generic (PLEG): container finished" podID="4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" containerID="c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9" exitCode=0
Sep 18 14:21:26.642941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.642840    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"
Sep 18 14:21:26.642941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.642871    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5" event={"ID":"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913","Type":"ContainerDied","Data":"c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9"}
Sep 18 14:21:26.642941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.642919    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5" event={"ID":"4f2d60c3-fe6d-4c6c-95ab-bfcc90403913","Type":"ContainerDied","Data":"9dcba447a9590ad450f35c23944f931ab55c75dd0d4b1f58b1cc99710964f1c9"}
Sep 18 14:21:26.651745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.651703    2585 scope.go:117] "RemoveContainer" containerID="40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29"
Sep 18 14:21:26.652103 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:21:26.652023    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29\": container with ID starting with 40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29 not found: ID does not exist" containerID="40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29"
Sep 18 14:21:26.652103 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.652054    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29"} err="failed to get container status \"40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29\": rpc error: code = NotFound desc = could not find container \"40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29\": container with ID starting with 40842769182e6c5242986a716159cf91224e96660dac75ab5619d60111999d29 not found: ID does not exist"
Sep 18 14:21:26.652103 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.652076    2585 scope.go:117] "RemoveContainer" containerID="c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9"
Sep 18 14:21:26.661473 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.661456    2585 scope.go:117] "RemoveContainer" containerID="c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9"
Sep 18 14:21:26.661748 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:21:26.661727    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9\": container with ID starting with c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9 not found: ID does not exist" containerID="c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9"
Sep 18 14:21:26.661843 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.661754    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9"} err="failed to get container status \"c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9\": rpc error: code = NotFound desc = could not find container \"c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9\": container with ID starting with c051a860682580e80a6f487f2c38991a134fdfc60657892c90c2c431f42b2fb9 not found: ID does not exist"
Sep 18 14:21:26.668376 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.668351    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"]
Sep 18 14:21:26.670888 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.670865    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv"]
Sep 18 14:21:26.682225 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.682197    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"]
Sep 18 14:21:26.685794 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:26.685770    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5"]
Sep 18 14:21:27.640578 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:27.640549    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21b6ce03-8591-451a-8e1e-e4d41929f189" path="/var/lib/kubelet/pods/21b6ce03-8591-451a-8e1e-e4d41929f189/volumes"
Sep 18 14:21:27.640970 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:27.640851    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be66984-fd75-4a42-9720-cfd500d8da79" path="/var/lib/kubelet/pods/2be66984-fd75-4a42-9720-cfd500d8da79/volumes"
Sep 18 14:21:27.641160 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:27.641146    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" path="/var/lib/kubelet/pods/4f2d60c3-fe6d-4c6c-95ab-bfcc90403913/volumes"
Sep 18 14:21:27.641482 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:27.641468    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9" path="/var/lib/kubelet/pods/fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9/volumes"
Sep 18 14:21:28.779693 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:28.779654    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:21:33.178380 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:33.178339    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"]
Sep 18 14:21:33.178943 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:33.178629    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy" containerID="cri-o://25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc" gracePeriod=30
Sep 18 14:21:38.445450 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.445365    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:21:38.522624 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522591    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06707cc-b680-4715-9a2b-16a7c7955070-istio-podinfo\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522624 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522627    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brtmk\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-kube-api-access-brtmk\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522656    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-envoy\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522672    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06707cc-b680-4715-9a2b-16a7c7955070-istiod-ca-cert\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522713    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-istio-token\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522744    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-credential-socket\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522772    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-data\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522803    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-socket\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.522890 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.522830    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-certs\") pod \"b06707cc-b680-4715-9a2b-16a7c7955070\" (UID: \"b06707cc-b680-4715-9a2b-16a7c7955070\") "
Sep 18 14:21:38.523252 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.523088    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:38.523309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.523229    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-data" (OuterVolumeSpecName: "istio-data") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:38.523309 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.523257    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06707cc-b680-4715-9a2b-16a7c7955070-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:38.523603 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.523317    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:38.523603 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.523330    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:38.525057 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.525031    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:38.525345 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.525321    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-istio-token" (OuterVolumeSpecName: "istio-token") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:38.525581 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.525559    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b06707cc-b680-4715-9a2b-16a7c7955070-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:21:38.525581 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.525570    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-kube-api-access-brtmk" (OuterVolumeSpecName: "kube-api-access-brtmk") pod "b06707cc-b680-4715-9a2b-16a7c7955070" (UID: "b06707cc-b680-4715-9a2b-16a7c7955070"). InnerVolumeSpecName "kube-api-access-brtmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:38.624508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624461    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06707cc-b680-4715-9a2b-16a7c7955070-istio-podinfo\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624502    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brtmk\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-kube-api-access-brtmk\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624513    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-envoy\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624522    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06707cc-b680-4715-9a2b-16a7c7955070-istiod-ca-cert\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624508 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624529    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06707cc-b680-4715-9a2b-16a7c7955070-istio-token\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624537    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-credential-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624547    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-istio-data\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624557    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-socket\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.624823 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.624564    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06707cc-b680-4715-9a2b-16a7c7955070-workload-certs\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:38.714821 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.714730    2585 generic.go:356] "Generic (PLEG): container finished" podID="b06707cc-b680-4715-9a2b-16a7c7955070" containerID="25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc" exitCode=0
Sep 18 14:21:38.714821 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.714784    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"
Sep 18 14:21:38.715012 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.714823    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" event={"ID":"b06707cc-b680-4715-9a2b-16a7c7955070","Type":"ContainerDied","Data":"25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc"}
Sep 18 14:21:38.715012 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.714878    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh" event={"ID":"b06707cc-b680-4715-9a2b-16a7c7955070","Type":"ContainerDied","Data":"1439a3a0348505c755f3c34d09390586f1368929da6e1c7a6481641a0767e6a0"}
Sep 18 14:21:38.715012 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.714900    2585 scope.go:117] "RemoveContainer" containerID="25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc"
Sep 18 14:21:38.724897 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.724877    2585 scope.go:117] "RemoveContainer" containerID="e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"
Sep 18 14:21:38.733996 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.733943    2585 scope.go:117] "RemoveContainer" containerID="25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc"
Sep 18 14:21:38.734474 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:21:38.734449    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc\": container with ID starting with 25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc not found: ID does not exist" containerID="25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc"
Sep 18 14:21:38.734606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.734485    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc"} err="failed to get container status \"25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc\": rpc error: code = NotFound desc = could not find container \"25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc\": container with ID starting with 25513f63e2e9f2901244a8273c707f43428955373250ea503353c47b22c912bc not found: ID does not exist"
Sep 18 14:21:38.734606 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.734515    2585 scope.go:117] "RemoveContainer" containerID="e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"
Sep 18 14:21:38.734835 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:21:38.734819    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f\": container with ID starting with e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f not found: ID does not exist" containerID="e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"
Sep 18 14:21:38.734903 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.734844    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f"} err="failed to get container status \"e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f\": rpc error: code = NotFound desc = could not find container \"e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f\": container with ID starting with e1aba4a7871f60a986e00e8662bcf08b6da4d8fb21611b45617aa3687840483f not found: ID does not exist"
Sep 18 14:21:38.736602 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.736582    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"]
Sep 18 14:21:38.740979 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:38.740952    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh"]
Sep 18 14:21:39.641024 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:39.640992    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" path="/var/lib/kubelet/pods/b06707cc-b680-4715-9a2b-16a7c7955070/volumes"
Sep 18 14:21:44.153623 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.153587    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"]
Sep 18 14:21:44.154155 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.153862    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx" podUID="ab386c1b-7c9c-40f8-9992-46a99b6af22b" containerName="payload-processing" containerID="cri-o://f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06" gracePeriod=30
Sep 18 14:21:44.162591 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.162563    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"]
Sep 18 14:21:44.162832 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.162804    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c" podUID="74bfa6b6-6017-4d0e-b7c1-46478648966a" containerName="payload-pre-processing" containerID="cri-o://022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97" gracePeriod=30
Sep 18 14:21:44.443680 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.443654    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:21:44.446894 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.446871    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:21:44.474095 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.474058    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5dlq\" (UniqueName: \"kubernetes.io/projected/74bfa6b6-6017-4d0e-b7c1-46478648966a-kube-api-access-d5dlq\") pod \"74bfa6b6-6017-4d0e-b7c1-46478648966a\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") "
Sep 18 14:21:44.474278 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.474129    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjjrw\" (UniqueName: \"kubernetes.io/projected/ab386c1b-7c9c-40f8-9992-46a99b6af22b-kube-api-access-kjjrw\") pod \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") "
Sep 18 14:21:44.474278 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.474184    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab386c1b-7c9c-40f8-9992-46a99b6af22b-plugins-config-volume\") pod \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\" (UID: \"ab386c1b-7c9c-40f8-9992-46a99b6af22b\") "
Sep 18 14:21:44.474278 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.474212    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bfa6b6-6017-4d0e-b7c1-46478648966a-plugins-config-volume\") pod \"74bfa6b6-6017-4d0e-b7c1-46478648966a\" (UID: \"74bfa6b6-6017-4d0e-b7c1-46478648966a\") "
Sep 18 14:21:44.474597 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.474568    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab386c1b-7c9c-40f8-9992-46a99b6af22b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab386c1b-7c9c-40f8-9992-46a99b6af22b" (UID: "ab386c1b-7c9c-40f8-9992-46a99b6af22b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:44.474991 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.474957    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74bfa6b6-6017-4d0e-b7c1-46478648966a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74bfa6b6-6017-4d0e-b7c1-46478648966a" (UID: "74bfa6b6-6017-4d0e-b7c1-46478648966a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:44.475340 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.475273    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab386c1b-7c9c-40f8-9992-46a99b6af22b-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:44.475340 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.475300    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bfa6b6-6017-4d0e-b7c1-46478648966a-plugins-config-volume\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:44.477789 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.477762    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74bfa6b6-6017-4d0e-b7c1-46478648966a-kube-api-access-d5dlq" (OuterVolumeSpecName: "kube-api-access-d5dlq") pod "74bfa6b6-6017-4d0e-b7c1-46478648966a" (UID: "74bfa6b6-6017-4d0e-b7c1-46478648966a"). InnerVolumeSpecName "kube-api-access-d5dlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:44.477903 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.477873    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab386c1b-7c9c-40f8-9992-46a99b6af22b-kube-api-access-kjjrw" (OuterVolumeSpecName: "kube-api-access-kjjrw") pod "ab386c1b-7c9c-40f8-9992-46a99b6af22b" (UID: "ab386c1b-7c9c-40f8-9992-46a99b6af22b"). InnerVolumeSpecName "kube-api-access-kjjrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:44.575802 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.575762    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5dlq\" (UniqueName: \"kubernetes.io/projected/74bfa6b6-6017-4d0e-b7c1-46478648966a-kube-api-access-d5dlq\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:44.575802 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.575794    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjjrw\" (UniqueName: \"kubernetes.io/projected/ab386c1b-7c9c-40f8-9992-46a99b6af22b-kube-api-access-kjjrw\") on node \"ip-10-0-132-83.ec2.internal\" DevicePath \"\""
Sep 18 14:21:44.751137 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.751100    2585 generic.go:356] "Generic (PLEG): container finished" podID="74bfa6b6-6017-4d0e-b7c1-46478648966a" containerID="022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97" exitCode=0
Sep 18 14:21:44.751336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.751143    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"
Sep 18 14:21:44.751336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.751194    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c" event={"ID":"74bfa6b6-6017-4d0e-b7c1-46478648966a","Type":"ContainerDied","Data":"022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97"}
Sep 18 14:21:44.751336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.751254    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c" event={"ID":"74bfa6b6-6017-4d0e-b7c1-46478648966a","Type":"ContainerDied","Data":"d30e16be3168577e5b5cc304570fa874aa676391d244ba7a502d8aebdf640e1b"}
Sep 18 14:21:44.751336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.751275    2585 scope.go:117] "RemoveContainer" containerID="022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97"
Sep 18 14:21:44.752664 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.752636    2585 generic.go:356] "Generic (PLEG): container finished" podID="ab386c1b-7c9c-40f8-9992-46a99b6af22b" containerID="f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06" exitCode=0
Sep 18 14:21:44.752793 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.752689    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"
Sep 18 14:21:44.752793 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.752706    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx" event={"ID":"ab386c1b-7c9c-40f8-9992-46a99b6af22b","Type":"ContainerDied","Data":"f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06"}
Sep 18 14:21:44.752793 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.752759    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx" event={"ID":"ab386c1b-7c9c-40f8-9992-46a99b6af22b","Type":"ContainerDied","Data":"9a7dbc06597c84d84159e1d813a361c197f70ff2663e57cc50e6d3ce43738210"}
Sep 18 14:21:44.763061 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.763038    2585 scope.go:117] "RemoveContainer" containerID="022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97"
Sep 18 14:21:44.763459 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:21:44.763383    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97\": container with ID starting with 022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97 not found: ID does not exist" containerID="022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97"
Sep 18 14:21:44.763459 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.763445    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97"} err="failed to get container status \"022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97\": rpc error: code = NotFound desc = could not find container \"022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97\": container with ID starting with 022d7aeab9a28c8c48b7124db07885a43fddbc4e5ee92650cf6f9d8aa041ca97 not found: ID does not exist"
Sep 18 14:21:44.763629 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.763469    2585 scope.go:117] "RemoveContainer" containerID="f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06"
Sep 18 14:21:44.772458 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.772403    2585 scope.go:117] "RemoveContainer" containerID="f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06"
Sep 18 14:21:44.773011 ip-10-0-132-83 kubenswrapper[2585]: E0918 14:21:44.772973    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06\": container with ID starting with f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06 not found: ID does not exist" containerID="f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06"
Sep 18 14:21:44.773088 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.773021    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06"} err="failed to get container status \"f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06\": rpc error: code = NotFound desc = could not find container \"f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06\": container with ID starting with f903eaf9eaf21454caf9c85822aa623747b4d38f7fd33a28b86652bdda52fa06 not found: ID does not exist"
Sep 18 14:21:44.774915 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.774896    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"]
Sep 18 14:21:44.781718 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.781694    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c"]
Sep 18 14:21:44.792714 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.792690    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"]
Sep 18 14:21:44.799453 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:44.799408    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx"]
Sep 18 14:21:45.641079 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:45.641045    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74bfa6b6-6017-4d0e-b7c1-46478648966a" path="/var/lib/kubelet/pods/74bfa6b6-6017-4d0e-b7c1-46478648966a/volumes"
Sep 18 14:21:45.641492 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:45.641428    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab386c1b-7c9c-40f8-9992-46a99b6af22b" path="/var/lib/kubelet/pods/ab386c1b-7c9c-40f8-9992-46a99b6af22b/volumes"
Sep 18 14:21:46.479648 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:46.479606    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:21:52.323025 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:52.322989    2585 scope.go:117] "RemoveContainer" containerID="ddfa19f04a7206d5641262f74edcc8e03c609d4d9bf8330a53e2c5f3d30a72d4"
Sep 18 14:21:56.873215 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:21:56.873178    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:23:18.065255 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:23:18.065205    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:06.877761 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:06.877725    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:14.274962 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:14.274928    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:21.077938 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:21.077897    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:28.084749 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:28.084709    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:35.269188 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:35.269151    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:44.281110 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:44.281070    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:24:51.837482 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:51.837456    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:24:51.846029 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:51.846006    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl6p5_343cb484-d3fa-4680-b8dc-5a8be1ed523e/ovn-acl-logging/0.log"
Sep 18 14:24:52.469507 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:24:52.469470    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:25:52.393336 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:25:52.393306    2585 scope.go:117] "RemoveContainer" containerID="98c7ea622403970de7b5de0a98948b23ff0fc5ea14bc85de15a73c9c8796fe45"
Sep 18 14:26:20.964293 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:26:20.964253    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:26:27.571592 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:26:27.571550    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:26:34.678714 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:26:34.678635    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:26:52.414589 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:26:52.414555    2585 scope.go:117] "RemoveContainer" containerID="fb33370fbf631f0bd67edbe30638c389ff88b08f16854c180b8e0d6a32d96eba"
Sep 18 14:27:08.480591 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:08.480550    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:27:17.467539 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:17.467497    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:27:44.075049 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:44.075011    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:27:51.966255 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:51.966218    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:27:52.437568 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:52.437534    2585 scope.go:117] "RemoveContainer" containerID="c3058ea2d1ecdd49c5408149b59a5dc79c7ff627321f4380d9530afc3b5b0d39"
Sep 18 14:27:52.446697 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:52.446676    2585 scope.go:117] "RemoveContainer" containerID="484653473ffe7750e3163e26452a34c29f92e86d772dbe8c28cfac3d871d2610"
Sep 18 14:27:59.678306 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:27:59.678260    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:28:07.766941 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:07.766858    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:28:14.876826 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:14.876789    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:28:22.672862 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:22.672824    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:28:27.076337 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:27.076289    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-bkfdg"]
Sep 18 14:28:34.712150 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:34.712121    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7ll9m_e9a20003-2003-42ed-b83d-c65844bffee3/manager/0.log"
Sep 18 14:28:35.184008 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:35.183980    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ksxrr_6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548/manager/0.log"
Sep 18 14:28:35.527789 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:35.527711    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-thpx8_68ea6f09-8002-47b7-ab3a-a54ee263dc04/copy-manifests/0.log"
Sep 18 14:28:35.540351 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:35.540322    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-thpx8_68ea6f09-8002-47b7-ab3a-a54ee263dc04/manager/0.log"
Sep 18 14:28:36.078467 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:36.078410    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829000-l64z5_1bb8f011-90b4-473e-84ad-12af78fa38f3/cleanup/0.log"
Sep 18 14:28:36.183567 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:36.183536    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829015-pqfcw_95edbab1-9690-42e3-a4c3-516e36af68f0/cleanup/0.log"
Sep 18 14:28:36.290375 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:36.290345    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-g9mcx_92694f8a-54f9-4526-9806-54d4d804eac8/postgres/0.log"
Sep 18 14:28:37.652316 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:37.652289    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-bkfdg_49810666-cb3c-4a79-a030-83e78aeb5b7c/limitador/0.log"
Sep 18 14:28:37.767122 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:37.767091    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-snjlp_9cada3d3-d5b3-4873-9847-833f730f873b/manager/0.log"
Sep 18 14:28:38.570887 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:38.570854    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/1.log"
Sep 18 14:28:38.696292 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:38.696259    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7tzk2_48cf3aef-a227-4491-8f30-5c0cba76fe84/payload-pre-processing/0.log"
Sep 18 14:28:38.822315 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:38.822242    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z44zd_1e2d11ab-7c5b-462b-a830-c9f669899f7b/payload-processing/0.log"
Sep 18 14:28:39.953733 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:39.953695    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-r6vt8_05131a8b-0819-4130-bed9-2eeda37f7219/main/0.log"
Sep 18 14:28:40.900910 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:40.900882    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rcsrb_3f93e9f0-1977-4bf3-aff3-baa5e3dbeedf/main/0.log"
Sep 18 14:28:46.195904 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.195868    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkp9v/must-gather-qxtx9"]
Sep 18 14:28:46.196287 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196273    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b6ce03-8591-451a-8e1e-e4d41929f189" containerName="payload-processing"
Sep 18 14:28:46.196287 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196288    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b6ce03-8591-451a-8e1e-e4d41929f189" containerName="payload-processing"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196298    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196304    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196313    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab386c1b-7c9c-40f8-9992-46a99b6af22b" containerName="payload-processing"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196318    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab386c1b-7c9c-40f8-9992-46a99b6af22b" containerName="payload-processing"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196326    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" containerName="payload-pre-processing"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196331    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" containerName="payload-pre-processing"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196342    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196347    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196353    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9" containerName="revoke-keys"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196358    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9" containerName="revoke-keys"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196364    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bfa6b6-6017-4d0e-b7c1-46478648966a" containerName="payload-pre-processing"
Sep 18 14:28:46.196367 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196370    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bfa6b6-6017-4d0e-b7c1-46478648966a" containerName="payload-pre-processing"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196448    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2d60c3-fe6d-4c6c-95ab-bfcc90403913" containerName="payload-pre-processing"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196456    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="21b6ce03-8591-451a-8e1e-e4d41929f189" containerName="payload-processing"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196464    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="74bfa6b6-6017-4d0e-b7c1-46478648966a" containerName="payload-pre-processing"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196471    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196476    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06707cc-b680-4715-9a2b-16a7c7955070" containerName="istio-proxy"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196483    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcecb033-10fe-44eb-b6d8-ce62cc1b3ec9" containerName="revoke-keys"
Sep 18 14:28:46.196775 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.196490    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab386c1b-7c9c-40f8-9992-46a99b6af22b" containerName="payload-processing"
Sep 18 14:28:46.199691 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.199676    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.202782 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.202761    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pkp9v\"/\"default-dockercfg-5xwr9\""
Sep 18 14:28:46.203354 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.203338    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkp9v\"/\"kube-root-ca.crt\""
Sep 18 14:28:46.203484 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.203376    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkp9v\"/\"openshift-service-ca.crt\""
Sep 18 14:28:46.210327 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.210307    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkp9v/must-gather-qxtx9"]
Sep 18 14:28:46.298503 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.298476    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5a7e15c1-ae3a-4481-880e-ab5127d744b2-must-gather-output\") pod \"must-gather-qxtx9\" (UID: \"5a7e15c1-ae3a-4481-880e-ab5127d744b2\") " pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.298667 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.298511    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9n86\" (UniqueName: \"kubernetes.io/projected/5a7e15c1-ae3a-4481-880e-ab5127d744b2-kube-api-access-s9n86\") pod \"must-gather-qxtx9\" (UID: \"5a7e15c1-ae3a-4481-880e-ab5127d744b2\") " pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.399279 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.399249    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5a7e15c1-ae3a-4481-880e-ab5127d744b2-must-gather-output\") pod \"must-gather-qxtx9\" (UID: \"5a7e15c1-ae3a-4481-880e-ab5127d744b2\") " pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.399469 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.399286    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9n86\" (UniqueName: \"kubernetes.io/projected/5a7e15c1-ae3a-4481-880e-ab5127d744b2-kube-api-access-s9n86\") pod \"must-gather-qxtx9\" (UID: \"5a7e15c1-ae3a-4481-880e-ab5127d744b2\") " pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.399607 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.399587    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5a7e15c1-ae3a-4481-880e-ab5127d744b2-must-gather-output\") pod \"must-gather-qxtx9\" (UID: \"5a7e15c1-ae3a-4481-880e-ab5127d744b2\") " pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.408547 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.408524    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9n86\" (UniqueName: \"kubernetes.io/projected/5a7e15c1-ae3a-4481-880e-ab5127d744b2-kube-api-access-s9n86\") pod \"must-gather-qxtx9\" (UID: \"5a7e15c1-ae3a-4481-880e-ab5127d744b2\") " pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.509228 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.509140    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkp9v/must-gather-qxtx9"
Sep 18 14:28:46.783372 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.783346    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkp9v/must-gather-qxtx9"]
Sep 18 14:28:46.785950 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:28:46.785929    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a7e15c1_ae3a_4481_880e_ab5127d744b2.slice/crio-c9bac7ef335f8bbe39f4b257358fc51d115d8d63acb98a9cbe73b939c99ad96c WatchSource:0}: Error finding container c9bac7ef335f8bbe39f4b257358fc51d115d8d63acb98a9cbe73b939c99ad96c: Status 404 returned error can't find the container with id c9bac7ef335f8bbe39f4b257358fc51d115d8d63acb98a9cbe73b939c99ad96c
Sep 18 14:28:46.788267 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:46.788249    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 14:28:47.074681 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:47.074593    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/must-gather-qxtx9" event={"ID":"5a7e15c1-ae3a-4481-880e-ab5127d744b2","Type":"ContainerStarted","Data":"c9bac7ef335f8bbe39f4b257358fc51d115d8d63acb98a9cbe73b939c99ad96c"}
Sep 18 14:28:48.089041 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:48.088990    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/must-gather-qxtx9" event={"ID":"5a7e15c1-ae3a-4481-880e-ab5127d744b2","Type":"ContainerStarted","Data":"25628648f1f723cd584c18c14f3f3ae8320e9e73754c3e99088c0e44eceb77aa"}
Sep 18 14:28:48.089605 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:48.089575    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/must-gather-qxtx9" event={"ID":"5a7e15c1-ae3a-4481-880e-ab5127d744b2","Type":"ContainerStarted","Data":"1eb15a2d7359fc4bc53685bcf900ed4076e4eeb0f37d3652669e228dcab43789"}
Sep 18 14:28:48.105600 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:48.105556    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkp9v/must-gather-qxtx9" podStartSLOduration=1.3301317990000001 podStartE2EDuration="2.10554111s" totalImagesPullingTime="775.409311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:28:48.103169097 +0000 UTC m=+2638.602926614" watchObservedRunningTime="2026-09-18 14:28:48.10554111 +0000 UTC m=+2638.605298626"
Sep 18 14:28:49.291958 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:49.291927    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ndscd_84b66f8e-7942-4042-9efd-70a021a82dcc/global-pull-secret-syncer/0.log"
Sep 18 14:28:49.460083 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:49.460045    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-plsw9_b97b228b-a6b4-4ac4-9f09-0ac08a6eacc9/konnectivity-agent/0.log"
Sep 18 14:28:49.535981 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:49.535935    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-83.ec2.internal_2efc99fa65034a5832afc3d8ace1de6d/haproxy/0.log"
Sep 18 14:28:54.058770 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:54.058742    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-bkfdg_49810666-cb3c-4a79-a030-83e78aeb5b7c/limitador/0.log"
Sep 18 14:28:54.136060 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:54.135978    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-snjlp_9cada3d3-d5b3-4873-9847-833f730f873b/manager/0.log"
Sep 18 14:28:55.706790 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.706752    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/alertmanager/0.log"
Sep 18 14:28:55.736029 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.735993    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/config-reloader/0.log"
Sep 18 14:28:55.762837 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.762810    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/kube-rbac-proxy-web/0.log"
Sep 18 14:28:55.786736 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.786710    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/kube-rbac-proxy/0.log"
Sep 18 14:28:55.812177 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.812110    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/kube-rbac-proxy-metric/0.log"
Sep 18 14:28:55.841221 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.841192    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/prom-label-proxy/0.log"
Sep 18 14:28:55.870256 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.870230    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cad684c-2b16-4ca2-8075-04a1ecc972f2/init-config-reloader/0.log"
Sep 18 14:28:55.954564 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.954526    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-6blnb_57ca3ede-b204-497b-b8a6-2e4553956f59/kube-state-metrics/0.log"
Sep 18 14:28:55.973724 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.973632    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-6blnb_57ca3ede-b204-497b-b8a6-2e4553956f59/kube-rbac-proxy-main/0.log"
Sep 18 14:28:55.998394 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:55.998349    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-6blnb_57ca3ede-b204-497b-b8a6-2e4553956f59/kube-rbac-proxy-self/0.log"
Sep 18 14:28:56.038649 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.038622    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bc7f59784-xqgtz_b5c12235-a374-4f3c-9ffa-63875b4e3220/metrics-server/0.log"
Sep 18 14:28:56.071330 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.071300    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-qmwpv_de53dcc7-67ed-4179-8b1a-d8e731d51027/monitoring-plugin/0.log"
Sep 18 14:28:56.105539 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.105516    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5dp2d_91a04d31-8407-43af-9fd0-80930a4aa722/node-exporter/0.log"
Sep 18 14:28:56.127616 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.127585    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5dp2d_91a04d31-8407-43af-9fd0-80930a4aa722/kube-rbac-proxy/0.log"
Sep 18 14:28:56.152952 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.152928    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5dp2d_91a04d31-8407-43af-9fd0-80930a4aa722/init-textfile/0.log"
Sep 18 14:28:56.370939 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.370861    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-b9r6t_6c517134-a308-4f7a-9873-20711558c4bf/kube-rbac-proxy-main/0.log"
Sep 18 14:28:56.394842 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.394815    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-b9r6t_6c517134-a308-4f7a-9873-20711558c4bf/kube-rbac-proxy-self/0.log"
Sep 18 14:28:56.421312 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.421285    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-b9r6t_6c517134-a308-4f7a-9873-20711558c4bf/openshift-state-metrics/0.log"
Sep 18 14:28:56.490588 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.490557    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/prometheus/0.log"
Sep 18 14:28:56.519325 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.519300    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/config-reloader/0.log"
Sep 18 14:28:56.556842 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.556806    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/thanos-sidecar/0.log"
Sep 18 14:28:56.590619 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.590592    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/kube-rbac-proxy-web/0.log"
Sep 18 14:28:56.619457 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.619431    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/kube-rbac-proxy/0.log"
Sep 18 14:28:56.651556 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.651532    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/kube-rbac-proxy-thanos/0.log"
Sep 18 14:28:56.677894 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.677862    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40134054-bdbd-4913-82c5-44f5f2cb7af8/init-config-reloader/0.log"
Sep 18 14:28:56.716403 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.716370    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-2lrls_132ef21b-5fb2-4810-8a2c-35cc263c1c49/prometheus-operator/0.log"
Sep 18 14:28:56.754532 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.754489    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-2lrls_132ef21b-5fb2-4810-8a2c-35cc263c1c49/kube-rbac-proxy/0.log"
Sep 18 14:28:56.780011 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:56.779980    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-lshww_d555ce44-2e52-4391-b18f-b34ccd31e32f/prometheus-operator-admission-webhook/0.log"
Sep 18 14:28:57.036375 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:57.036336    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4f75dfc4-pjnrn_cd8773e0-c384-428b-8766-88b19277968f/thanos-query/0.log"
Sep 18 14:28:57.067686 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:57.067651    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4f75dfc4-pjnrn_cd8773e0-c384-428b-8766-88b19277968f/kube-rbac-proxy-web/0.log"
Sep 18 14:28:57.103029 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:57.102975    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4f75dfc4-pjnrn_cd8773e0-c384-428b-8766-88b19277968f/kube-rbac-proxy/0.log"
Sep 18 14:28:57.127033 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:57.127000    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4f75dfc4-pjnrn_cd8773e0-c384-428b-8766-88b19277968f/prom-label-proxy/0.log"
Sep 18 14:28:57.154732 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:57.154696    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4f75dfc4-pjnrn_cd8773e0-c384-428b-8766-88b19277968f/kube-rbac-proxy-rules/0.log"
Sep 18 14:28:57.181244 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:57.181194    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4f75dfc4-pjnrn_cd8773e0-c384-428b-8766-88b19277968f/kube-rbac-proxy-metrics/0.log"
Sep 18 14:28:59.728591 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.728550    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"]
Sep 18 14:28:59.733629 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.733600    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.743588 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.743130    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"]
Sep 18 14:28:59.850220 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.850192    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59d77c5f84-6h7v4_ab386b76-992f-4d75-822c-9e535632d5aa/console/0.log"
Sep 18 14:28:59.890745 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.890708    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-sys\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.890937 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.890841    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-proc\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.890937 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.890875    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-lib-modules\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.890937 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.890905    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ptzb\" (UniqueName: \"kubernetes.io/projected/89dd86fc-1b3f-4425-8739-436456ea4978-kube-api-access-4ptzb\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.891092 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.890981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-podres\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.992293 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.992186    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-proc\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.992556 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.992536    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-lib-modules\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.992705 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.992689    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ptzb\" (UniqueName: \"kubernetes.io/projected/89dd86fc-1b3f-4425-8739-436456ea4978-kube-api-access-4ptzb\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.992844 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.992830    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-podres\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.993015 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.993001    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-sys\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.993253 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.993235    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-sys\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.993365 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.992441    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-proc\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.993624 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.993594    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-lib-modules\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:28:59.993727 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:28:59.993709    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89dd86fc-1b3f-4425-8739-436456ea4978-podres\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:29:00.005148 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:00.004564    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ptzb\" (UniqueName: \"kubernetes.io/projected/89dd86fc-1b3f-4425-8739-436456ea4978-kube-api-access-4ptzb\") pod \"perf-node-gather-daemonset-wbvf6\" (UID: \"89dd86fc-1b3f-4425-8739-436456ea4978\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:29:00.049283 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:00.049246    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:29:00.337490 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:00.336613    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"]
Sep 18 14:29:00.347361 ip-10-0-132-83 kubenswrapper[2585]: W0918 14:29:00.347322    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89dd86fc_1b3f_4425_8739_436456ea4978.slice/crio-eb8b06490b7b6979fd1851334ab9661aa1e88618c3f4a8ba8cff9ef8068ffdf1 WatchSource:0}: Error finding container eb8b06490b7b6979fd1851334ab9661aa1e88618c3f4a8ba8cff9ef8068ffdf1: Status 404 returned error can't find the container with id eb8b06490b7b6979fd1851334ab9661aa1e88618c3f4a8ba8cff9ef8068ffdf1
Sep 18 14:29:01.209322 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.209275    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6" event={"ID":"89dd86fc-1b3f-4425-8739-436456ea4978","Type":"ContainerStarted","Data":"20fd64740ba0d7eed23549c4b6852e920b7b90fa6109a6b593944cf256420eae"}
Sep 18 14:29:01.209837 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.209358    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:29:01.209837 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.209385    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6" event={"ID":"89dd86fc-1b3f-4425-8739-436456ea4978","Type":"ContainerStarted","Data":"eb8b06490b7b6979fd1851334ab9661aa1e88618c3f4a8ba8cff9ef8068ffdf1"}
Sep 18 14:29:01.226491 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.226432    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6" podStartSLOduration=2.22639649 podStartE2EDuration="2.22639649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:29:01.224840412 +0000 UTC m=+2651.724597928" watchObservedRunningTime="2026-09-18 14:29:01.22639649 +0000 UTC m=+2651.726154005"
Sep 18 14:29:01.769819 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.769794    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4zk86_397cdb97-e628-45dc-9eb3-4c9c2d625a4f/dns/0.log"
Sep 18 14:29:01.792290 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.792256    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4zk86_397cdb97-e628-45dc-9eb3-4c9c2d625a4f/kube-rbac-proxy/0.log"
Sep 18 14:29:01.910939 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:01.910911    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dx8b2_c80e0886-d3f2-44d1-80e0-530225fed07f/dns-node-resolver/0.log"
Sep 18 14:29:02.556962 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:02.556932    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95mk2_5516f495-0ad8-4b3e-944f-af53249e703c/node-ca/0.log"
Sep 18 14:29:04.466754 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:04.466725    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/0.log"
Sep 18 14:29:04.470342 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:04.470322    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/1.log"
Sep 18 14:29:04.507767 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:04.507740    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7tzk2_48cf3aef-a227-4491-8f30-5c0cba76fe84/payload-pre-processing/0.log"
Sep 18 14:29:04.543498 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:04.543472    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z44zd_1e2d11ab-7c5b-462b-a830-c9f669899f7b/payload-processing/0.log"
Sep 18 14:29:05.453982 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:05.453902    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbg95_ab7c2cf7-0685-45d0-9266-7ee4ed4e9092/serve-healthcheck-canary/0.log"
Sep 18 14:29:06.144950 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:06.144923    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjstv_0980c7b1-f1b1-4041-ba15-8e2a773f1d52/kube-rbac-proxy/0.log"
Sep 18 14:29:06.165621 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:06.165587    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjstv_0980c7b1-f1b1-4041-ba15-8e2a773f1d52/exporter/0.log"
Sep 18 14:29:06.188529 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:06.188492    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjstv_0980c7b1-f1b1-4041-ba15-8e2a773f1d52/extractor/0.log"
Sep 18 14:29:07.237731 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:07.237698    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-wbvf6"
Sep 18 14:29:08.442201 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:08.442170    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7ll9m_e9a20003-2003-42ed-b83d-c65844bffee3/manager/0.log"
Sep 18 14:29:09.170949 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:09.170916    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ksxrr_6c3cb0f4-ca2a-4ca0-8d21-7a88b9015548/manager/0.log"
Sep 18 14:29:09.378862 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:09.378833    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-thpx8_68ea6f09-8002-47b7-ab3a-a54ee263dc04/manager/0.log"
Sep 18 14:29:09.401231 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:09.401205    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-thpx8_68ea6f09-8002-47b7-ab3a-a54ee263dc04/copy-manifests/0.log"
Sep 18 14:29:10.729637 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:10.729583    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f877cc68b-krq7z_98a7dc55-9f23-44d4-afc2-492760d62fd4/manager/0.log"
Sep 18 14:29:11.301792 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:11.301694    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/0.log"
Sep 18 14:29:11.305572 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:11.305543    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/1.log"
Sep 18 14:29:11.337108 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:11.337054    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7tzk2_48cf3aef-a227-4491-8f30-5c0cba76fe84/payload-pre-processing/0.log"
Sep 18 14:29:11.368179 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:11.368145    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z44zd_1e2d11ab-7c5b-462b-a830-c9f669899f7b/payload-processing/0.log"
Sep 18 14:29:13.905813 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:13.905641    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/0.log"
Sep 18 14:29:13.909327 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:13.909298    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-kvtb6_9fb05eff-a90e-45b4-af4a-9d3bdab2f57b/istio-proxy/1.log"
Sep 18 14:29:13.939762 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:13.939730    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7tzk2_48cf3aef-a227-4491-8f30-5c0cba76fe84/payload-pre-processing/0.log"
Sep 18 14:29:13.967879 ip-10-0-132-83 kubenswrapper[2585]: I0918 14:29:13.967842    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z44zd_1e2d11ab-7c5b-462b-a830-c9f669899f7b/payload-processing/0.log"